• Features
  • Pricing
  • Contact
    Login with:
  • Features
  • Pricing
  • Contact
Login with:
master
tokenizers
Repository badge with B rating
View on GitHub

  • 524 issues
  • 0 pull requests
  • 100 files
  • 1 active branch

CodeFactor Rating B

  • {{format.Name}}
Grade
Name
Complexity
Churn
Issues
A
docs\source\conf.py
3 2 1
A
bindings\python\examples\example.py
3 1 2
A
bindings\python\tests\implementations\test_bert_wordpiece.py
3 2 -
A
bindings\python\examples\train_with_datasets.py
2 2 -
A
bindings\python\py_src\tokenizers\normalizers\__init__.py
2 1 -
A
bindings\python\tests\test_serialization.py
1 1 -
A
bindings\python\tests\implementations\test_base_tokenizer.py
1 1 -
A
bindings\node\jest.config.js
1 -
A
bindings\node\lib\bindings\trainers.js
2 -
A
.github\workflows\python-release-conda.yml
3 -
A
bindings\node\lib\bindings\decoders.js
2 -
A
bindings\node\lib\bindings\utils.js
1 -
A
.github\workflows\docs-check.yml
1 -
A
.github\workflows\python-release-extra.yml
2 -
A
bindings\node\lib\bindings\enums.ts
1 5
A
.github\workflows\python-release.yml
2 -
A
bindings\node\lib\bindings\models.js
1 -
A
bindings\node\lib\bindings\native.js
1 -
A
bindings\node\lib\implementations\tokenizers\index.ts
1 -
A
bindings\node\lib\index.ts
1 -
  • Previous Page
  • Next Page
  • Security
  • Terms
  • Privacy
  • Contact
© 2026 CodeFactor

We use cookies in order to offer you the most relevant information. See our Privacy Policy.