• Features
  • Pricing
  • Contact
    Login with:
  • Features
  • Pricing
  • Contact
Login with:
master
tokenizers
Repository badge with B rating
View on GitHub

  • 524 issues
  • 0 pull requests
  • 100 files
  • 1 active branch

CodeFactor Rating B

  • {{format.Name}}
Grade
Name
Complexity
Churn
Issues
A
bindings\node\lib\bindings\models.js
1 -
A
bindings\node\lib\implementations\tokenizers\bert-wordpiece.tokenizer.ts
9 1 -
A
bindings\python\py_src\tokenizers\tools\__init__.py
1 -
A
bindings\node\lib\bindings\utils.js
1 -
A
bindings\node\lib\implementations\tokenizers\bpe.tokenizer.ts
7 1 -
F
bindings\node\lib\bindings\models.test.ts
40 1 38
A
bindings\node\lib\implementations\tokenizers\byte-level-bpe.tokenizer.ts
6 1 -
D
bindings\node\lib\implementations\encoding.test.ts
14 1 22
A
bindings\node\lib\implementations\tokenizers\index.ts
1 -
A
bindings\node\lib\bindings\native.js
1 -
A
bindings\node\lib\implementations\tokenizers\sentence-piece-bpe.tokenizer.ts
6 1 1
A
bindings\node\lib\index.ts
1 -
A
bindings\node\lib\bindings\native.prod.js
1 -
A
bindings\python\build-sdist.sh
1 -
A
bindings\node\lib\bindings\normalizers.js
1 -
A
bindings\python\conftest.py
6 1 -
A
bindings\python\examples\custom_components.py
1 2
A
.github\workflows\rust.yml
1 -
C
bindings\node\lib\bindings\normalizers.test.ts
9 1 16
A
bindings\python\examples\example.py
3 1 2
  • Previous Page
  • Next Page
  • Security
  • Terms
  • Privacy
  • Contact
© 2026 CodeFactor

We use cookies in order to offer you the most relevant information. See our Privacy Policy.