Features
Pricing
Contact
Login with:
×
Features
Pricing
Contact
Login with:
GitHub
Bitbucket
×
master
tokenizers
524
issues
0
pull requests
100
files
1
active branch
×
CodeFactor Rating B
{{format.Name}}
Grade
Name
Complexity
Churn
Issues
A
docs\source\conf.py
3
2
1
A
bindings\python\examples\example.py
3
1
2
A
bindings\python\tests\implementations\test_bert_wordpiece.py
3
2
-
A
bindings\python\examples\train_with_datasets.py
2
2
-
A
bindings\python\py_src\tokenizers\normalizers\__init__.py
2
1
-
A
bindings\python\tests\test_serialization.py
1
1
-
A
bindings\python\tests\implementations\test_base_tokenizer.py
1
1
-
A
bindings\node\jest.config.js
1
-
A
bindings\node\lib\bindings\trainers.js
2
-
A
.github\workflows\python-release-conda.yml
3
-
A
bindings\node\lib\bindings\decoders.js
2
-
A
bindings\node\lib\bindings\utils.js
1
-
A
.github\workflows\docs-check.yml
1
-
A
.github\workflows\python-release-extra.yml
2
-
A
bindings\node\lib\bindings\enums.ts
1
5
A
.github\workflows\python-release.yml
2
-
A
bindings\node\lib\bindings\models.js
1
-
A
bindings\node\lib\bindings\native.js
1
-
A
bindings\node\lib\implementations\tokenizers\index.ts
1
-
A
bindings\node\lib\index.ts
1
-
We use cookies in order to offer you the most relevant information. See our
Privacy Policy
.
Ok, got it!