NURL registrynurl-lang.org →0.4.612 file(s) · 112.8 KB unpacked
nurl.toml | 2.6 KB |
src/hf.nu | 20.6 KB |
src/tokenizer.nu | 34.0 KB |
src/main.nu | 4.6 KB |
src/unigram.nu | 25.8 KB |
tests/unigram_check.nu | 2.2 KB |
tests/unigram_test.sh | 2.8 KB |
tests/tokenizer_test.sh | 4.4 KB |
tests/data/unigram_golden.txt | 1.3 KB |
tests/data/unigram_corpus.txt | 960 B |
CHANGELOG.md | 9.4 KB |
README.md | 4.2 KB |