NURL registrynurl-lang.org →0.4.112 file(s) · 104.4 KB unpacked
nurl.toml | 2.6 KB |
src/hf.nu | 20.5 KB |
src/tokenizer.nu | 29.2 KB |
src/main.nu | 4.6 KB |
src/unigram.nu | 26.1 KB |
tests/unigram_check.nu | 2.2 KB |
tests/unigram_test.sh | 2.8 KB |
tests/tokenizer_test.sh | 4.4 KB |
tests/data/unigram_golden.txt | 1.3 KB |
tests/data/unigram_corpus.txt | 960 B |
CHANGELOG.md | 5.6 KB |
README.md | 4.2 KB |