NURL registrynurl-lang.org →0.3.012 file(s) · 99.3 KB unpacked
nurl.toml | 2.2 KB |
src/hf.nu | 22.4 KB |
src/tokenizer.nu | 28.8 KB |
src/main.nu | 5.0 KB |
src/unigram.nu | 23.2 KB |
tests/unigram_check.nu | 2.6 KB |
tests/unigram_test.sh | 2.8 KB |
tests/tokenizer_test.sh | 4.4 KB |
tests/data/unigram_golden.txt | 1.3 KB |
tests/data/unigram_corpus.txt | 960 B |
CHANGELOG.md | 1.7 KB |
README.md | 4.0 KB |