NURL registrynurl-lang.org →0.3.212 file(s) · 105.5 KB unpacked
nurl.toml | 2.6 KB |
src/hf.nu | 22.4 KB |
src/tokenizer.nu | 29.2 KB |
src/main.nu | 5.0 KB |
src/unigram.nu | 26.5 KB |
tests/unigram_check.nu | 2.6 KB |
tests/unigram_test.sh | 2.8 KB |
tests/tokenizer_test.sh | 4.4 KB |
tests/data/unigram_golden.txt | 1.3 KB |
tests/data/unigram_corpus.txt | 960 B |
CHANGELOG.md | 3.8 KB |
README.md | 4.0 KB |