Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Tokenization Is the Bottleneck You're Not Measuring.
Github's BPE crate (https://crates.io/crates/bpe) advertises >10x speedup relative to HF, as do others.
There are no comments on this comment yet.
Github's BPE crate (https://crates.io/crates/bpe) advertises >10x speedup relative to HF, as do others.