News for hackers. Stuff that matters.

A comment on You Should Probably Pay Attention to Tokenizers. Parent comment

Re:You Should Probably Pay Attention to Tokenizers by Der_Einzige on Wednesday October 23, 2024 @03:56PM (#41928753)
I wrote a whole paper about this exact topic! (Syntactic, phonetic, and related constraints)

https://aclanthology.org/2022.cai-1.2/

[ Parent | on HN ]

There are no comments on this comment yet.