News for hackers. Stuff that matters.
Re:You Should Probably Pay Attention to Tokenizers by SEGyges on Wednesday October 23, 2024 @01:00PM (#41926979)
you might have better luck giving the LM the original document and having it generate its own OCR independently, then asking the llm to tiebreak between its own generation and the OCR output while the image is still in the context window until it is satisfied that it got things correct

There are no comments on this comment yet.