News for hackers. Stuff that matters.
Re:GPT-4o mini: advancing cost-efficient intelligence by film42 on Thursday July 18, 2024 @05:18PM (#40999848)
This has been my experience with any model with a large response token limit. I've had to work around this by running it through several times with specific questions about the data: extract text, extract tables, extract <specific detail>. They seem to do well on large input though so I just concat all the extracted info and things seem to work just fine.

There are no comments on this comment yet.