News for hackers. Stuff that matters.
Re:Fable and the End of the Free Lunch by denverllc on Sunday August 23, 2026 @04:43PM (#49412441)
Write a detailed plan using a more expensive model and implement it using the cheaper one.
Re:Fable and the End of the Free Lunch by blfr on Sunday August 23, 2026 @05:02PM (#49412600)
How much are you saving once the more expensive model already has all the context loaded and ready to go?
Re:Fable and the End of the Free Lunch by csullivannet on Sunday August 23, 2026 @05:10PM (#49412686)
API calls get more expensive, not less, as you've loaded more context. This is exactly when you want to switch to cheaper models.
Re:Fable and the End of the Free Lunch by camdenreslink on Sunday August 23, 2026 @08:01PM (#49413802)
There is caching to consider. Switching models throws away the cached tokens.