Re:Fable and the End of the Free Lunch
by denverllc on Sunday August 23, 2026 @04:43PM
(#49412441)
Write a detailed plan using a more expensive model and implement it using the cheaper one.
[ Parent
| on HN ]
How much are you saving once the more expensive model already has all the context loaded and ready to go?
Re:Fable and the End of the Free Lunch
by csullivannet on Sunday August 23, 2026 @05:10PM
(#49412686)
API calls get more expensive, not less, as you've loaded more context. This is exactly when you want to switch to cheaper models.
Re:Fable and the End of the Free Lunch
by camdenreslink on Sunday August 23, 2026 @08:01PM
(#49413802)
There is caching to consider. Switching models throws away the cached tokens.