Re:Show HN: Echo – Fable-level results at 1/3 the cost using...
by hahahaa on Friday July 24, 2026 @01:46AM
(#49031616)
Cache hits should be part of the strategy.
Re:Show HN: Echo – Fable-level results at 1/3 the cost using...
by lbriner on Friday July 24, 2026 @04:29AM
(#49032758)
You can use the Ralph Wiggum technique: https://ghuntley.com/ralph/
Else, you break the cache by doing a round robin of the same conversation across different models. Likely you'll end up paying more than what it would've cost with a cache aware system