Re:I cut Claude API costs from $70/month to pennies
by ok_orco on Monday January 26, 2026 @01:16PM
(#46769361)
I haven't thought about that, but really want to dig in more now. Any places you recommend starting?
[ Parent
| on HN ]
Re:I cut Claude API costs from $70/month to pennies
by LTL_FTC on Wednesday January 28, 2026 @12:13PM
(#46798262)
I started off using gpt-oss-120b on cpu. It uses about 60-65gb of memory or so but my workstation has 128gb of ram. If I had less ram, I would start off with the gpt-oss-20b model and go from there. Look for MoE models as they are more efficient to run.
My old threadripper pro was seeing about 15tps, which was quite acceptable for the background tasks I was running.