I burned all my tokens researching how to save tokens

Re:I burned all my tokens researching how to save tokens by jack_pp on Sunday July 19, 2026 @10:20AM (#48968451)

Unlees you invest thousands your local ai won't even come close to the cheap cloud llms. Local is only worth it if you care about privacy or have a legitimate usage for the hardware otherwise. Money wise it isn't worth it

[ Parent | on HN ]

Re:I burned all my tokens researching how to save tokens by Bender on Sunday July 19, 2026 @12:04PM (#48969313)

I think you bring up a good point about privacy. Companies probably should not be handing over intellectual property to cloud AI third party vendors. Perhaps all of that should stay on-prem and then the cloud vendors could be used to fill in the gaps.

[ Parent | on HN ]

Re:I burned all my tokens researching how to save tokens by alchemism on Monday July 20, 2026 @11:02AM (#48979860)

Enterprises running in public clouds have Zero Data Retention policies with the vendor. Routing the ai spend through Azure or AWS usually bring these policies along with it, ie enterprise data and useage is not ingested to retrain the model.

[ Parent | on HN ]

Re:I burned all my tokens researching how to save tokens by arijun on Sunday July 19, 2026 @11:27PM (#48974038)

I mean, if you're using one of the $200/month plans, you'd recoup the cost in a year or two.

[ Parent | on HN ]

Re:I burned all my tokens researching how to save tokens by TOMDM on Monday July 20, 2026 @12:14AM (#48974270)

You're not running an Opus 4.8/GPT 5.6 tier model on $5k of hardware at a useful Tok/s

[ Parent | on HN ]

Re:I burned all my tokens researching how to save tokens by nicman23 on Monday July 20, 2026 @01:30AM (#48974679)

the qwen 27b is quite good for doing a mvp

[ Parent | on HN ]