Re:Show HN: I made the slowest, most expensive GPT
by toomuchtodo on Friday December 13, 2024 @01:40PM
(#42411114)
Reach out to benneo?
https://news.ycombinator.com/item?id=42403006 ("Ask HN: Ideas for spending $8k in Anthropic credits?")
Re:Show HN: I made the slowest, most expensive GPT
by wluk on Friday December 13, 2024 @01:56PM
(#42411240)
wow I wish I had the problem of too many credits. just reached out, thanks!
Re:Show HN: I made the slowest, most expensive GPT
by ricktdotorg on Friday December 13, 2024 @06:20PM
(#42413253)
to be fair to you tho, it's a lot easier to be almost-infinite-scale-ultimate-uptime SRE when you have an almost-infinite-scale-company CC/bank draft supporting you instead of your personal dalla is staked on a really cool PoC.
thank you. just seeing this and playing with this has expanded how i think about these type of systems
Update 2:30 PM ET: Back up (for now). Still waiting for Anthropic and Gemini quota increase requests, so those have been migrated to GPT-4o for now. Running on 2 VPCs, in the process of launching 2 more. Confident that I can increase the daily limits by EOD once everything's more stable.
Update 1:30 PM ET: HN blew up Ithy and it's 99% down right now, congrats ._.
1. I've exceeded my weekly Anthropic API limits; I've gotten in touch with their sales team and I've temporarily disabled the Anthropic model.
2. Blew past my Google API limits as well. I was using Gemini for prompting and aggregation, and I'm waiting for their quota increase response. In the meantime, I've switched to GPT-4o for the prompting/aggregation.
3. My VPC is at 100% CPU load. Launching more right now with some load balancing.
4. Limits were previously 5 anon / 20 per logged in user. Reduced this to 1 anon / 3 logged in while I deal with the load issues. Planning bring these back up as soon as everything's working again.
Hope to get this all back online within an hour or two. Sorry for the crappy launch. To think I was an SRE in a past life...