yolo-auto
Sure, sign up and ping me in discord
Ok well I need a way to securely give you an API key for you to try it out but I don't really want to post it on HN so I'm open to ideas lol
~100tok/s average
but were losing money right now obviously.
we did come from 4x 3090s could actually make money, but we thought a couple hundred bucks a month isnt worth a 100 degree office.
People are dumping 128k cold documents in like its their job. Some dudes hit 2 billion + tokens a week.
its been fun though. you should check it out
If it helps, there's really no reason to ever log into our site after you get an API Key. I guess until you want to make another api key
Show HN: An unmetered LLM API–$6/month, no token tracking, no limits
Hi HN,I was once given the advice: Don't waste expensive frontier model credits (GPT/Claude/etc.) on bulk work. Send the boring, repetitive, high-volume jobs to a smaller model, and save the expensive prompts for when you actually need frontier-level reasoning. I complained and told my manager that I shouldnt have to think about using certain models for certain coding tasks, and that one model...
We are doing some weird q4 on 3090s now that is surprisingly good (for qwen) .
will people pay for it? Yeah, sometimes. Some dude just burned 80mil tokens in 24 hr and posted it to our discord. I'd say he's getting 600 pennies worth.
I think the best part is that no one is watching what your doing, you don't worry, and it's fun.
Also just as divided as people are to whether it's a good deal or not, people are divided on liking/hating the name and brand.
Story of How Im Running an Unlimited $6/Month AI Provider on 4x RTX 3090s
This submission is a tale about how I launched an unlimited LLM provider to about 60 hyped people on the waitlist, then immediately served them a fully dysfunctional death-loop model, and how most people, very reasonably, disappeared, but thanks to a few extremely nice people stuck around anyway, we kept the project alive and its still pretty chaotic but gaining traction.To back up a little...