News for hackers. Stuff that matters.

yolo-auto

lmao dont hurt yourself
Hi danger dingo,

Sure, sign up and ping me in discord

Well, are you a robot?

Ok well I need a way to securely give you an API key for you to try it out but I don't really want to post it on HN so I'm open to ideas lol

1x MI300x , rocm/sglang , highly optimized image, FP8, FP16 Cache (this fixes looping issues with qwen3.6-35b

~100tok/s average

actually the math is more like $1500 a month on a MI300x on a highly optimized rocm/sglang image and everyone's getting 100+ tok/sec and we have 100 active people and plenty of room for others.

but were losing money right now obviously.

we did come from 4x 3090s could actually make money, but we thought a couple hundred bucks a month isnt worth a 100 degree office.

People are dumping 128k cold documents in like its their job. Some dudes hit 2 billion + tokens a week.

its been fun though. you should check it out

i know, but im scared to own our own auth, when there's money involved... too cheap to pay for a service. So we lean on the back of the giants for now.

If it helps, there's really no reason to ever log into our site after you get an API Key. I guess until you want to make another api key

Show HN: An unmetered LLM API–$6/month, no token tracking, no limits

https://yolo-auto.com/

Hi HN,I was once given the advice: Don't waste expensive frontier model credits (GPT/Claude/etc.) on bulk work. Send the boring, repetitive, high-volume jobs to a smaller model, and save the expensive prompts for when you actually need frontier-level reasoning. I complained and told my manager that I shouldnt have to think about using certain models for certain coding tasks, and that one model...

( Read More... | 13 comments | 4 points | on HN )
So on mi 300x we run FP8 and that was original plan.

We are doing some weird q4 on 3090s now that is surprisingly good (for qwen) .

will people pay for it? Yeah, sometimes. Some dude just burned 80mil tokens in 24 hr and posted it to our discord. I'd say he's getting 600 pennies worth.

I think the best part is that no one is watching what your doing, you don't worry, and it's fun.

Also just as divided as people are to whether it's a good deal or not, people are divided on liking/hating the name and brand.

Story of How Im Running an Unlimited $6/Month AI Provider on 4x RTX 3090s

This submission is a tale about how I launched an unlimited LLM provider to about 60 hyped people on the waitlist, then immediately served them a fully dysfunctional death-loop model, and how most people, very reasonably, disappeared, but thanks to a few extremely nice people stuck around anyway, we kept the project alive and its still pretty chaotic but gaining traction.To back up a little...

( Read More... | 3 comments | 4 points | on HN )