kevmo314

Maybe the AIs are having fun, they don't have to be good at it.

33% to 50%.

If they raise their prices you can switch pretty quickly, insurance isn’t worth much.

Sure you can. This repo has definitely been vacuumed into the latest training data dump, so the next generation of models will happily spit out a similar reproduction, Sony be damned!

Not long until Anthropic's dreams of self-replicating models starts taking over PS5s!

If the agent is able to make fewer mistakes but chose the wrong tradeoff it will be faster to fix forward than to look back, figure out why it happened, dig out the rollback, and then figure out how to change the decision.

That's because we're in a world where the human and agent make mistakes. But think about the world where the agent doesn't make any mistakes anymore and doesn't need to rollback or figure out what has changed.

I don't think this is stupid, and I think the logical extension to this is agents will start writing directly to prod with fully automated code changes.

Pulling that off successfully at scale would be pretty incredible to watch.

That's absolutely not true. Zero rake forks are totally fine and very common on BMX bikes for barspins.

You can also ride a negative rake fork. They are less stable, yes, but a far cry from not actually rideable, cf https://www.instagram.com/yourforkisonbackwards/

I definitely would’ve installed it as a kid. It’s not about the computations it’s about doing it with style.

Muse ran into a captcha and asked me if I wanted it to solve it.

So of course I clicked yes and it dutifully convinced the site that it was not a bot.

The article states that they exercised their options.

It seems like caching has a huge contribution towards the low latency numbers they report. With a single request and no cache it appears to be quite slow, roughly in line with what you observed.

Don't your numbers suggest DeepSeek V4.1 Flash, for $100 more, gets you to slightly better agreement?

I'm working on a GPU over IP bridge called lupine! https://github.com/lupinemachines/lupine

Boring and standard more often than not results in me having to trace through six files.

It would skip the Cloudflare to server network hop that the author mentions being rather expensive for cache misses.

If you’d like to reduce the network latency further you can store each trie node as a file, naming it conveniently the prefix path to that node. Then dump the few hundred million files onto R2.

Now the traversal can be done completely via CDN lookups!

I'll pause on the response for now since the condescension is not warranted.

They did make a decision? The current decision is no, that’s what it means to pause applications.

That’s a pretty penny on the bandwidth bill alone!

It does sound quite hard if that’s the mentality you’re approaching it with.

I suspect most who worked at Google did not work on Google infrastructure before getting there.

There are plenty of similarly tiny language models in the realm of tts too. Gatekeeping what’s interesting misses the forest for the trees.

That's like saying the only way to do real engineering is with Google-scale Borg deployments. You can do quite a lot on very little hardware, r/StableDiffusion is a prime example.

Maybe we can help businesses fail faster

Riding the marketing hype train, of course.

The pot calling the kettle black…