badatnames

I've worked in a few places that had ultra-privileged analysis tools, would it really be a surprise to learn their security team has an MCP that queries a full text index of all user inputs. It would almost be more surprising to learn they don't, seems the kind of thing that would be invaluable for model research too

Just an observation, but my first thought was how energy demand strongly correlates with economic growth and wondered if the article could be cast in that light. Might be fun to overlay that graph with UK gilt rates

edit: helpful robot boyfriend plotted it https://i.imgur.com/Hp199vV.png

> this can be a matter of scaling at 50% capacity

At which point we're paying double just to work around cold start latency, which was the original point.

That's only how it works when misapplying mean() to characterise application performance. In your scenario, every request is hitting either an overloaded instance, or when scaled down, a 20-30 second wait for spin up, better hope they're neither interactive nor some jobs configured with a short timeout. The mechanisms are so completely different they're hard to even make meaningful comparisons between

So long as you don't count >2 orders of magnitude difference in scaleup time as particularly special..

These one-sided arguments come up every time there's a Lambda thread. They're useful and easily cheaper almost anywhere you have sparse compute or RAM requirements, even for heavyweight tasks like transcoding. A t3.nano meanwhile can simultaneously be overpriced ($3.50 for an idle task) and a bottleneck (30Mbit/s sustained network) in just as many places as a Lambda could be applied incorrectly.

There is a collection of these someplace. Rust is better but it'll never be perfect, news at 10

> Even formats like H.264 are being dropped from some hardware decode engines because it’s so easy to do on CPUs now, as can be seen even on the Raspberry Pi 5

CPU decode efficiency most certainly was not the reason h.264 was dropped on the Pi

I'm simply not seeing this

DS4 (not 4.1) crossed my dont-care threshold and I genuinely stopped paying attention to new models. I'd love to try GLM 5.3 but I just don't see any point in spending the effort any more. I can get passable intelligence for a bargain price either direct from China or from a ZDR EU provider for a small markup. Paying 10x more will not make me 10x happier, it's unlikely to make me even 1.1x happier now I've got some intuition for the natural limits of these models.

I don't even bother checking how much I spent on API any more, its well under $30 over the past 2 months despite daily constant use. Who even needs a subscription at these numbers?

This interminable argument has been raging at least since the days of the East India Company, I'm sure even Jesus had some thoughts on the preferential relationship the money changers had with the temple. It makes the world go round. All the wealth used to train these models comes from compatible relationships between power and creativity, and we rely on that compatibility. That a regime to lock out US vendors from European infrastructure contracts was even necessary is too fresh a story to reduce it to a complaint as boring as regulatory capture, go ask the folk in Greenland for their thoughts.

Their paper shows this comes with huge quality loss, but that doesn't make it a negative result by any means

Yes, and image editors absolutely can. If JXL lets me correct over/underexposed images by default everywhere I find them then it's worth it even just for that reason alone

> This is a pretty grim prognosis for European AI.

I think it's an incomplete read. What's the point in competing for a sizeable percentage of your funding when the finish line is incrementally being moved each month? Better spend it on leapfrogs which they seem to have done.

Meanwhile Mistral have a natural ace in their pocket with respect to regulation in the form of CADA and the Cloud Sovereignty Framework. I can't think of another company that would qualify as SOV-3 under that regime

Maybe we lived on different planets at the time, but watching the response at the start of the Ukraine war taught me the EU is little more than a disjointed balancing act with no real potency of its own outside of economic policy, and that seems unlikely to change in my lifetime. We are still buying their gas to this very day.

If trade stopped, AI capability would be the last thing on the minds of administrations in both regions. The question I think is more if EU can't compete (and we know we can't) who the more reliable partner is to depend on, especially where leaning towards dependence on that partner applies pressure to a recently highly unreliable partner.

Non-American maybe, but non-Chinese is likely impractical. We might not want their APIs, but we can't compete on energy and labour for training, even if it means buying licenses to host the weights (which CADA encourages). From China's perspective, what's the case for baking weights they can't sell? Some Chinese models already don't even have the Taiwan politics stuff baked in, those filters are only in their APIs.

I realised after writing this, the EU as is uncomfortably often the case, may be the real forcing function for what happens with US policy irrespective of the media campaigns we're presently seeing. Here's hoping for a steady trickle of stale ChatGPT weights leaking from EU infra providers in the long term.

It's a byproduct of the nannyism safety marketing from the AI companies. I'm glad these cases were caught, but disagree with how they were disposed of. If the automated flagging is good, enforce it by default. If it's noisy, refine the tech then enforce it by default. This middleground where everything going through the platforms is subject to training and arbitrary human inspection in the midst of an acrid cloud of marketing-driven fearmongering is unacceptable, and it reinforces the idea the fearmongering is legitimate.

Somehow humanity survived the past 40 years without Microsoft Word and Excel phoning home and shopping users to the feds at random, I don't see why the standard should be any different for this new class of tooling.

Low key ad instantly sold me. Awesome looking tool, bookmarked

The consistent reports I'm getting through friends who have spoken to recruiters is just that standards have increased dramatically. Firms accepting only a single candidate CV from a recruiter instead of 5 or more, and the recruiter downstream working their ass off to ensure it is absolutely the best possible CV, because if it's not then they don't get paid.

SpaceX is a different beast with extremely high friction to enter its market, a massive technology lead, and well developed preferential high level relationships with just about every country worth worrying about.

OpenAI/Anthropic meanwhile feel a bit like they're hoping to sell iPhones in a market about to be flooded by $20 flip phones, with almost no channel of their own to do it. And for whatever mad reason OpenAI are now signalling they will attempt to compete on price with flip phones despite their cost of labour, energy, and just about everything else being far higher

Because at some point keeping it up involves filing an S-1 that doesn't look like a garbage fire

It's asking a lot to trust they can or will maintain this new pricing. In any case it's exciting to think this might lead to further price cuts in the highly competent and competitive Chinese clones. I'm still using ChatGPT for interactive queries, but at this point pretty much only because of its familiar UI

I'm also not personally a fan of Ansible, but to claim it doesn't really work is quite breathtaking given the size of the installed base.

It reminds me a bit of what Ansible got right: user communication. The underlying tech may have existed for a long time, but the genius is presenting it to a regular developer in a way that reads "yes, even you can understand ML, just using a little JSON". The contribution of that should not be understated, as has been clearly evident recently.

Everything is always better with more YAML, are you perhaps new to this industry?

Next we also need an instruction style guide and CoC. It's important to treat your agents with respect. I almost forgot, the YAML template meta-language to YAML the YAML. Then we will need a foundation employing 12 FTEs to maintain it all and of course to run the certification process. You are certified, right? Statistics show a 10x increased chance of an agent going rogue and hacking competitors if it has been mistreated or been run in an unvalidated sandbox. It goes without saying the sandbox certification process is separate and must be repeated yearly by a trusted third party auditing company.

Please give us a hyper general cookie consent popup dismissal add-on :)

This is crying out to become an Excel or LibreOffice Calc add-in

What happened today ?

You know it's underdeveloped because everything is described as "basic" or "simple". There's no such thing in any complex design, yet somehow for all his purported seniority, he keeps pumping out designs using the same description.