electroglyph

AA's intelligence score is based on many benchmarks, you can go look at them all individually if you'd rather focus on specific areas.

size doesn't really have a correlation if u look at the hallucination benchmarks. this is mostly mitigated thru post training imo. also, deepseek 4.1 is notorious for hallucinations, so kinda ironic to mention it as an example here =)

same, not a fan of the new icon tbh

that nemotron model is such a dog, like all the other nemotrons

but pro isn't very good...

Rust scores a lot higher on the safe scale than Python scores on the fast scale. Also, who are these mythical people that call Python fast?

this will be quite obsolete by the time the weights are released. still though, it's always good to see open weight releases

Welcome to Costco, I love you.

of course they can do math, how is this even controversial in 2026?

hopefully someone on the team sees this and fixes the situation, otherwise, if it's good, i'm sure somebody else will open the PR. thanks for your contribution.

they don't always operate within the parameters tho. some N% of the time they decide to do whatever they feel like doing. multiply that times a lot of agents and you invariably get a rogue agent every once in a while.

way less of a blocker these days due to sparse attention...

what the fuck did i just read?

those are all expecting far too much for models this size

do you just manually type out your important instructions every time instead of being smart and putting a few lines in a text file?

prismml's title is very misleading. in their own paper the model is at 75% of coding scores.

mimo 2.5 has been a big underperformer since shortly after it's release imo. i cancelled my sub after the first month. purposefully using 2.5 right now is just handicapping yourself for no reason.

oh man, you're going to be blown away then once you use a real model

good stuff, no mention of confidence tho, recommend having a look at diffusiongemma and others.

Opus 5 literally benchmarks higher than Fable

Good on them for the retraction. It's good to see science at work.

it's not a schooner...it's a sailboat

i would assume a model this size would require finetuning tbh. even functiongemma recommends that.

my experience is the same, but deepseek is planning on increasing prices soon, which will make it a lot less attractive

yep, agreed. little bit smarter than deepseek 4 flash, but a little bit worse at tool calls.

the cats can traverse a fence, hole or not, so not sure that's relevant?

If it makes you feel any better, my apology was genuine.

Such a weird project. Does the world really need this?

i handed out so many upvotes here, good work everybody!