MaxikCZ

How dare you wrongthink

Seems okay to me

As many people that catch on, the same amount are new people that havent catched on yet.

32 gb of ram is gonna be your blocker for iq3, u will have to go iq2 and thus the output will suffer. At the plus side, it will spew faster than iq3.

Iq3xxs fits barely on my 10+64gb, so much that I am agresivelly cashing checkpoints to disk instead of keeping them in memory, moved vision from ram to disk too etc, I am sitting at few gigs left RAM and few hundred MB free on gpu.

I dont think its strata problem, its been running on my system for days without any crash.

"Model like this" not sute about ds v4.1 but qwen3.8 flash next is currently running on 10gb 3080 + 64 gb ddr5 ram at respectable 40-70t/s with 1200pp at max context

This is start of "companies are not liable for their actions" era.

I want my ai to be as cold as possible. I dont want a friend, I want a tool. I dont want my tool to pretend it has emotions.

Like when Miller in The Expanse talk to phone AI (https://m.youtube.com/watch?v=SC3bpJmGnPo) to trace Anubis flight, notice how the phone doesnt even reply in words.

Imagine if the phone instead replied with: "Thats a great insight, Anubis really goes there", it would be a joke. We are only tolerating it now because everyone is doing it.

Mac Air M1 in Safari here, buttery smooth.

Imho u are overestimating average buyer.

And even if they do google for best, Id bet all my m9ney that the truly average buyer wouldnt read 1/10th of that article.

Would be good if the hardware itself would get damaged by non-scanning laser before eye would.

What if I see myself writing a message in one minute, and thus I dont need to send that message back in in time for me from the future, coz ive already seen it, so I wont write it down for me in a minute?

> How is that relevant for the average buyer

Avg buyer wont read a token of tests before buying whats marketed best.the whole point in test like these is to provide non-average buyer with info average buyer doesnt care for.

"diversity is genocide with extra steps"

> Large costs of datacenters is largery electricity and floor space

Really? I would guess that those would be almost a rounding error on the price of gpus sitting in there

New models are trained with 8/4bit quantization in mind. Going from "native" 8 to 4 isnt as big of a step as going from 8 to 4 if native is full bf16.

The reason models running on low vram are not talked about enough is because they are just not worth it. Qwen3.8 27b changed that, but even 24gb vram is too low for it. Running better model faster at 12gb vram is where its now at, and thats why you see people talkin about it

I totally get that, Its just, regardless of how bit-quantized it is, they are still pulling 40t/s from model sitting mostly in RAM instead of VRAM. If I understand correctly they split the network parts very deliberately between VRAM and RAM, and I wonder if your program, of which main feature is "get most of your hardware" is capable of similar feats, or if that performace is still locked for those willing to spend days experimenting manually.

if fully custom compiler would find best settings for given setup, upload the setup to mothership and allow new peers to download it as good starting point.

Can it do all the shenanigans that allows to run qwen flash on 12GB vram over 40 toks like people seems to be getting in this thread?: https://www.reddit.com/r/LocalLLaMA/comments/1wp7zyb/qwen38f...

But isnt the whole point of Jev that "we trained it so you dont have to"? Yet it make such a simple mistakes still.

I was watching some youtube hype demo of it to pick items (each an emoji) from a pile according to questions. One of the questions was: "what can a magnet attract?" and it picked like 8 metal items, while a literal magnet was left unpicked. Ofc the video was too busy praising it to notice. Was all I needed to see

They just take away all the legal non-sucky options :(

Dont conflate "I know this is test case" with it being trained on it.

But its safe to say that pelicans on bicycles are disproportionally huge part of their training data

How about a choice: both "no, maybe later" and "no, never"

I looked it up and seems they just bash it with hammer? What are you eluding to?

Have you spent at least 10 seconds thinking about it or are you asking just out of spite?

Now you've convinced me.

That page runs at 2 fps on my Firefox, windows laptop with A2000 graphic card.

Cant be bothered to skim trough the video to see if he even revs it that high. None of the comments give any timestamp, but quite a few have the same complaint I do.

I bet the size difference plays a role, and a car turbo that spins to 200k rpm will definetly be smaller than a turbopump for rocket engine.