kennywinker
kennywinker on Hacker News
> Meta Ray Bans and even though I love the functionality
Which functionality do you love? Is it the nonconsensual recording? Or maybe the giving away your own privacy and the privacy of everyone around you to one of history's least-trustworthy companies?
It looked like there was a throat mic in the first shot... it seems counterintuitive that you'd get better performance out of lidar on face muscles than on a throat mic.
Two weeks late is hardly “enterprise level”
If they don’t have the resources to handle this, they should be recruiting more help from their community
Great idea, assuming that doesn't disable the entire system
New business idea: fitted faraday cages for smart tvs
> Is that true? Aren't they going to use those datacenters for training and robotics as well?
Sure, those things too. I was meaning “inference” as a shorthand for any ai workloads.
Whatever analogy you want to use: gas, data transfer, it doesn’t matter. My point is that all the capacity is being hoarded for future use making it feel like a scarce resource now.
If the demand grows like they say it will, then hoarding was a smart choice and the people who own the GPUs will make lots of money. If the demand doesn’t grow as fast and as much as they say, then hoarding was a bad call and the house of cards collapses and a lot of people will lose a lot of money.
To use your data transfer analog - during the dotcom bubble a ton of fiber was built. But after the bubble popped most of it went unused for years. Some of that “dark fiber” is still unused today, 25+ years later. Afaik it would have been a lot cheaper and more stable for the economy to lay that fiber more incrementally.
The compute they sold is based on the idea that the amount of money people spend on inference will continue to go up dramatically.
If we’re in a gas shortage, all that matters is who has the gas, true. But the issue is that we’re burning 50% of the gas that’s made every day, mean while the other 50% is being stockpiled based on the idea that everyone is going to drive 10x farther next year.
I (and millions of other people) literally had a netflix streaming subscription for 15 years (up until I cancelled it last year after 4 or 5 price hikes). The desire and ability to pay for stuff has always been there - but at the same time, there's a reason youtube has youtube content and netflix has netflix content.
The chinese models are being trained for less than a million a pop.
"flip me over without causing a neck injury, make no mistakes"
Entirely vibes based for the AA rankings.
For specific benchmarks, I’ve downloaded and used basically every model out there under 35b parameters - especially the tiny models: ling-3.0-tiny, spark-x2.6-4b, nanbeige, etc. etc. some of those tiny models are ranked VERY high on benchmarks like deepswe or terminalbench but are obviously incapable when you try to use them for swe or terminal based tasks.
If that’s benchmaxxing or a bad benchmark, idk, but it’s made me not trust the benchmarks much. If it benchmarks poorly, it’s probably bad. If it benchmarks well, it might be good.
Only because it aggregates all the other benchmarks. It still feels off. It felt off before the last two re-rankings, and it still feels off. Probably because the benchmarks its based on aren’t measuring the right things.
Can’t afford isn’t the only option. Unwilling to pay the bribe, or not invited to the party are also possible reasons.
Only if “western” models don’t show the same results, which we don’t know because they didn’t publish that data. Maybe there’s not much Tibetan data in any LLMs training sets
No that’d be in the training data. But it doesn’t indicate intent to censor or sabotage, it could just be that the lack of data involving tibet leads to poorer results.
Ice is under the executive branch. They are one and the same thing
But they aren’t following the constitution or the rule of law, hence rogue.
From an svg not rendered to pixels?
This is incorrect. Context and details matter in the law and we all agree that is a good thing. As an example - 1st degree murder, 2nd degree murder, and manslaughter are all different crimes even tho they’re all “killing a person” - the context matters.
Should the police wipe criminals phones? No.
Should the police wipe CSAM-adjacent data from phones to protect victims? Yes.
One is a consistent principal that is bad/cruel/overly broad. The other is a consistent principle that targets a specific harm.
I was sick when the news about php2shell broke, so ended up leaving two of my personal sites that use php un-patched for about 48 hours until my fever broke and I patched them. I didn’t get hacked. Was I just lucky and so shouldn’t infer anything about how hard it is to actually make use of this vulnerability? Probably.
Could one reverse the test? Feed ai generated svgs into the model and ask it to decide which of 10 animals (dog, cat, pelican, crocodile, etc) doing which of 10 actions (moonwalking, paddleboarding, sitting, riding a bicycle, etc.).
Not really. Kimi has 104B active parameters, so afaik that means you’d only need ~64gb vram to run an 8bit quantization of this, and potentially as little as 32gb to run a 4bit quantization. The rest, the MoE experts, can be in system ram… or if you’re willing to take the speed hit, offloaded to ssd. But yes you’d need a lot of system ram… like 1.5TB.
But that’s all kinda moot because I was referring to smaller open models, ones you could easily run on $1500 of hardware.
DDoS doesn’t require agents, so it’s not really a new threat
If you ask someone to turn down the heat in your home, and they start smashing all your windows, one might come the conclusion that we can’t afford to turn down the heat because the cost of repairing the windows is too high. Window smashing is still unrelated (or “orthogonal”) to turning down the thermostat.
distributed denial of pwnage, or DDoP for short.
I don’t know. You can run models that are in the ballpark of this on $1500 of hardware (e.g. strata on 12gb vram + 64gb ram), so I feel like unless you’re training stuff you either run smaller local models, rent your hardware, or pay for tokens.
Ranking existential threat higher than economic recession is orthogonal to austerity. If your problem is austerity, complain about that - not climate action.
South of the equator they go counter-clockwise