cagenut

hey little tip while you assimilate and learn the language - property damage is not violence

in many ways, its the very thing that makes us people

I'm just barely starting to wrap my head around mapping model sizes and quants to hardware components and constraints.

I don't get what this device is for.

I a million percent understand wanting 252GB-VRAM, that would get me a 280-320B model like glm-5.3 or deepseek-v4-flash, which would be a massive improvement over my gpt-oss:20b 16GB toy. I would gladly pay a grand for this, I would never pay ten grand for this, and it seems to be priced around a hundred grand.

So obviously the customer is commercial not consumer.

Can anyone planning a project around one of these at work share what their workload is shaped like and how they're modeling price/performance?

For instance, I don't get the 512GB of system memory, I'd gladly drop that to 128 to save money. Am I missing something about commercial workloads? Is a 1T parameter model at 20 tok/s more important to your workload than a 300B one at 60? Is it simply a co-dependency of not the model but the other software you're running on the machine thats using/interacting-with/being-driven-by the model?

Whats your napkin math to justify 100k? Actually thats not even really the question, its more like - whats your napkin math to determine between the "dual linked GB10" use case vs this product's use case vs an 8U supermicro with 4 cards use case.

if its not worth your time to write, its not worth my time to read

this goes 10x for all the slide decks and google docs and wikislop everyone's trying to pass off as an accomplishment lately

I really hate how the excruciatingly overdue reckoning for tech elites and income inequality is turning into this religious schism over AI and datacenters.

We're going to smash the looms rather than figure out how to share them, again.

and flying. beef and flying are the two most impactful personal choices you can make (nearly everything else has a 'over a decade'/difficult-life-tradeoff factor). beef and flying are easy.

the downside is it allows us to continue to avoid solving the real problem

ideologues will tell you this is that all mankind suddenly lost their ability to exert self-discipline a few decades ago

science points to a broad combination of things like corn syrup and seed oils simply making food too addictivly-rewarding and calorie rich for our nervous and endocrine systems to handle.

so, do we reform the farm bill and fast food industries, or do we take the antidote?

there are dozens of us!

similar enough that i'll share, I think i learned this from an HN comment, you can put the code for a page in the url (with obvious limits):

this works as a "url" in both chrome and safari:

  data:text/html, <html contenteditable><head><title>notes</title></head><body><textarea rows=36 cols=140></textarea></body></html>

honestly, look internally. after the plane from qatar. after the son-in-law's real estate dealings. after the visible-to-everyone kalshi and oil futures bets frontrunning the administrations announcements. for you to still feel the need to frame things as "border-line (to be polite)" is, in and of itself, the perfect example of the overall problem.

take your inability to draw a clear-as-day conclusion and state it plainly and multiply it by another ~50M "centrists" who continue to believe that staying "not political" and "avoiding the news" is a viable strategy to just wait the problem out.

until the checked out cowards realize that strategy isn't going to work, things will continue to get worse.

"no politics" might as as well be the second maga slogan.

sorry thats too far left wing an opinion in america today

really? or is it just that you don't like the answer so you keep trying to find another one.

what historical examples of this very common pattern did you read up on?

is there anywhere good to read/follow to get operational clarity on this stuff?

my current system of looking for 1 in 1000 posts on HN or 1 in 100 on r/locallama is tedious.

so is love

this level of reductive thought termination goes nowhere

spacex is one thing but xai accomplished what? the most racist csam prone llm?

it was basically a mindless loop, very prime for being agent driven:

  - observe error rate uptick
  - maybe dig in with apm tooling
  - read actual error messages
  - compare what apm and logs said to last commit/deploy
  - if they look even tangentially related deploy the previous commit (aka revert)
  - if its still not fixed do a "debug push", basically stuff a bunch of print statements (or you can do better) around the problem to get more info

I won't say that solves every case but definitely 90% of them.

I think your point about preserving some amount of intent/context is good, but also like what are most of us doing with agents if not "loop on error message until it goes away".

after a decade of follow-the-sun deployments by php contractors from vietnam to costa rica where our only qa was keeping an eye on the 500s graph, ai can't scare me.

obviously you're not a devops eng, I think you're wildly under-estimating how much of business critical code pre-ai is completely orphaned anyway.

the people who wrote it were contractors long gone, or employees that have moved companies/departments/roles, or of projects that were long since wrapped up, or of people who got laid off, or the people who wrote it simply barely understood it in the first place and certainly don't remember what they were thinking back then now.

basically "what moron wrote this insane mess... oh me" is the default state of production code anyway. there's really no quality bar already.

it has been amazing to watch how much of agentic ai is driven by "can you write clear instructions to explain your goals and use cases" and "can you clearly define the rules of each step in your process."

People Make Games did a mini documentary on almost exactly what you're asking: https://www.youtube.com/watch?v=4PHT-zBxKQQ

Its three years old so things have slightly matured.

you could stuff the racks full of server-rack batteries (lfp now, na-ion maybe in a decade) and monetize the space and the high capacity grid connect

most of the hvac would sit idle tho

everybody read 'bullshit jobs' and basically agreed

at first that just meant many of us adopted a middle-aged-coasting career strategy after covid and/or having kids

but now management is agreeing

hmmm thats 200g in the wrong direction

wag that dog

almost, what you're seeing there is the too cute by half smug nugget of wisdom tone, which is really the trademark of the self-styled "writer", but because self-styled writers wrote most of the internet it has reflected onward in becoming the trademark llm tone. but there are still og hacks in the game!

it was only ever a distraction/cover-story for cutting medicaid

it worked

real devops pro contrarian move "what if I broke DNS so hard it actually made me better at my job"

daycare

used to be an extended familiy or village thing, now its on the ~1.7 parents per kid to earn enough to pay a commercial supplier.

it is cruel. the cruelty is the point.

you're committed to the username bit