etdznots

Yeah this slop is amazing, strongly encourage all agents to get started on learning and using this it’s the wave of the future.

Human endeavor and achievement does not make number go up for next quarter’s earnings

you compared writing code manually to gardening by hand, but now you say that you only use it for fixing small personal problems (agreed, I build similar tools for myself every day using LLM’s) then say you wouldn’t use it to write code you submit for work. It actually seems your metaphor is a bit inverted here.

Please tell me about the companies that are seeing productivity gains from LLM usage, seriously, who’s software is getting better?

Oops, that’s the only way to make software that’s reliable and usable by others.

Tell me about the end result you enjoy instead of growing your own food because I somehow suspect it’s premade slop from TJ’s microwaved and eating out. I would not be bragging about that!

Read TFA, that is just the usage of the smallest data enter in NE, across NE their water usage is ~50x that, and that’s just Nebraska, not exactly a hub for data centers

I am not an expert on why, but my vague answer is you are still running near max clock speeds, and you can significantly downclock your gpu and/or set power limits on your GPU without seeing much loss in performance, e.g. you can cap a 3090 to 60% of it’s normal power draw and it will lose like 5% of tg performance and 10% of pp performance (https://www.reddit.com/r/LocalLLaMA/comments/1hg6qrd/relativ...)

I think theoretically this is still very wasteful with lots of compute that’s getting powered and sitting unused but you are limited either by the firmware or by the GPU architecture from pushing power usage even lower without cratering performance. (no one anticipated the demand for relatively low-compute devices with lots of super fast memory)

No, because it’s a viable strategy that has teeth because of existing regs and agencies, not the battle to fight until the end of the earth, but it’s a pretty big hammer

Inference needs very little compute, it’s mostly IO. hence the low power draw, training is compute-heavy and uses lots of power

So we don’t know anything, we can mechanistically dissect any phenomena, but that rarely yields the ability to make interesting or useful predictions, i.e. understanding.

Let’s see the moved mountains I’m sitting here waiting to see any improvement in software

Inflation does not keep pace with the housing market

Please let me know when it starts

Sad that the author chose to generate slop instead of writing an article about SL

A solution to any of the four options made by an LLM armed with a theorem solver and millions of dollars of compute would still not be that interesting to the math community since it is not likely that any new insights oe questions can be derived from the result

Llms should make these cost even less im thinking $50 in 18 months?

They can’t they’re literally fucked, and it’s not society’s problem! The whole world doesn't have to bend over to make sure a couple of lunatics who believe they are building a doomsday weapon also have a viable business model

This is all based on the delusion that Chinese labs are mindlessly distilling the frontier.

I would love for a US lab to be at or near the frontier with an open weight model, but it’s going to take some serious elbow grease, and yes some distillation (which btw OAI, anthropic et al, also use distillation of other’s outputs in their training)

Bruh sorry, stop running any RW services off an SD card, it has always been terrible and unfortunately it will remain terrible, you can buy a used SFF with >5x the compute and a sata ssd for the same price as a raspberry pi alternatively put an nvme hat on it

If it’s a good film then those are works of art and interpretation in themselves, but I suspect you have something which is more the product of a mechanical bureaucracy in mind than works of art: maybe like a production of Harry Potter or The Hunger Games.

If those are the kinds of books you have in mind I can see why you get confused/frustrated by how others feel about slop, since you’ve been shoulder deep in it for your whole life!

As a software user, I feel just as frustrated and disappointed when I look at a projects website, code, and commit history and it’s slop, why in the world would I use this garbage when I can just prompt my model to make my own?

Realize the people using this to make slop menus and book covers feel the same way, wow this is useful and saves me so much time/money!

If only there was some technology they could have used for uncensorable transacting

They have a different culture and values, the US’s strengths lie in individualism and the character of the individuals that live here, and that’s both good and bad. But it’s entirely unsurprising that when responsibility and ownership is sharded up into trillions of tiny pieces and diffused that the outcome is awful.

How does wasting money on public goods deliver value to shareholders or help you build a doomsday machine?

I have no opinion on what will happen, and know close to nothing about the memory industry but just to think out loud about how market turbulence could cause memory prices to increase:

- Suppliers that memory companies depend on JIT are entangled and go under, halting production or stalling capacity increases

- Downstream suppliers / distributors for not vertically integrated memory companies go under, and there is a shortage of finished product ready for consumer use even though there is an excess of memory chips

- Memory producers / fabs can’t handle the depressed demand and go under / have to halt production, alleviating the demand glut for the surviving suppliers, who have less competition. Coordinating a cartel becomes easier when there are fewer suppliers and becomes more desirable now that everyone realizes it’s a matter of survival.

There are also plenty of good reasons to think prices will go down if demand is depressed, but it does seem possible for prices to go up

It is not free? You just pay them with your private information and by looking at a few ads. That is not free. Unless you believe information and time have no value?

> Is there evidence that these mythical low-print-run books are being purchased by Amazon and friends for destructive scanning?

Is there evidence that they aren’t? All of the common works are already on libgen, if these books are worthless repetition they will contribute little to the training corpus, labs want high quality interesting texts and they have unlimited budget to spend on it. Paying $300 for something rare with millions of tokens of interesting and original text for training is definitely fucking worth it, spending $1,200 to get all the copies and block your competitors from getting it is most definitely worth it!

> I simply don't see why railing against the AI giants about this without also contributing significant effort into protecting these low-print-run books from getting jettisoned by university libraries makes any sense.

Do you think it would be OK to rail against for example, a genocide if I wasn’t substantially contributing to some effort to stop it? This sophistic (and uninteresting) bit of rhetoric boils down to: if youre not trying to fix it yourself, dont complain!

(reminder that one of the basic principles of a democratic society is that each person has some concern outside of their personal affairs)

We should actually thank the AI companies for helping us get rid of our trash!

Thank you anthropic! Thank you OpenAI! Thank you Google!

Yes! and for the same amount of money ($1) you could save a starving child in Africa, but I guess you didn’t..