News for hackers. Stuff that matters.
Re:YaLM-100B: Pretrained language model with 100B parameters by alexb_ on Thursday June 23, 2022 @06:08AM (#31847026)
...what? 60 thousand dollars for a dedicated computer that you can't use is not everyone, not on their own computers, and is also a crazy large amount of money for nearly everyone. Sure there are some that could, but that's not what I said.
Re:YaLM-100B: Pretrained language model with 100B parameters by H8crilA on Thursday June 23, 2022 @06:30AM (#31847177)
Indeed. What "everyone" can use is a ~$200 smartphone, so there's a ~300x gap to be bridged.
Re:YaLM-100B: Pretrained language model with 100B parameters by ben_w on Thursday June 23, 2022 @08:29AM (#31848089)
Most of the cost of a phone isn’t the processor, so probably closer to x1000. Hardware may get that much cheaper, but it was never guaranteed, and we’re not making progress as fast as we used to.
Re:YaLM-100B: Pretrained language model with 100B parameters by wjnc on Thursday June 23, 2022 @06:50AM (#31847310)
log(300) / log(2) = only 8.2 doublings away. That's near future material.
Re:YaLM-100B: Pretrained language model with 100B parameters by thfuran on Thursday June 23, 2022 @07:12AM (#31847460)
Maybe at 90s hardware growth rates, but not now.
Re:YaLM-100B: Pretrained language model with 100B parameters by rictic on Thursday June 23, 2022 @07:30AM (#31847604)
The dream of the 90s is alive in the GPU market: https://aiimpacts.org/2019-recent-trends-in-gpu-price-per-fl...

Moore's law didn't stop, just Dennard scaling. Expect graphics and AI to continue to improve radically in performance/price, while more ordinary workloads see only modest improvements.

Re:YaLM-100B: Pretrained language model with 100B parameters by thfuran on Thursday June 23, 2022 @08:13AM (#31847939)
GPU TDP seems on the verge of going exponential, cost per transistor isn't really decreasing so much at the very latest nodes, and even that article seems to suggest it'd likely be decades before 300x flops/$
Re:YaLM-100B: Pretrained language model with 100B parameters by paganel on Thursday June 23, 2022 @06:38AM (#31847230)
Plus, that's the energy costs involved when running a computer now worth 60k, I'm pretty sure that in the current socio-economic climate those power costs will surpass the initial acquisition cost (those 60k, that is) pretty easily.
Re:YaLM-100B: Pretrained language model with 100B parameters by colechristensen on Thursday June 23, 2022 @09:32AM (#31848857)
An 80GB nvidia A100 goes for $20k and uses 300 watts, the energy costs of using one (or three) isn’t going to surpass the hardware costs for… a while.
Re:YaLM-100B: Pretrained language model with 100B parameters by paganel on Thursday June 23, 2022 @10:37AM (#31849710)
I wanted to add that I was writing it metaphorically in a way, as in, seeing as how high those energy bills will be they might as well all add up to 60k.

Not sure about most of the people in here, but I would get really nervous at the thought of running something that eats up 3x300 watts per hour, for 24/7, just as part of a personal/hobby project. The incoming power bills would be too high, you have to be in the wage-percentile for which dropping 60k on a machine just to carry out some hobby project is ok, i.e. you’d have to be “high-ish” middle-class at least.

The recent increases in consumer power prices are a heavy blow for most of the middle-class around Europe (not sure about how things are in the States), so a project like this one is just a no-go for most of middle-class European programmers/computer people.

Re:YaLM-100B: Pretrained language model with 100B parameters by colechristensen on Thursday June 23, 2022 @11:00AM (#31850036)
At full power 3 of those would cost me ~$3.50 per day ($0.15 per kWh is what I paid for last month's electricity, though I could pay less if I made some difference choices), I occasionally have a more expensive coffee order, or have a cocktail worth three times as much.

Things are getting more expensive here but nothing like the situation in Europe (essentially none of our energy was imported from Russia, historically ~10% of oil imports but that was mostly to refine and re-export, we have all the natural gas locally that we need) The US crossed the line into being a net hyrdocarbon energy exporter a while ago (unsure what the case is recently but it is at worst about at parity)

Re:YaLM-100B: Pretrained language model with 100B parameters by golem14 on Thursday June 23, 2022 @06:47PM (#31856048)
You must not have a pool :)
Re:YaLM-100B: Pretrained language model with 100B parameters by px43 on Thursday June 23, 2022 @11:48AM (#31850788)
Eh, 60k is just a bit more expensive than your average car, and lots of people have cars, and that's just how things are today. I imagine capabilities will be skyrocketing and prices will fall drastically at the same time.
Re:YaLM-100B: Pretrained language model with 100B parameters by fuzzer37 on Thursday June 23, 2022 @01:25PM (#31852361)
> 60k is just a bit more expensive than your average car

If by "A bit" you mean about 30-40k

Re:YaLM-100B: Pretrained language model with 100B parameters by CRConrad on Saturday June 25, 2022 @03:19PM (#31877927)
> > 60k is just a bit more expensive than your average car

> If by "A bit" you mean about 30-40k

30k more expensive: Than your very-low-end-"average" car.

40k more expensive: Than your average used car.

AFAICS. All in what one sees as an "average" car, I suppose.