News for hackers. Stuff that matters.

A comment on YaLM-100B: Pretrained language model with 100B parameters. Parent comment

Re:YaLM-100B: Pretrained language model with 100B parameters by Byamarro on Thursday June 23, 2022 @06:07AM (#31847010)
It could be possible with analog chips. I.e. ones that Mythic works on.
[ Parent | on HN ]
Re:YaLM-100B: Pretrained language model with 100B parameters by redox99 on Thursday June 23, 2022 @06:24AM (#31847130)
I'm not sure why you got downvoted. Yes, ASICs (either analog or digital) that have some model hardcoded in would probably make it feasible, but it won't be programmable which is the interesting part.
[ Parent | on HN ]
Re:YaLM-100B: Pretrained language model with 100B parameters by trasz on Thursday June 23, 2022 @07:34AM (#31847624)
Totally not my field, but why wouldn't they be programmable? Analog FPGA's already exist.
[ Parent | on HN ]
Re:YaLM-100B: Pretrained language model with 100B parameters by redox99 on Thursday June 23, 2022 @08:42AM (#31848230)
Yes, true. I was referring to the Mythic ones the other comment mentioned which are only for inference of a specific model.
[ Parent | on HN ]