News for hackers. Stuff that matters.

A comment on High-Throughput Generative Inference of Large Language Models with a Single GPU. Parent comment

Re:High-Throughput Generative Inference of Large Language Mo... by imtringued on Tuesday March 14, 2023 @03:29AM (#35148360)
In Forward Forward Networks, inference and training are the same operation.
[ Parent | on HN ]
Re:High-Throughput Generative Inference of Large Language Mo... by pksebben on Tuesday March 14, 2023 @04:05AM (#35148558)
can you recommend any papers on this?
[ Parent | on HN ]
Re:High-Throughput Generative Inference of Large Language Mo... by noduerme on Tuesday March 14, 2023 @09:07AM (#35150831)
I think when the spec is hammered out, we'll know about 12 hours later, because everyone's phone will ring at the same time and the missiles will launch.
[ Parent | on HN ]