News for hackers. Stuff that matters.

A comment on High-Throughput Generative Inference of Large Language Models with a Single GPU. Parent comment

Re:High-Throughput Generative Inference of Large Language Mo... by macrolocal on Monday March 13, 2023 @10:17PM (#35146479)
Nb. the non-humanlike interactions they'll enable are equally (maybe more) exciting.
[ Parent | on HN ]
Re:High-Throughput Generative Inference of Large Language Mo... by TaylorAlexander on Monday March 13, 2023 @10:23PM (#35146538)
Certainly an unrestricted LLM sounds pretty interesting. I've not much had the chance to talk to one as they are so often restricted. But of course that is rapidly changing. Sounds like I will be able to run them on my desktop soon.
[ Parent | on HN ]
Re:High-Throughput Generative Inference of Large Language Mo... by macrolocal on Monday March 13, 2023 @10:55PM (#35146795)
I just meant that there’s (clearly) no reason to think their most useful skills will overlap with ours.
[ Parent | on HN ]