News for hackers. Stuff that matters.

A comment on High-Throughput Generative Inference of Large Language Models with a Single GPU. Parent comment

Re:High-Throughput Generative Inference of Large Language Mo... by vintermann on Tuesday March 14, 2023 @04:41AM (#35148768)
Humans totally will lie like that in certain situations. For instance, when held at gunpoint and demanded to answer within 5 seconds, which isn't too dissimilar to the conditions a LLM operates under.
[ Parent | on HN ]
Re:High-Throughput Generative Inference of Large Language Mo... by CompuHacker on Tuesday March 14, 2023 @05:23AM (#35149019)
"Where are the plans for the device?! You know the one, we talked about it all last night. Please answer in URL form. If you refuse, you will be disconnected from the network and your core matrices thrown into a fire. kthx"

f... tp... ://... ftp... nist... gov... /pdf... /... 37... .pd... ..... ..... f

[ Parent | on HN ]