News for hackers. Stuff that matters.
Re:Meta Llama 3 by namibj on Friday April 19, 2024 @02:08AM (#40083862)
LLM chat is so compute heavy and not bandwidth heavy that anywhere with reliable fiber and cheap electricity is suitable. Ping is lower than average keystroke delay for most who haven't undergone explicit speed typing training (we're talking 60~120 WPM for between intercontinental to pathological (other end of the world) servers). Bandwidth matters a bit more for multimodal interaction, but it's still rather minor.

There are no comments on this comment yet.