News for hackers. Stuff that matters.
Re:Run llama3 locally with 1M token context by tankado on Wednesday May 01, 2024 @03:28AM (#40220479)
"Note: using a 256k context window requires at least 64GB of memory. Using a 1M+ context window requires significantly more (100GB+)."

There are no comments on this comment yet.