Re:Run llama3 locally with 1M token context
by tankado on Wednesday May 01, 2024 @03:28AM
(#40220479)
"Note: using a 256k context window requires at least 64GB of memory. Using a 1M+ context window requires significantly more (100GB+)."
[ Parent
| on HN ]
There are no comments on this comment yet.