Understanding LLM Compute Requirements Posted by pgspaintbrush on Sunday May 28, 2023 @06:47PM from the intuitiveai.substack.com dept. https://intuitiveai.substack.com/p/the-fundamental-quantities-of-llms ( 2 comments | 3 points | on HN )
Training requires a ridiculous amount of both, but again the raw compute requirements would be much lower with huge memory pools.