News for hackers. Stuff that matters.
Re:OpenLLaMA: An Open Reproduction of LLaMA by startupsfail on Wednesday May 03, 2023 @11:26AM (#35803545)
GPU memory is also useful to load large detailed scenes for rendering (.usd). It is a bit surprising that 80GB is the limit. It was obvious for years that GPU compute is ahead of GPU memory size by 10x-100x. And loading larger models and scenes into memory was always a struggle. This must be a hardware or yields issue.

There are no comments on this comment yet.