Re:OpenLLaMA: An Open Reproduction of LLaMA
by startupsfail on Wednesday May 03, 2023 @11:26AM
(#35803545)
GPU memory is also useful to load large detailed scenes for rendering (.usd). It is a bit surprising that 80GB is the limit. It was obvious for years that GPU compute is ahead of GPU memory size by 10x-100x. And loading larger models and scenes into memory was always a struggle. This must be a hardware or yields issue.
[ Parent
| on HN ]
There are no comments on this comment yet.