Re:Refact LLM: New 1.6B code model reaches 32% HumanEval and...
by Retric on Monday September 04, 2023 @05:59PM
(#37385527)
It actually kind of makes sense.
RAM is only about 6x the speed of SSD’s for sequential access. Most people don’t actually need truly random access to all that much data rather than streaming video or loading video game assets to their GPU. So they shift spending to other components like video card, monitors, etc that actually provide significant value.
Which is how you get people with 16 GB of system RAM using graphics cars that also have 16GB of RAM.
RAM is only about 6x the speed of SSD’s for sequential access. Most people don’t actually need truly random access to all that much data rather than streaming video or loading video game assets to their GPU. So they shift spending to other components like video card, monitors, etc that actually provide significant value.
Which is how you get people with 16 GB of system RAM using graphics cars that also have 16GB of RAM.