Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs
by dragonwriter on Sunday April 20, 2025 @05:54PM
(#43746780)
AI PCs aren't about running the kind of models that take a 3090-class GPU, or even running on GPU at all, but systems where the local end is running something like Phi-3.5-vision-instruct, on system RAM using a CPU with an integrated NPU, which is why the AI PC requirements specify an NPU, a certain amount of processing capacity, and a minimum amount of DDR5/LPDDR5 system RAM.
[ Parent
| on HN ]
There are no comments on this comment yet.