News for hackers. Stuff that matters.

A comment on Show HN: Fine-tune an 8B model on a 4 GB laptop GPU. Parent comment

Re:Show HN: Fine-tune an 8B model on a 4 GB laptop GPU by MakazhanAlpamys on Tuesday August 04, 2026 @01:46PM (#49172279)
Do not buy a 4 GB card for this. Mine is an RTX 3050 Laptop, I picked it because it is boring hardware that many people already have. If you are buying, buy VRAM. At 0.5B where I could measure both, resident training was 1.43x faster than streaming. And if you do stream, system RAM matters more, the base sits there and has to page-lock. 16 GB is about the floor for 8B.
[ Parent | on HN ]
Re:Show HN: Fine-tune an 8B model on a 4 GB laptop GPU by bookmon on Tuesday August 04, 2026 @11:56PM (#49178408)
what price is the cheapest
[ Parent | on HN ]
Re:Show HN: Fine-tune an 8B model on a 4 GB laptop GPU by MakazhanAlpamys on Wednesday August 05, 2026 @04:33AM (#49180101)
i don't follow gpu prices.

the cheapest one is the one you already have.

more vram for the money is what i'd look for. usually used :)

[ Parent | on HN ]
Re:Show HN: Fine-tune an 8B model on a 4 GB laptop GPU by bookmon on Wednesday August 05, 2026 @11:20AM (#49184199)
cool thanks yeah I'll aim for a used one
[ Parent | on HN ]