News for hackers. Stuff that matters.

A comment on Running large language models like ChatGPT on a single GPU. Parent comment

Re:Running large language models like ChatGPT on a single GPU by hedgehog0 on Tuesday February 21, 2023 @06:18AM (#34879683)
What’s the price may I ask
[ Parent | on HN ]
Re:Running large language models like ChatGPT on a single GPU by alex_sf on Tuesday February 21, 2023 @12:11PM (#34883656)
I have a similar setup. GPUs were $1.6k US, rest of the system was another ~$1k. This includes 256GB RAM and dual Xeons.
[ Parent | on HN ]
Re:Running large language models like ChatGPT on a single GPU by zac_hudson on Tuesday February 21, 2023 @04:41PM (#34887863)
I bought an old server from ebay, and ripped the guts out to make a desktop computer. 128GB of ddr3 ram and 48 E5 v2 xeons for 300$.
[ Parent | on HN ]