News for hackers. Stuff that matters.
Re:NanoGPT by wongarsu on Wednesday January 11, 2023 @04:00PM (#34344727)
Assuming you get the 12GB version of the 3080. A 2080TI is another option. Though you can reduce precision or use one of the smaller GPT2 versions to run on smaller cards as well.
Re:NanoGPT by int_19h on Wednesday January 11, 2023 @06:28PM (#34346597)
Let me slightly rephrase the question: what is the best model that one can run on high-end consumer grade hardware? Let's say RTX 3090.