Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs

Re:Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs by logankeenan on Tuesday January 07, 2025 @11:30AM (#42624227)

Do you have any recommendations on models to try?

[ Parent | on HN ]

Re:Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs by stkdump on Tuesday January 07, 2025 @12:03PM (#42624657)

Mixtral and Deepseek use MOE. Most others don't.

[ Parent | on HN ]

Re:Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs by Terretta on Tuesday January 07, 2025 @12:51PM (#42625189)

Mixtral 8x22b https://mistral.ai/news/mixtral-8x22b/

[ Parent | on HN ]

Re:Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs by terhechte on Tuesday January 07, 2025 @01:10PM (#42625397)

In addition to the ones listed by others, WizardLM2 8x22b (was never officially released by Microsoft but is available).

[ Parent | on HN ]

Re:Nvidia announces next-gen RTX 5090 and RTX 5080 GPUs by memhole on Tuesday January 07, 2025 @02:38PM (#42626441)

I planted garlic this year. Thanks for documenting! I can’t wait to see what I get harvest time.

I like the Llama models personally. Meta aside. Qwen is fairly popular too. There’s a number of flavors you can try out. Ollama is a good starting point to try things quickly. You’re def going to have to tolerate things crashing or not working imo before you understand what your hardware can handle.

[ Parent | on HN ]