News for hackers. Stuff that matters.
Re:I want run open source LLMs on this prebuilt AI. Anyone t... by tech_no_logic on Monday December 23, 2024 @12:08PM (#42495873)
cool case, i'll go for opt 2 as they have Threadripper.
Re:I want run open source LLMs on this prebuilt AI. Anyone t... by rar00 on Monday December 23, 2024 @11:43AM (#42495694)
seems a tad expensive for (nerfed) consumer-grade GPUs IMO
Re:I want run open source LLMs on this prebuilt AI. Anyone t... by average_joey on Monday December 23, 2024 @12:17PM (#42495928)
good point is that this integrates some existing models for you to use. You can test different models with this. But still need to upgrade if you wanna try larger models. The more Vram the better
Re:I want run open source LLMs on this prebuilt AI. Anyone t... by KTibow on Monday December 23, 2024 @03:41PM (#42497427)
It reminds me of a similar product [0] from George Hotz

[0] https://tinygrad.org/#tinybox