News for hackers. Stuff that matters.
Re:Long Live the 'GPU Poor' – Open-Source AI Grants by tikkun on Wednesday August 30, 2023 @03:14PM (#37327458)
What are other open source LLM projects that people rely on? As a way to come up with ideas for future grant recipients.

This is a good initiative, and an excellent initial batch. A great use of management fees!

I'm struggling to think of additional ones because I feel like this covers everyone I would've suggested (particularly TheBloke, vLLM and oobabooga).

Edit, some ideas for future grant recipients would be:

* MLC LLM

* ExLlama

* An open source fork of text-generation-inference

* AutoGPTQ

Re:Long Live the 'GPU Poor' – Open-Source AI Grants by rajko_rad on Wednesday August 30, 2023 @04:47PM (#37328862)
Awesome suggestions, thank you!