Re:Long Live the 'GPU Poor' – Open-Source AI Grants
by rajko_rad on Wednesday August 30, 2023 @03:26PM
(#37327593)
Thank you so much for your work and enthusiasm here!! Unfortunately, that’s roughly the best way to approach it and how most of these have worked so far, demonstrations on smaller models (e.g. 7/13B), with slightly smaller datasets, catching the eye of the community, etc. in general it’s not a bad approach to research too, prove out concepts at smaller scale before scaling up!
Re:Long Live the 'GPU Poor' – Open-Source AI Grants
by thewataccount on Wednesday August 30, 2023 @03:33PM
(#37327710)
Totally understand! I'm sure you'd get swarmed with requests.
Are you interested in non-LLMs as well? Stable diffusion for example?
If an individual is looking to contribute to the field with different training data ideas - would they need to first establish themselves and get your attention, or would there be a way to submit a proposal?
For myself compute is rather expensive, I could likely afford a few test runs for proofs of concept but beyond that it would be difficult. I've got a single 4090 so I can't run llama70b faster then 1it/s.