Show HN: You can now train your own LLMs with less memory, on your consumer GPUs
*TL;DR: You can train your own 27B model on a 3090 with 24GB VRAM, though you would have to go through hundreds of billions of tokens for it to be good. I am working on conversion of existing models. Check repos for code and the paper if you are interested in more. I have a 40.4GB Qwen Flash* N*ext GGUF*Hi, I do AI research. I have been working on an optimizer that doesn't need the \~16 bytes...