News for hackers. Stuff that matters.
Re:Here’s how you can build and train GPT-2 from scratch usi... by moffkalast on Saturday July 06, 2024 @07:34AM (#40889780)
That's cool as a learning experience, but if you're gonna build a language transformer, why not instead of ClosedAI's outdated nonsense learn something with a more established open architecture like llama, so whatever you end up training ends up plug and play compatible with every LLM tool in the universe when converted to a GGUF?

Otherwise it's like learning to build a website and stopping short of actually doing the final bit where you put it on a webserver and run it live.

There are no comments on this comment yet.