News for hackers. Stuff that matters.
Re:Open source ChatGPT with LLaMA implementation trains 15x ... by IanCal on Monday February 27, 2023 @06:15PM (#34963394)
You have to split it up which slows it down a lot. The 14B model doesn't fit fully on a 3090, though the 7B fits easily and is very fast. Other replies either may have meant this or thought the original comment was about llama.

There are no comments on this comment yet.