Re:Open source ChatGPT with LLaMA implementation trains 15x ...
by IanCal on Monday February 27, 2023 @06:15PM
(#34963394)
You have to split it up which slows it down a lot. The 14B model doesn't fit fully on a 3090, though the 7B fits easily and is very fast. Other replies either may have meant this or thought the original comment was about llama.
[ Parent
| on HN ]
There are no comments on this comment yet.