Re:LLaMA: A foundational, 65B-parameter large language model
by minimaxir on Friday February 24, 2023 @11:27AM
(#34926256)
Business orgs have been finetuning open-source models like these on their own internal data to create a moat since BERT in 2018.
[ Parent
| on HN ]
Re:LLaMA: A foundational, 65B-parameter large language model
by Der_Einzige on Friday February 24, 2023 @12:41PM
(#34927257)
Glad to see you still on HN! You've done amazing work in this domain!
I'd argue that this goes further back to the word2vec/glove days too. I was working for a company in 2018 who leveraged my skills for fine-tuning word2vec/fasttext even before BERT/attention is all you need paper.