Re:GPU-Accelerated LLM on a $100 Orange Pi
by chank on Tuesday August 15, 2023 @08:10AM
(#37132975)
this concept already exists and is in practice at many companies that require knowledge driven results. https://arxiv.org/abs/2005.11401
[ Parent
| on HN ]
Re:GPU-Accelerated LLM on a $100 Orange Pi
by regularfry on Tuesday August 15, 2023 @08:44AM
(#37133288)
There was another paper out recently that adds to this: https://arxiv.org/pdf/2308.04430.pdf. Looks like a more flexible approach to document storage, and it outperforms retrieval in context.
They trained up their own LLM, but from the text it seems like it might be possible to use any LLaMA-style LM without retraining. Not sure though, need to give it a proper look.