fcautomation
Re:Ask HN: Recommendations for Local LLMs in 2024: Private and Offline?
on Saturday April 06, 2024 @09:45AM (#39952418)
You can do this with Lamma2. There are multiple ways to compile it unless you use python. If you don't have familiarity with cpp i would just stick to python and save yourself time. Buy a big PC that can handle it.