Code Llama, a state-of-the-art large language model for coding

Re:Code Llama, a state-of-the-art large language model for c... by simonw on Thursday August 24, 2023 @05:21PM (#37254697)

I've been trying to push things in that direction with my LLM tool - the idea is to have Python plugins which you can install that do all of the irritating details to get a model setup.

I've not yet been able to solve the challenge of needing CUDA etc for some models though!

Plugins so far: https://llm.datasette.io/en/stable/plugins/directory.html

[ Parent | on HN ]

Re:Code Llama, a state-of-the-art large language model for c... by noduerme on Thursday August 24, 2023 @05:36PM (#37254861)

Cool! I've followed your instructions and your blog quite a bit as I've experimented with running local LLMs as well as stable diffusion. It's been especially helpful, as python is not my language or usual environment. Your patience at hacking your way through each new iteration and presenting what's important about them is astonishing; I personally think I'd have gone mad, but you've done great work in charting the territory.

[ Parent | on HN ]