News for hackers. Stuff that matters.

A comment on Flow-Based Programming, a way for AI and humans to develop together. Parent comment

Re:Flow-Based Programming, a way for AI and humans to develo... by rodrigobellusci on Monday March 20, 2023 @07:48AM (#35230180)
Alpaca [1], perhaps. It's based on facebook's model (LLaMA) and its been trained on a conversational style, same as chat gpt. I don't know if it can produce code, though.

[1] https://github.com/antimatter15/alpaca.cpp

[ Parent | on HN ]
Re:Flow-Based Programming, a way for AI and humans to develo... by est on Monday March 20, 2023 @10:15PM (#35241744)
I mean anybody had success fine-tuning it? How hard could it be and how long does it take?
[ Parent | on HN ]
Re:Flow-Based Programming, a way for AI and humans to develo... by rodrigobellusci on Tuesday March 21, 2023 @08:13AM (#35245137)
Yeah, anybody can clone Alpaca and fine tune it.

From what I can tell setting things up to train the model is easy. Then you have to generate the training data (can be done using GPT3's API), fine tune Alpaca, and then evaluate it.

Haven't done it myself but I believe you can find more info here [1]

[1] https://crfm.stanford.edu/2023/03/13/alpaca.html

[ Parent | on HN ]