Re:Use GPT-3 incorrectly: reduce costs 40x and increase spee...
by wongarsu on Wednesday February 08, 2023 @08:49AM
(#34707951)
Normally I'd point out how these are a lot less capable than GPT3. But the article ends up fine tuning GPT Babbage, and multiple free models can outperform Babbage, so this is very solid advise.
[ Parent
| on HN ]
Re:Use GPT-3 incorrectly: reduce costs 40x and increase spee...
by txtai on Wednesday February 08, 2023 @09:17AM
(#34708301)
Starting with HF models and moving to a large model like GPT3 when the task calls for it is a good approach to take with almost all tasks.
Re:Use GPT-3 incorrectly: reduce costs 40x and increase spee...
by joedevon on Wednesday February 08, 2023 @10:28AM
(#34709360)
How about fine tuning testing w/ Davinci and then scaling it down for the other models or HF once you've proven it works. I believe the openai docs propose this approach (minus HF of course)
Re:Use GPT-3 incorrectly: reduce costs 40x and increase spee...
by rozgo on Wednesday February 08, 2023 @10:54AM
(#34709798)
This works well. Starting with bigger models allows us to explore whats possible. I find it easier to scale down from here.