News for hackers. Stuff that matters.
Re:Use GPT-3 incorrectly: reduce costs 40x and increase spee... by txtai on Wednesday February 08, 2023 @09:17AM (#34708301)
Starting with HF models and moving to a large model like GPT3 when the task calls for it is a good approach to take with almost all tasks.
Re:Use GPT-3 incorrectly: reduce costs 40x and increase spee... by joedevon on Wednesday February 08, 2023 @10:28AM (#34709360)
How about fine tuning testing w/ Davinci and then scaling it down for the other models or HF once you've proven it works. I believe the openai docs propose this approach (minus HF of course)
Re:Use GPT-3 incorrectly: reduce costs 40x and increase spee... by rozgo on Wednesday February 08, 2023 @10:54AM (#34709798)
This works well. Starting with bigger models allows us to explore whats possible. I find it easier to scale down from here.
Re:Use GPT-3 incorrectly: reduce costs 40x and increase spee... by txtai on Wednesday February 08, 2023 @10:59AM (#34709890)
That's up to you. Many don't want to open an account and pay in order to explore what's possible. There are LLMs available on the HF Hub, such as google/flan-t5-xl.