News for hackers. Stuff that matters.

A comment on ChatGPT's API Is So Good and Cheap, It Makes Most Text Generating AI Obsolete. Parent comment

Re:ChatGPT's API Is So Good and Cheap, It Makes Most Text Ge... by leobg on Saturday March 11, 2023 @04:05PM (#35112696)
The zero shot ability is convenient. But for tasks that you need to get done millions of times, I’d much rather spend $10 on GPU compute and maybe a day of training data generation to train a T5 which I then “own”.

Also, running your own specialized model locally can be much faster than using someone’s API.

[ Parent | on HN ]
Re:ChatGPT's API Is So Good and Cheap, It Makes Most Text Ge... by specproc on Sunday March 12, 2023 @12:59AM (#35117193)
Sure, purely a time issue for me. I'm not the most skilled in this area, and I've got a load of core stuff I need to keep on top of.

I think we're not far off having something equivalent that can be pulled from Huggingface and run on a near consumer grade GPU.

For now, I'll hang tight and see how things progress. Don't disagree.

[ Parent | on HN ]
Re:ChatGPT's API Is So Good and Cheap, It Makes Most Text Ge... by leobg on Sunday March 12, 2023 @01:36AM (#35117414)
Maybe one day you’ll be able to tell ChatGPT what kind of model you need and it’ll automatically select the right architecture, gather the training data, and commission the training using the cheapest and/or fastest provider. :)
[ Parent | on HN ]