Re:Building LLM Applications for Production
by bob1029 on Friday April 14, 2023 @12:55PM
(#35571742)
> This is the problem I have with the GPT models
You absolutely should think about different kinds of models, especially for tasks that don't truly require generative output.
If all you are doing is classification, I'd grab some ML toolkit that has a time-limited model search and just take whatever it selects for you.
Binary classifiers are the epitome of inspectable. You can follow things all the way through the pipeline and figure out exactly where we went off the rails.
You can have your cake & eat it too. Perhaps you have a classification front-end that uses more deterministic techniques that then feeds into a generative back-end.
You absolutely should think about different kinds of models, especially for tasks that don't truly require generative output.
If all you are doing is classification, I'd grab some ML toolkit that has a time-limited model search and just take whatever it selects for you.
Binary classifiers are the epitome of inspectable. You can follow things all the way through the pipeline and figure out exactly where we went off the rails.
You can have your cake & eat it too. Perhaps you have a classification front-end that uses more deterministic techniques that then feeds into a generative back-end.