News for hackers. Stuff that matters.

A comment on ChatGPT's API Is So Good and Cheap, It Makes Most Text Generating AI Obsolete. Parent comment

Re:ChatGPT's API Is So Good and Cheap, It Makes Most Text Ge... by cs702 on Saturday March 11, 2023 @05:57PM (#35113648)
There's evidence that you can get LLMs to write chain-of-thought explanations that are consistent with the instructions in the given text, including quantitative data, cohort performance, governance imperatives, qualitative considerations, etc. The models can even be given directions to write conditional approvals if necessary.

To get a sense of what is and will be possible, take a look at the ReAct paper: https://arxiv.org/abs/2210.03629

and some of the LangChain tutorials that use it:

https://langchain.readthedocs.io/en/latest/modules/agents/ge...

https://langchain.readthedocs.io/en/latest/modules/agents/im...

[ Parent | on HN ]
Re:ChatGPT's API Is So Good and Cheap, It Makes Most Text Ge... by jsemrau on Saturday March 11, 2023 @06:33PM (#35113928)
Thank you for sharing the python code. While I am aware of the paper, I have not seen the code. Let me run a demo with this.

Yet overall, this is not only a tech problem, but a compliance / regulatory problem that includes a time differential of sometimes many years. Also, I am not saying its impossible. Mainly because I was the one pushing this type of innovation for a long time and faced headwinds from Credit Operations for many years. Quality prevailed.

[ Parent | on HN ]
Re:ChatGPT's API Is So Good and Cheap, It Makes Most Text Ge... by mark_l_watson on Saturday March 11, 2023 @09:22PM (#35115725)
The SerpAPI has backends for a few search engines. And, maybe substitute an ElasticSearch or Nutch search engine?

You make a good point.

[ Parent | on HN ]
Re:ChatGPT's API Is So Good and Cheap, It Makes Most Text Ge... by cs702 on Saturday March 11, 2023 @09:56PM (#35115969)
> Yet overall, this is not only a tech problem, but a compliance / regulatory problem that includes a time differential of sometimes many years.

Hmmm... I see what you mean. You're likely right that regulators won't take kindly to this at first. Adoption could take a long while. The difference this time is that executives will be pushing for it!

[ Parent | on HN ]