openai functions are useful for such use cases. Might not be exactly what you're looking for, but I'm building a website where users can upload their functions as docker images and they will get called whenever the gpt-3.5 or 4 api needs to call them. Imagine a bunch of building blocks such as "fetch this url", "google search", "run this python code" etc. They can be composed together to be extremely useful.

I started around a week ago, another week to go before users can start testing it. If anyone's interested in trying it out, please email [email protected]

I little bit on the technical details, there are 2 parts: a django site that handles the websocket connections, making calls to the gpt apis, user management etc, there's a flask site that will handle running the docker images and returning the output. Initially I'll try to run the docker images using gvisor and maybe later move to firecracker (still exploring my options, not sure).

Here's a screenshot: https://imgur.com/377oPl5 The website is not online yet.