News for hackers. Stuff that matters.

A comment on Show HN: MonkeyPatch – Cheap, fast and predictable LLM functions in Python.

Re:Show HN: MonkeyPatch – Cheap, fast and predictable LLM fu... by eychu94 on Thursday November 16, 2023 @12:47AM (#38286184)
Awesome stuff! What other potential integrations are on the roadmap?
[ Parent | on HN ]
Re:Show HN: MonkeyPatch – Cheap, fast and predictable LLM fu... by JackHopkins on Thursday November 16, 2023 @01:08AM (#38286269)
The big one is a Typescript implementation. Other than that, the plan is to support other models (e.g Llama) that can be fine-tuned.

Finally, other persistence layers like S3 and Redis, to support running on execution targets (like AWS Lambda and CloudFlare workers) that don’t have persistent storage.

I think it could be really interesting to support Vercel more tightly too. We currently support Vercel with Python, but I think Typescript + Redis would really enable serverless AI functions - which is where I think this project should go!

[ Parent | on HN ]