rizsyed1
LLMs Aren't Inevitable
Space Jam (1996)
I'm sick of Claudisms, & what will happen next in AI-boosted software dev
Is this website more boring than it used to be, or am I just used to it?
Is anyone else losing their motivation to nerd out and tinker because of AI?
Do you ever struggle to find another programmer to work on a project/pair with?
Remote: Yes - but am open to both hybrid and in-office too.
Willing to relocate: Yes
Technologies: Python, FastAPI, Node.js, Express, PostgreSQL, MongoDB, REST APIs, JavaScript, TypeScript, React, HTML/CSS, Pytest, AWS, Terraform, Docker, Nginx, DigitalOcean, Linux, Git/GitHub, Postman, PyPI
Résumé/CV: https://www.linkedin.com/in/riz-s/
Email: [email protected]
Co-creator of Mantis (https://mantis-llm-gateway.github.io), an open-source, self-hosted Large Language Model (LLM) gateway that provides a single interface for interacting with multiple LLMs. I was particularly involved with building out the end-to-end asynchronous token streaming pipeline, writing and publishing the SDK on PyPi and automating the deployment workflow using Terraform.
Mantis – an open-source, self-hosted LLM gateway
Remote: Yes - but am open to both hybrid and in-office too.
Willing to relocate: Yes
Technologies: Python, FastAPI, Node.js, Express, PostgreSQL, MongoDB, REST APIs, JavaScript, TypeScript, React, HTML/CSS, Pytest, AWS, Terraform, Docker, Nginx, DigitalOcean, Linux, Git/GitHub, Postman, PyPI
Résumé/CV: https://www.linkedin.com/in/riz-s/
Email: [email protected]
Co-creator of Mantis (https://mantis-llm-gateway.github.io/case-study/introduction...), an open-source, self-hosted Large Language Model (LLM) gateway that provides a single interface for interacting with multiple LLMs. I was particularly involved with building out the end-to-end asynchronous token streaming pipeline, writing and publishing the SDK on PyPi and automating the deployment workflow using Terraform.
Show HN: Mantis, A self-hosted LLM gateway
https://github.com/mantis-llm-gateway
Hey HNers - Riz here.I got together with a few guys and we built an LLM gateway.It's designed for small teams working on early-stage products, and can be deployed to AWS using a single command (i.e. `mantis deploy`).It's self-hosted, and is designed to belong to you.