News for hackers. Stuff that matters.

supreetgupta

A bit more context: this Gateway is part of a progression from an LLM Gateway - MCP Gateway - a future Agent Gateway. The intent is to provide a consistent control plane for tool access, authentication, and policies around agent execution. MCP offers a clean interoperability layer, so the Gateway focuses on security, observability, and operational consistency rather than tool-specific logic.

There are areas still evolving (more granular budget/rate controls, extended tool composition inside Virtual MCP Servers, richer audit traces). Input from people who’ve built multi-tool agent systems or worked with MCP at scale would be especially useful.

Refer to our roadmap here - https://www.truefoundry.com/roadmap

Show HN: MCP Gateway – Unifying Access to MCP Servers Without N×M Integrations

https://www.truefoundry.com/mcp-gateway

Many teams connecting LLMs to external tools eventually encounter the same architectural issue: as more tools and agents are added, the integration pattern becomes an N×M mesh of direct connections. Each agent implements its own auth, retries, rate limiting, and logging; each tool needs credentials distributed to multiple places and observability becomes fragmented.We built LLM gateway with...

( Read More... | 3 comments | 8 points | on HN )

Show HN: TrueFoundry raises $19M Series A to scale AI deployment with agents

https://www.truefoundry.com/blog/announcing-our-19m-series-a-scaling-ai-deployment-with-autonomous-agents-on-autopilot

Hey HN,We are thrilled to announce that TrueFoundry has raised $19M in Series A funding, led by Intel Capital, with participation from Spark Capital, Pi Ventures, and others.What We DoAI deployment today is painfully slow, expensive, and requires large engineering teams. At TrueFoundry, we’re fixing this by building an autonomous AI deployment layer that lets ML teams ship models 10x faster...

( Read More... | no comments | 2 points | on HN )
Hey Hitesh, thanks to our contributors, we've introduced some exciting new features to Cognita:

1. Added VLM-based PDF parser 2. Integrated an intelligent summary query controller. Now, you can input multiple questions at once, and the controller will break them down into individual queries, answering each in a streaming format. Finally, it provides a summary of all responses.

Roadmap / Anticipated Contribution Scope:

1. Enabling hybrid and sparse vector search support 2. Implementing Embedding Quantization support 3. Integrating with GraphDBs and relevant retrievers 4. Enabling RAG Evaluation across various retrievers 5. Implementing RAG Visualization features ...and many other enhancements are awaiting.

Excited for the community's backing! Let's maintain the momentum of open source.

Re:Ask HN: Is RAG the Future of LLMs? on Saturday April 27, 2024 @10:51PM (#40185614)
TrueFoundry has recently introduced a new open-source framework called Cognita, which utilizes Retriever-Augmented Generation (RAG) technology to simplify the transition by providing robust, scalable solutions for deploying AI applications.

Try it out: https://github.com/truefoundry/cognita

Re:Make the Most of Retrieval Augmented Generation on Saturday April 27, 2024 @10:50PM (#40185606)
TrueFoundry has recently introduced a new open-source framework called Cognita, which utilizes Retriever-Augmented Generation (RAG) technology to simplify the transition by providing robust, scalable solutions for deploying AI applications.

Try it out: https://github.com/truefoundry/cognita

Re:Show HN: Serverless RAG to 10x Internal Operations on Saturday April 27, 2024 @10:47PM (#40185588)
TrueFoundry has recently introduced a new open-source framework called Cognita, which utilizes Retriever-Augmented Generation (RAG) technology to simplify the transition by providing robust, scalable solutions for deploying AI applications.

Try it out: https://github.com/truefoundry/cognita Read the technical blog here: https://www.truefoundry.com/blog/cognita-building-an-open-so...

TrueFoundry has recently introduced a new open-source framework called Cognita, which utilizes Retriever-Augmented Generation (RAG) technology to simplify the transition by providing robust, scalable solutions for deploying AI applications.

Try it out: https://github.com/truefoundry/cognita Read the technical blog here: https://www.truefoundry.com/blog/cognita-building-an-open-so...

Re:Ask HN: RAG for API Documentation on Saturday April 27, 2024 @09:15PM (#40185120)
TrueFoundry has recently introduced a new open-source framework called Cognita, which utilizes Retriever-Augmented Generation (RAG) technology to simplify the transition by providing robust, scalable solutions for deploying AI applications.

Try it out: https://github.com/truefoundry/cognita Read the technical blog here: https://www.truefoundry.com/blog/cognita-building-an-open-so...

Re:Challenges of Scaling RAG Applications on Saturday April 27, 2024 @09:14PM (#40185114)
TrueFoundry has recently introduced a new open-source framework called Cognita, which utilizes Retriever-Augmented Generation (RAG) technology to simplify the transition by providing robust, scalable solutions for deploying AI applications.

Try it out: https://github.com/truefoundry/cognita Read the technical blog here: https://www.truefoundry.com/blog/cognita-building-an-open-so...

Thanks for highlighting that! Here’s the GitHub link: https://github.com/truefoundry/cognita

Show HN: Cognita – open-source RAG framework for modular applications

https://github.com/truefoundry/cognita

Hey HN, exciting news! Our RAG framework, Cognita (https://github.com/truefoundry/cognita), born from collaborations with diverse enterprises, is now open-source. Currently, it offers seamless integrations with Qdrant and SingleStore.In recent weeks, numerous engineers have explored Cognita, providing invaluable insights and feedback. We deeply appreciate your input and encourage ongoing...

( Read More... | 34 comments | 36 points | on HN )
Re:Dream – A Distributed RAG Experimentation Framework on Monday April 22, 2024 @02:35PM (#40117342)
Hi, I've come across an open-source API-driven RAG framework launched recently. It's different from other frameworks in a lot of context. Give it a try and let me know your thoughts: https://github.com/truefoundry/cognita
I've collated a list of AI conferences happening during Jan-Jun 2024 across the globe. Hope this is helpful: https://docs.google.com/spreadsheets/d/15jyJP1TbuWenzBD0OahZ...