LLM-in-a-Box: A Templated, Self-Hostable Framework for Generative AI

Posted by geoHeil on Sunday July 20, 2025 @04:22PM
from the github.com dept.

https://github.com/complexity-science-hub/llm-in-a-box-template

( 3 comments | 2 points | on HN )

Re:LLM-in-a-Box: A Templated, Self-Hostable Framework for Ge... by geoHeil on Sunday July 20, 2025 @04:22PM (#44628961)

Together with www.linkedin.com/in/aaron-cul... I have created a template for making LLMs (from different vendors and even self hosted ones) easily accessible to researchers - including advanced document RAG with docling.

[ Parent | on HN ]

Re:LLM-in-a-Box: A Templated, Self-Hostable Framework for Ge... by geoHeil on Sunday July 20, 2025 @04:23PM (#44628969)

We are currently preparing a submission for JOSE and are looking for feedback but also more people who are interested in joining in and refining the template

[ Parent | on HN ]

Re:LLM-in-a-Box: A Templated, Self-Hostable Framework for Ge... by thedananarama on Monday July 21, 2025 @06:53AM (#44633724)

top!

[ Parent | on HN ]