News for hackers. Stuff that matters.

alextttty

alextttty on Hacker News

Re:Show HN: Last CLI tool you will need on Thursday October 17, 2024 @08:48AM (#41869173)
Point is to actually avoid hallucinations, Think I didnt focus on it as much as I wanted. To avoid hallucinations, make sure you use strict prompt when creating the chatbot/api key. Combination of rag + strict prompt will make sure that AI does not go out of bounds of it contextualised knowledge and avoids using LLM's internal knowledge.
Re:Show HN: Open-source LLM provider price comparison on Wednesday August 14, 2024 @11:01AM (#41246914)
Made action to gen csvs + json Working on the mui data table frontend right now
Re:Show HN: Open-source LLM provider price comparison on Wednesday August 14, 2024 @10:32AM (#41246539)
Indeed!
Re:Show HN: Open-source LLM provider price comparison on Wednesday August 14, 2024 @09:27AM (#41245824)
Amazing! Please dont hesitate to open an issue or a PR Will update our dataset and add it.
Re:Show HN: Open-source LLM provider price comparison on Wednesday August 14, 2024 @08:44AM (#41245441)
Think its just dominating the industry with cheaper access to gpu's probably even subsidised pricing
Re:Show HN: Open-source LLM provider price comparison on Wednesday August 14, 2024 @08:43AM (#41245422)
Thank you!
Re:Show HN: Open-source LLM provider price comparison on Wednesday August 14, 2024 @08:18AM (#41245219)
Exactly, always best to rely on your hardware, we need to collect/add more data from self hosted models on different gpus/clouds to compare
Re:Show HN: Open-source LLM provider price comparison on Wednesday August 14, 2024 @08:18AM (#41245217)
Honestly this is very very fresh, I was tinkering with hosting some models and wanted to optimize costs, tried few inference engines. Just want to collaborate on organizing data.

Agree, we will add a MUI table very soon. Also some charts.

I genuinely want someone to roast the way I did my benchmark process described there. Want something good enough yet easy to run.

Re:Show HN: Open-source LLM provider price comparison on Wednesday August 14, 2024 @08:15AM (#41245190)
Thank you! yeah great source. Do they track throughput for open source models? and inference engines Thats kind of data I want to find as well
Re:Show HN: Open-source LLM provider price comparison on Wednesday August 14, 2024 @08:14AM (#41245180)
Yeah we want to do exactly this, benchmark and add more data from differnt gpus/cloud providers, will appreciate your help a lot! There are many inference engines which can be tested and updated to find best inference methods

Show HN: Retrieval Augmented Generation Optimised LLM's

Posted by alextttty on Thursday August 17, 2023 @05:05PM
from the show-hn dept.

https://huggingface.co/Arc53/docsgpt-14b

I'm super excited to show you newly published DocsGPT llm’s on Hugging Face, tailor-made for tasks some of you asked for. From Documentation-based QA, RAG (Retrieval Augmented Generation) to assisting developers and tech support teams by conversing with your data! (basically the same thing tbh, all started by 2020 Retrieval Augmented Generation for Knowledge-Intensive NLP Tasks paper)Fine-tuned...

( Read More... | no comments | 2 points | on HN )