News for hackers. Stuff that matters.

abhaym

Show HN: Fine-Tuning Index of Open-Source LLMs vs. OpenAI

https://predibase.com/fine-tuning-index

The research team at Predibase analyzed 700+ fine-tuning experiments using 13 of the most popular open-source models, GPT-3.5/4/4o, and 31 distinct datasets and tasks. We chose open-source models with a max of 7B parameters to ensure that any organization can train the models on low-end GPUs. For evaluation, we utilized task-specific metrics including accuracy, rouge, and HumanEval to assess...

( Read More... | no comments | 3 points | on HN )

Show HN: LoraLand – 25 fine-tuned LLMs that beat GPT-4

https://predibase.com/lora-land

Hi all, today we're excited to launch LoraLand: 25 fine-tuned mistral-7b models that outperform #gpt4 on task-specific applications ranging from sentiment detection to question answering.All 25 fine-tuned models… - Outperform GPT-4, GPT-3.5-turbo, and mistral-7b-instruct for specific tasks - Are cost-effectively served from a single GPU through LoRAX - Were trained for less than $8 each on...

( Read More... | 3 comments | 6 points | on HN )
Whoa this looks pretty cool. One question though: is there increased latency when you have multiple adapters on a single base model?

Show HN: Predibase - Low-Code AI for Developers

https://predibase.com

Hi HN!We are excited to announce the general availability and free trial of Predibase, the first low-code AI platform for developers.Our mission is simple: empower engineering teams everywhere to rapidly build powerful AI-powered applications without needing to learn complex low-level ML frameworks. Using our platform, engineers can train, fine-tune, and operationalize custom models leveraging...

( Read More... | 2 comments | 9 points | on HN )