News for hackers. Stuff that matters.

aaronrelph

Yeah, I mention this in the post but this variant of LLaMA isn't storing any of the conversation in memory so it doesn't have context on the prior questions. You're starting fresh with each prompt. We have some ideas for how to improve this though... more soon :)
Alright, after a few hiccups, you should be seeing a noticeable improvement in response times now!
fixed!
And we're back! Might be little slow while traffic is high but responses are coming through.
Wow sorry y'all, we didn't expect this to take off so quickly. Working on getting this scaled up now so everyone can play!

Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

https://chatllama.baseten.co/

ChatLLaMA is an experimental chatbot interface for interacting with variants of Facebook's LLaMA. Currently, we support the 7 billion parameter variant that was fine-tuned on the Alpaca dataset. This early versions isn't as conversational as we'd like, but over the next week or so, we're planning on adding support for the 30 billion parameter variant, another variant fine-tuned on LAION's...

( Read More... | 218 comments | 33 points | on HN )
A guide on how Abu fine-tuned Alpaca 30B and how to use it.