News for hackers. Stuff that matters.
Re:Mistral 7B,The complete Guide of the Best 7B model by brucethemoose2 on Tuesday October 31, 2023 @02:11AM (#38080907)
Are y'all doing anything in particular to stretch the context out? Just plain old rope scaling?

While it seems to be a base model, I'm pretty excited about coming finetunes on this one: https://huggingface.co/SciPhi/SciPhi-Mistral-7B-32k

There are no comments on this comment yet.