Mistral 7B Paper on ArXiv

Re:Mistral 7B Paper on ArXiv by benxh on Wednesday October 11, 2023 @09:14AM (#37843955)

It's missing a lot of crucial details. Nothing on the dataset used, nothing on the data mix, nothing on their data cleaning procedures, nothing on the tokens trained.

[ Parent | on HN ]

Re:Mistral 7B Paper on ArXiv by dazed_confused on Wednesday October 11, 2023 @10:03AM (#37844544)

What we get when it is on arxiv first before being peer reviewed.

[ Parent | on HN ]

Re:Mistral 7B Paper on ArXiv by arugulum on Wednesday October 11, 2023 @04:14PM (#37849706)

BERT was on arXiv before being peer reviewed. As were T5, BART, LLaMA, OPT and GPT-NeoX-20B. The Pile and FLAN were also on arXiv before being peer reviewed. Of course, the original Transformer paper was also on arXiv before being peer reviewed.

Being on arXiv before being peer reviewed is not the or even a problem.

[ Parent | on HN ]

Re:Mistral 7B Paper on ArXiv by jmac01 on Wednesday October 11, 2023 @10:42AM (#37845045)

I cud almost tell this would be the case when the title of the paper was simply Mistral 7B. A little more info would be useful!

[ Parent | on HN ]