Once again, this pickle file is not what's sitting in Mistral's engineer's editors as they go about their day.
Please be clear, we keep asking. What are you asking for? Datasets? Training algo? What?
Comparing it to software artifacts isn't a good comparison when any program with open source code (visible or free to use) is equivalent to what's being given. You have everything you need to use, edit, and fuck around with. You don't have the exact scheme, but I'll put it this way, if you gave me the hardware I could produce a LLM of high quality from scratch using their architecture.
[0] https://github.com/mistralai/mistral-src/blob/main/mistral/m...
It's not what Mistral's engineers edit to create this release. Just like an ELF file is necessarily contains the code flow graph, in a way extractable by experts, but isn't open source because... it's not source.
[1]: https://huggingface.co/datasets/EleutherAI/pile