News for hackers. Stuff that matters.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by wg0 on Tuesday March 28, 2023 @02:10PM (#35345361)
Noob to ML in practice. These models containing weights, all of them, do they have a standard file/binary format?
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by examplary_cable on Tuesday March 28, 2023 @03:04PM (#35346188)
[I'm not an expert] but I believe .ckpt and .safetensors.

The problem with .ckpt is that it executes arbitrary code in your machine(very unsafe). While .safetensors was made by huggingface in order to have a safe format to store the weights. I've also seen people load up the llama 7B via a .bin file.