News for hackers. Stuff that matters.
Re:Bypass DeepSeek censorship by speaking in hex by jagged-chisel on Friday January 31, 2025 @10:02PM (#42895245)
Models can come pre-trained, or not trained. So do they pre-train and only offer the model with training? Or can one download an untrained model and avoid this censorship?
Re:Bypass DeepSeek censorship by speaking in hex by sadeshmukh on Friday January 31, 2025 @10:36PM (#42895409)
What is an untrained model? That doesn't make sense. Do you mean the training code or just base models (even those are trained).
Re:Bypass DeepSeek censorship by speaking in hex by jagged-chisel on Friday January 31, 2025 @10:57PM (#42895501)
Alright, what's the thing being trained to become the model? If a model means "already trained," what is it before being trained?

Is the model not the network that awaits training data? Or is the model just the weights applied to some standardized network?

Re:Bypass DeepSeek censorship by speaking in hex by lucianbr on Saturday February 01, 2025 @12:44AM (#42896009)
A "language model" is a model of a certain language. Thus, trained. What you are thinking of is a "model of how to represent languages in general". That would be valid in a sense, but nobody here uses the word that way. Why would one download a structure with many gigabytes of zeroes, and argue about the merits of one set of zeroes over another?

The network before training is not very interesting, and so not many people talk about it. You can refer to it as "blank network", "untrained network", or any number of ways. Nobody refers to it as "a model".

Yes, if you want to, you can refer to the untrained network as "a model", or even as "a sandwich". But you will get confused answers as you are getting now.