News for hackers. Stuff that matters.
Re:There Will Be a Scientific Theory of Deep Learning by hodgehog11 on Saturday April 25, 2026 @08:16AM (#47900830)
Both you and the comment above are correct; initializing with iid elements ensures that correlations are not disastrous for training, but strong correlations are baked into the weights during training, so pretty much anything could potentially happen.

There are no comments on this comment yet.