News for hackers. Stuff that matters.
Re:Please don’t upload my code on GitHub by TeMPOraL on Monday May 08, 2023 @09:07AM (#35861151)
While I do believe that thinking and compression will turn out to be fundamentally the same thing, the split you propose is unclear with NN-based models. Code and data are fundamentally the same thing. The distinction we usually make between them is just a simplification, that's mostly useful but sometimes misleading. Transformer models are one of those cases where the distinction clearly doesn't make any sense.

There are no comments on this comment yet.