News for hackers. Stuff that matters.
Re:Creativity fundamentally comes from memorization by Jensson on Wednesday July 31, 2024 @03:49PM (#41122771)
> I don't remember anyone who couldn't pass tests but was really a great engineer.

But there are plenty of people who can pass tests and are terrible engineers. When people talk about memorization they talk about remembering the words without understanding the concepts, such a person is no better off than the person carrying around a text note with the concept written down.

When you understand these concepts you will remember those formulas, but memorizing the formula doesn't make you understand it. Therefore creativity doesn't fundamentally comes from memorization, there is something else there.

Re:Creativity fundamentally comes from memorization by muzani on Wednesday July 31, 2024 @04:13PM (#41122976)
The point they are trying to make is it comes from memorizing the right things. You don't become a chess master by memorizing opening moves, you become one by memorizing strong and weak states on the board.

The ability to memorize opening moves may lead you into a stronger mid game, but it's not creativity. Creativity is searching for patterns where they can mate in three, or spotting positions where the bishop can attack two pieces at once in two moves.

Re:Creativity fundamentally comes from memorization by Jensson on Wednesday July 31, 2024 @04:20PM (#41123023)
> The point they are trying to make is it comes from memorizing the right things

No it doesn't, understanding a concept doesn't come from memorizing N facts, if it did we could easily make everyone understand math in school but we can't.

Some people understand math trivially with no effort and no work memorizing (they wont remember the formulas, but they can explain how it works and can reproduce something similar to the formulas), others don't understand even with massive amounts of effort and memorizing every formula.

> You don't become a chess master by memorizing opening moves, you become one by memorizing strong and weak states on the board.

That is just a theory, there is little behind that. Much more likely you become a chess master by training a board state evaluator in your hand that is really good at evaluating board states, not by memorizing lots of board states. Memorizing board states is deep blue, it is much worse than AlphaGo etc, so that is for sure not the best way to get good, and for sure not the way humans get good, humans get good similar to how AlphaGo gets good, not how deep blue did it.

That board state evaluator allows you to also remember board states easily, but you don't build that by memorizing board state patterns.

Re:Creativity fundamentally comes from memorization by simiones on Thursday August 01, 2024 @06:54AM (#41127862)
Memorizing is clearly a necessary, but not sufficient part of learning. If you are to become an expert in any subject whatsoever, from math to football fandom, you will need to develop an ability for remembering huge amounts of raw facts. One of the first hurdles in a math education is memorizing the multiplication tables. In biology or medicine you have to learn literally hundreds of systems that happen to exist in a certain way, and from all of the raw facts, could very well be a different way.

> Some people understand math trivially with no effort and no work memorizing (they wont remember the formulas, but they can explain how it works and can reproduce something similar to the formulas), others don't understand even with massive amounts of effort and memorizing every formula.

Sure, you can wing it at a primary or high school level if your teachers are impressed by your understanding. But you will never become a math expert if you don't remember the specific formulae, and many other more complex things. Even if you are fully able to deduce the theorems from scratch, you won't be able to function if you have to invent and then prove every single theorem you want to use.

> Memorizing board states is deep blue, it is much worse than AlphaGo etc, so that is for sure not the best way to get good, and for sure not the way humans get good, humans get good similar to how AlphaGo gets good, not how deep blue did it.

No, it is precisely the other way around. DeepBlue is deducing how good a board state is by trying to calculate all possible follow-up moves up to a depth of 13 or something. In contrast, AlphaGo has memorized patterns occuring in billions of games (in a lossy archive format, of course) and basically can recall games that are close enough to the current game and what you need to do to win from the current position. And this is exactly how chess masters mostly work as well, to the extent that it has been studied, and based on their own reporting. They just recognize positions or certain aspects of a position, and can recall how the game works from that position.

Re:Creativity fundamentally comes from memorization by will1am on Thursday August 01, 2024 @06:59AM (#41127889)
I think memorization is a tool to deep understanding
Re:Creativity fundamentally comes from memorization by ozim on Wednesday July 31, 2024 @05:42PM (#41123775)
Without memorizing at first, it is much harder to understand the topic. Memorizing builds fluency, fluency builds proficiency.

You cannot build complex electronics without having Ohms law in your mind as something fundamental you don’t have to look up.

Yes at some point you build up experience so you never really think of it but for it to become intuitive it needs to be learned by rot repetition

Re:Creativity fundamentally comes from memorization by Jensson on Wednesday July 31, 2024 @05:48PM (#41123829)
> You cannot build complex electronics without having Ohms law in your mind as something fundamental you don’t have to look up.

But I learned Ohms law without learning any formula, or memorizing any picture. I just internalized that electricity are electrons that gets pushed by a force against a resistance, so it is obvious that the amount that gets pushed through is force divided by resistance. I couldn't write down the formula for that, because I don't remember which symbol represents what, but I understand the concept as good as any expert and I never need to look that up because my intuition instantly solves any related problem.

Most of the basic electric circuit formulas comes trivially from that fact, so I never had to study for that in physics. And as we know memorizing that fact doesn't mean people know how to do the electric circuit formulas, so memorization isn't enough, rather internalizing concepts is a completely separate process from memorization, and the quality of your internalized structure is the most important part here not how many objects you memorized.

Re:Creativity fundamentally comes from memorization by kiba on Wednesday July 31, 2024 @11:45PM (#41125966)
Most of the basic electric circuit formulas comes trivially from that fact, so I never had to study for that in physics. And as we know memorizing that fact doesn't mean people know how to do the electric circuit formulas, so memorization isn't enough, rather internalizing concepts is a completely separate process from memorization, and the quality of your internalized structure is the most important part here not how many objects you memorized.

If you mean by rote learning and just remembering information in an arbitrary manner, then that's memorization. I doubt that such a person have even acquired the knowledge, except maybe for the simplest case such as multiplication tables.

I know how multiplication works actually, but I never used them. Instead I go for the memorized answer.

But all knowledge a person have is based on memory. How you acquire it is up to you, preferably in the most efficient way possible so that we actually retain the information and don't have to "study" as often.

Re:Creativity fundamentally comes from memorization by Jensson on Thursday August 01, 2024 @02:57AM (#41126766)
> But all knowledge a person have is based on memory

No it isn't, tacit knowledge isn't based on remembering something it is based on having made a model that parses something. That is what you want to build, memory itself is mostly redundant compared to those models, as those models lets you easily rediscover information but memory doesn't let you parse problems.

Memorizing something implies there is a piece of information you can later recall. If there is nothing to recall such as with tacit skills then you don't learn it by memorizing, you learn it by practice and thinking and theorizing until it "clicks".

A computer can remember everything trivially, but it hasn't built any models based on the information so all that information is useful. The same happens in our head, the value isn't in the memory it is in the structures you built as an answer to that memory. The memory itself is a red herring, don't chase it, chase the understanding.

So for example, I have made a model in my head that parses electronic circuit problems for me, with that I don't need any formulas as it does the work. There is no memory tied to that model, it just solves things, there is nothing to recall, nothing to write down etc, it isn't a piece of information it is an active skill I have built. Saying otherwise is like saying that you memorize how to move your arm, no that is you building up intuition and reflexes, that isn't what we call memorizing.

You can call that a pattern matcher, you can't recall one of your heads pattern matchers. Pattern matchers can be tied to recall, but pattern matchers can also solve problems for you by themselves without ever invoking any memory. Pattern matchers are much more powerful than memories since they can solve a whole slew of similar problems while memories just solves one thing, so there is no need to go memory -> pattern matcher, you can go instantly to pattern matcher without ever commiting anything to memory.

Re:Creativity fundamentally comes from memorization by kiba on Thursday August 01, 2024 @10:39AM (#41129574)
It's all memories to me whether that's concepts, models, tacit or otherwise. They are all just information stored within our brain.

Otherwise we're arguing semantics.

Re:Creativity fundamentally comes from memorization by Jensson on Thursday August 01, 2024 @12:15PM (#41130744)
> It's all memories to me whether that's concepts, models, tacit or otherwise. They are all just information stored within our brain.

So you call practicing a serve etc memorizing" excercises? That makes you very strange.

> Otherwise we're arguing semantics.

You have the strange definition here, most people don't all sorts of brain updates "memorizing". Memorizing is when you commit something to memory for later retrieval, people do not include all brain updates under this word.

Anyway, then we can agree that committing facts to memory to retrieve them later is not the main way to become more creative. Instead it is better to do other form of brain updates that doesn't involve storing exact information in the brain.

Re:Creativity fundamentally comes from memorization by WalterBright on Thursday August 01, 2024 @01:08PM (#41131269)
Did you simply intuited RC circuit design without anyone teaching it to you? How about the calculus needed to design an opamp circuit? Feedback circuits?

I doubt you could ace the MIT first electronic circuits final without taking the course.

> internalizing concepts is a completely separate process from memorization

Internalizing it is memorizing it.

Re:Creativity fundamentally comes from memorization by WalterBright on Thursday August 01, 2024 @01:27AM (#41126407)
The science/engineering/math tests I took at Caltech were all open book, open note. They were not about regurgitating facts and formulae. But if you didn't already know them, you didn't have the time to open the book and learn about them.
Re:Creativity fundamentally comes from memorization by Jensson on Thursday August 01, 2024 @03:17AM (#41126867)
> The science/engineering/math tests I took at Caltech were all open book, open note. They were not about regurgitating facts and formula.

Yes, you can be a bad engineer even if you pass such tests. Don't underestimate how far mindless pattern matching can take you, you can get pretty high up in international competitions just by dumb pattern matching and very little broader understanding, tests average students can pass are a piece of cake even at MIT level compared to that.

But of course such an engineer can be useful to solve constrained problems, but I wouldn't call them good since they don't really connect to the larger picture so they need a lot of oversight.

Re:Creativity fundamentally comes from memorization by WalterBright on Thursday August 01, 2024 @01:01PM (#41131186)
> you can be a bad engineer even if you pass such tests

Of course. But the issue is can you be a good engineer if you flunk the tests?

> tests average students can pass are a piece of cake even at MIT level

That's a nope.

Re:Creativity fundamentally comes from memorization by will1am on Thursday August 01, 2024 @06:58AM (#41127879)
Creativity comes from a deep understanding of concepts