You also need the understanding, of course. The largest mistake in mathematics education is to think that memorizing a rote process is the same as learning mathematics (see: US high schools). The second largest mistake in mathematics education is to swing too hard in the other direction.
Nobody would suggest that you try to learn a new language without memorizing words, phrases, idioms, etc. Communication is the foundation of any field of interest, so why do we think we can get away with "learning" them without memorizing the sub-language of the field?
Just as memorization is only part of process of learning a new language, so it is for learning in other areas.
As you say, memorization can be a useful part of a deeper understanding.
At any rate, symbolic representations of knowledge should be committed to memory (or pad and pencil) at the time of understanding (Hebb's rule), or else your "memory" will be isomorphic to random symbols and therefore inaccessible to future thoughts.
That said, some of the greatest mathematicians (e.g., Gauss, von Neumann, Dieudonné) had phenomenal memory, so I suppose rote memorization isn't a terrible hack to try to approximate the advantages this kind of gift confers, but only in a pinch, since these mathematicians were keeping much more than definitions and statements of theorems in memory.
"Don't just read it - fight it!" - P.R. Halmos.
[0] Yes, I know these can be relaxed, but this is the standard presentation in Kobayashi-Nomizu/Spivak/Lee/Tu/Barden-Thomas/Do Carmo/Petersen etc etc.
Euler - probably the greatest mathematician of all time - had an amazing memory. He memorized the entire Aeneid and could recite any line at will.
That leads me to my next point, which is Anki is best used when you do what's called rote-memorization, but memorize simpler aspects -- so have one card that asks what does 'upon' mean in Greek, and another asking what 'mono' means in Greek - in addition to making more general questions regarding this subject.
(But the OP is French and I don't know whether French mathematics terminology includes anything corresponding to English "one-to-one".)
This won't give you an understanding of mathematics, just perhaps a memory of it.
I suppose people's methods differ, but personally I don't think I could have an effective memory without understanding, and that my memory follows understanding.
By "effective memory", I mean that I could actually apply some definition, not merely remember the pattern of notation on the page. I fancy if I learnt it from a flash card I'd struggle when variables were named differently, or with the slightest variation in form.
When we start a lot of things are interrelated and unless you a bare minimum is committed to memory, it's difficult to start.
It is akin to learning a language where one need to cram the basics building blocks i.e. words and grammar rules before applying them. I think idea of trying to understand before remembering ends up impairing learning at least in my case.
I have a two year old and I see this process in action. She will first cram things like counting and then start attaching meaning to it slowly.
When it comes to addition however, any attempt to learn addition by tabulation and memory would clearly be futile.
I certainly don't mean to suggest that one should study a theorem in a particular corner of mathematics from fundamentals up; rather understand it "one level down", to something previously interned in a similar manner (and since forgotten because one no longer had need of it) or to somemething axiomatic.
For example, say I come across an equation for the area of a right triangle for the first time. I've previously understood and accepted some other problem that I can reduce it to - area of a rectangle, say, or integration - so I can do so and actually understand why, and be able to reproduce it. Easier to learn, recall, and apply than rote memorisation in my opinion.
Perhaps I'm missing the point, but I'm really skeptical that rote memorization of definitions is a sensible solution to this problem.
> For example, I recall that Epi and Mono are generalization of injective and of surjective. Or of surjective and injective. I can't remember which is which.
Specifically with respect to Epi and Mono, perhaps it would help to know that epi is from Greek meaning "upon" and mono is from Greek meaning "alone" (my dictionary tells me so), which immediately resolves the injective-surjective confusion example: Epi is surjective, Mono is injective.