I've always assumed this was an evolutionary result of weighting memories based on their usefulness, wherein the most useful memories are correlated with their recall frequency. I.e. they are the most useful for surviving my day to day life since I seem to need them a great number of times.
Rather horrifying.
This does bring up an idea I had from years ago where instead of making prisons as boring as possible we make them amazingly interesting places where the prisoners have to use their brains constantly all day. The idea being that all this information will slowly push out the ideas and thoughts of the old person to be replaced with a new ideas and memories that make the person less likely to commit crime once released. The person should come out of prison a better person than they went in.
And on the subject of memories, are all memories information? If you learn something new in mathematics, do you risk losing the memory of the cake at your fourth birthday party, or only something technical you learned about archery?
Also, if what you are saying is true, you are vulnerable to a DoS attack on your brain. I could flood you with new information right now and, if you read it, you might not remember your mother's name by the end of it.