For that to be the case it should be accumulated in the body in the form of toxins or similar molecules, there's no other 'memory'.

So no, it does not work exactly like that. Some chemical compounds trigger mutations at a higher rate than others.