This isn't accurate, adverse inference can be drawn from silence in many first world western nations.
“adverse inference” is still nothing when it comes to making a case and is still infinitely better than perhaps missing an important detail and then having discrepancies between your own testimonies.
“I do not recall” and “I refuse to answer” translates well into a lot of languages.
The first time when you should talk about your case, if ever, is in court, during the trial.