I don't know about that, ever been to Narva? Ethnic Russians are, at least to some extent, in a position similar to that of African Americans in the US, but it is easier for them to leave since they just arrived a few decades ago, whereas African Americans have been in the US long enough to have established long-term connections and to have lost contact with the "old world". So it seems pretty reasonable to me to say that Ethnic Russians have an incentive to leave the Baltic states.
Narva is a huge problem for the Estonian government - unemployment there is high, and the educational institutions struggle to field teachers who can teach in Estonian. As a result, young people with a Russian background are at a disadvantage with respect to basic language skills.
It's also fair to say there are a number of those in Narva who wish for their 'countrymen' to come rolling over the border again.
In any case, you have a point that if someone WANTED to integrate into Latvian society, they could. What I'm questioning is the desire.
Having immigrated to US and adapted to that society, I'd have to say that moving "back" to the country where you already speak the language and identify with the society is quite a bit easier than to fully integrate into something you are not used to. It's all in the will of a person and the economic incentives to do so. For me in the US, I had the resolve and very strong financial against to be had if I followed through.
If you take Switzerland as an example, their extremely high citizenship requirements are well supported by the high standard of living and long term benefits. Unfortunately, Latvia, together with the rest of the Baltic states does not yet have such a strong position. I suspect when it does, such complaints will end, as people will be happy to do the work for the reward.
Also claiming that they have an incentive to leave the country seems wrong, because the requirements to acquire citizenship are so easy. You just have to prove that you understand the Latvian language at a very basic level. If you can do that, then you get citizenship. Much easier than moving to a different country.