Why does it matter how a discriminated-against minority group got to a place? Russian Balts are treated poorly. African Americans are treated poorly. Both groups suffer from lack of opportunities, institutional discrimination at various points, and a cycle of poverty caused largely by bigotry. How they got there is really immaterial.
Narva is a huge problem for the Estonian government - unemployment there is high, and the educational institutions struggle to field teachers who can teach in Estonian. As a result, young people with a Russian background are at a disadvantage with respect to basic language skills.
It's also fair to say there are a number of those in Narva who wish for their 'countrymen' to come rolling over the border again.