People moving away from the countryside to cities could be a big factor. That leaves rural areas with a lot of older folks (that don't count as unemployed) while jobseekers are in bigger cities. Why should you be unemployed in rural Brandenburg when you could as well move to Berlin where there's a higher chance for a job? That could also explain why the rate in Northeastern Germany has decreased that much, both areas are mostly rural.