It's easy to recognize and avoid the student neighborhoods. Find out where the professors and doctors live. Or even the graduate students -- not as wealthy but tend to be quite well behaved. Many are raising families while in grad school.

I live in a college town -- mid sized city in the shadow of a major university in the Midwest. It has everything the OP wants, walking distance to supermarket and shops, easy to get around by bike, enough of an economy thanks to the university and hospitals.