The drug use and homelessness are still pretty visible in downtown San Jose, or were when I lived there 2 years ago. Your personal tolerance level for it may be different from mine - I just treat it as a reality of city life, but my sister complained about it any time she visited because it made her feel actively unsafe.