I think this tourist map[1] brilliantly depicts what parts most tourists actually stick to, by shrinking the western parts of the city on the map.

There are very few tourists in the vast majority of the Richmond and Sunset, except near the water and Golden Gate Park (around the museums). Also, there are very few tourists south of Bernal Heights Park.

[1] http://baycityguide.com/media/San-Francisco-Map.pdf