Yeah, walking from Rosslyn to Mt Vernon would take a really long time. Walking to Old Town Alexandria, however, is pretty doable for a day, though you'd probably want to take the subway back home afterwards.