Although I'm all in favor of cars, taking just one baby on public transit isn't much different from going by yourself on public transit. The trick is a sling. Don't even buy a stroller. There are several types of slings for babies. You can use one with a padded pocket and strap, one with fancy parts, a big long strip of cloth, or even just a folded bed sheet with a knot behind your shoulder.