I've never used bread as a yogurt starter, but I have used yogurt to kickoff a starter to bake sourdough bread. Takes a few days before the starter starts growing nicely but makes sense it can go both ways.