Yeah that seems a little counterintuitive at first, but your assumption is correct. You still absorb lots of cheap calories from the sugars / carbs that you eat, but there's still plenty of leftovers for the bacteria. Everyone's different though - some people may have no issues at all, others are extremely sensitive.