Depending on the stage, they actualy give up sushi ...
Apart from pregnancy/breast-feeding, Japan’s relation with raw fish is interesting, in that most people understand one day they’ll be unlucky and get food poisonned, but that’s just a fact of life, and nobody usually avoids raw fish just because of the risk.
My understanding is that the primary concern is the ability of the child to breathe normally. Anything which restricts that ability can be life threatening.
Having their face covered (very easy to do when they sleep between two adults who pull the covers up when they're cold) or pushing their face up against a non-breathable material (windproof bassinets, pillows, soft toys) leads to a lack of air circulation which can lead to CO2 buildup. This is particularly a problem when their muscles aren't strong enough to turn their head or roll over.
As an additional benefit, she didn't have to pump for overnight, and I didn't have to get up to bottle feed. Which, I would have done! But I'm happy not to have to have done that.
I am a very hard sleeper. I can sleep through anything. But I can sleep in bed with a little kid next to me just fine. I think our unconscious minds/nervous systems must have enough awareness of those little blazing furnaces.
But generally the books don't even say where the claims are coming from, and everything is like you suspect, quite small effects if any, a priori.
Even the co sleeping thing seems to be fearmongering. Unless you're drunk, you're not gonna squash your kid to death. Plus the sleep benefits of letting the kid have boob on tap are enormous.