I know the whole point of Bayesian statistics is that you actually need much less data to get a good prediction. But the edge case I was talking about is still interesting I think, if not as a criticism of Bayes.