It's not just because of fishery collapse. The changing temperature and pH matters, too. Reefs bleaching and all that.

I wouldn't say it's a rumor. Just a possibility as reported by some researchers. Not a consensus, as far as I know, though there was a book about it summarizing the research.