Hard to play historical what-ifs, but let me try. By the end of the 13th Century, almost all Crusader holdings had been taken over by the Sultan of Egypt Baibars. He used his consolidated power to defeat the Mongol horde at the Battle of Ain Jalut in 1260, the first time a Mongol army had been defeated.
It's possible that if there had been no Islamic power at the time, either the Golden Horde or the Ilkhanate would have eventually swept the Eastern Roman Empire away. Or maybe not. Who knows?
Even otherwise, you realise that the body blow to the ERE wasn't struck any Muslim army. Constantinople was captured and looted by Crusaders in 1204, apparently on the Fourth Crusade. Though the Greeks recovered Constantinople a few decades later, it was a shadow of it's past self, left with the city, north Western Anatolia and parts of the Balkans. The Ottomans ended the empire in 1453.