Since Deepmind hasn't beaten Montezuma's Revenge yet, and has been cracking away at it along with a number of other researchers for years, empirically, the answer would seem to be yes.

(I know the article says that it's been beaten, but it's wrong: it's improving over DQN by being able to explore 15 rooms rather than 2 rooms, but it hasn't cleared the first level, much less the whole game. An interesting breakthrough in how to define novelty in the ALE but not something as striking as AlphaGo.)