You might like [1], where they use an ensemble of models and essentially optimize for novelty as measured by the entropy of model predictions across the ensemble.

[1] Model-Based Active Exploration, Shyam et al. 2019, https://arxiv.org/abs/1810.12162