Yes, absolutely. People are multidimensional. Most people may not care for your particular captivating niche interest, but some will find your excitement about it interesting and enjoy your excitement about it. And you can reciprocate that feeling towards their niche interests (almost everyone has at least one). Toss everyone who doesn't care about your thing into the same "normie" pile at your peril.