Lookup spherical CNNs and tensor field networks, both are rotation invariant using spherical harmonics. They are not really used in practice however.