Just lean into that. Start automating peoples jobs or making their jobs irrelevant. The management will take note of the concerns of the others and put you in your own group. Now that you have established that you are 5x more productive than the other employees while only making 20% more, management will not care if you slack off and only work 5 hours a week.