People who don’t have an ingroup are called psychopaths. I know at least one person who (claims to have) reasoned themselves into something resembling utilitarianism from that starting point but that’s a minority end point to not having a capacity for group loyalty.