Buffet may not directly exploit anyone, but wage-labor in itself is exploitation. If he's investing in companies that hire employees with the intent of extracting surplus value from said employees, then he's indirectly participating in capitalist exploitation.