This is completely true. A blockchain that didn't prevent double spending could be both very efficient and support hidden transactions without any tricky math.