It means using less number of bits to store float values. This reduces the memory/compute requirement at the cost of making model less precise.