I assumed from the "not bit-perfect audio" that VLC somehow misses bits or something, as in, doesn't play all the music information, but from your comment it just sounds something to do with volume. I also don't understand a word of your second paragraph, but I won't worry about that—they sound like dark, arcane realms of knowledge safer to avoid.
You can hear it for yourself - turn the volume in VLC very low down, and your speakers all the way up to compensate, and listen to a record - it'll sound bad. The louder your speakers, the lower you'll be able to crank VLC, and the worse the whole thing will sound.
Making the recording louder is - theoretically - fine; it shouldn't make it sound any worse. But if the recording is well-mixed, there's no headroom to make it louder and it will distort - this is because the engineers make the recording as loud as possible to avoid exactly the above issue.
Side note - bit-perfect is very important when you want to listen to surround-encoded files (AC3, DTS) on a surround system over SPDIF. SPDIF only has bandwidth for two uncompressed PCM channels, so the way it works is basically compressed audio data pretending to be a PCM stream. If anything messes with the stream - if you touch the software volume knob - your surround system will start outputting digital static at maximum volume.