I'd be interested to know whether that's an actual requirement of the format (i.e. the compressor reads far ahead in the input), or if it's only an artifact of this implementation.

My expectation is the latter. Unbounded lookahead is potentially O(n^2) or worse in the size of the input, making it infeasible to use on large inputs.