I'd imagine working with an entire company document would require a lot more hand holding and investment in prompt engineering. You can definitely get better results if you add much more context of what you're expecting and how the LLM should do it. Even simple stuff like walking through its output.

Treating these LLMs as just simple Q&A machines is not enough.