While I agree with OP that you need to listen to a lot of source content, a reasonable amount grammatical understanding can definitely speed up your comprehension. This is a lot of what gives adult learners an advantage to learn quickly over infants.