You see? You are still able to make theories based on what you know and causality, and we can debate about which theories are most likely to be true. Not directly observing something is the beginning of theorizing. We don't just give up on knowing.