Yes, you end up very quickly in Thomas Nagel's "What is it like to be a bat?" scenario. You can't ever know what it is like to be another person (or animal) because as soon as you are that other thing, you are no longer you. If you were still you, you wouldn't be that other thing so you still wouldn't have that knowledge.