I feel exactly the same way. Taking notes just distracts me from the original content and I end up absorbing less. When I was still in school, the only notes I took were exact copies of what the teacher/professor wrote on the board, and only if it was something I couldn't derive myself with what I already knew.

I wonder if part of it might be because I write slowly and tend to focus on my penmanship (unknowingly).