That's a non sequitor, as I'm not trying to explain human actions at all in this case.

I think their comment is pointless, and would agree with you calling it a non-sequitur, however I feel the need to pedantically point out that when you wrote "... it seems really bad logic to assume that...", that is explaining a human action (assuming).

You literally do.