Yes, I absolutely would be cautious - if nothing else, attempting to stop him with deadly force may well be what triggers the situation to become violent and life-threatening for my family and myself. But more importantly, all the circumstances I can realistically imagine myself trespassing into somebody's house do not involve me intending any harm to any of the occupants, so I would very much hope most people would approach such scenarios with similar caution.