Once you build up your seasoning on cast iron, you're not really touching it anymore, much less scratching it, much less machining it. On top of the fact that the pan isn't dry either.

Also eating iron oxide is fine, it's breathing it that is bad.