To easily stay perpendicular to the work, use a tap guide block. You can 3D print one or drill one out of stock on a reasonably square drill press.