Agreed - a drill press can get a perfect hole and then the tap will likely be straight as well.

Use a punch to get a starting point for your drill bit to keep it from "walking" and not going in the spot you want.

This might also help:
https://youtu.be/nGqiw4dorDs