I find F360 to be quite efficient and precise at these things.
Make a sketch; make a rectangle. Constrain it until it all turns black (do this by reference to the origin). Drop a circle on the sketch. Click the circumference. Press d. Place the dimension tag. Enter the diameter. Press d again, click the center of the circle. Click the left edge of the rect, drag the mouse up to place the tag someplace nice. Type in the distance from the edge to the center of the circle. Do the same for the Y location.
It shouldn’t feel like you’re dragging and sizing anything manually unless it’s just a decorative part.
I use Fusion 360 exactly how you say you want to. Just slap some shit on there and then use dimensions and constraints to actually precisely position everything to match my measurements.
I will say that I learned a lot by watching James at clough42 do some designs, but I think I’d learned the very basics before that.
Briefly, for functional parts: “blue lines on the sketch are bad” Add constraints until they turn black (fully constrained). If you aren’t sure why a line is blue, drag it and see which degree(s) of freedom it still has and add constraints to those.
Once you have that down and made a drawing, I’d then look at “modify user parameters” to make sketches more easily tweakable (especially if you’re 3D printing or trying to match a bolt pattern that’s somewhat “random”). Almost every drawing I start now starts with defining the user parameters (and then using those as the dimension entries).
This might not be the best “first video” to watch, but it’s topically relevant to help you here: https://clough42.com/2020/07/04/tap-guide-block-ii-fusion-36...
Parametric modeling is a godsend for woodworking.
FWIW I found the same nonsense when doing schematic and PCB layout with e.g. Eagle. I'm running a data bus from one component to another. This is a standard thing since the 70s. Why is the tool making me drag lines and manually connect them and individually label them? In Eagle get the exact mouse end point wrong and it doesn't even connect the components and you don't find out until much later in the process when you move something or try to switch to PCB layout and nothing hooks up. Yes, there's some aggregate bus routing stuff but it's the exception rather than the rule.
I don't understand how hardware and manufacturing engineers can stand these tools. So manual and finicky.
I tried some of the programmatic CAD tooling, too but they also didn't really click with me. But I did notice a plugin for Fusion 360 that adds python scripting, so I might give that a try.