Yes, moving towards sun/ any body that is inbeteen sun and earth you actually 'slowing down' (after reaching earth's orbit). When you reach zero V relative to sun you will just drop to its surface (same with any other planet).

Anything on the outside you 'speedup'.

That's why its called delta-V as its relative change in V needed to get somewhere. And its independent of size, type of craft etc.