If that is what they meant, that's not a good idea.

Choice of h dictates precision (less bias than doing it purely in the real domain, but still .. a nontrivial choice). And also requires your functions to be analytical - which many aren't.

Whereas autodiff is precise .