I'd say that yes, if you are just performing an operation that already exists in a common C library just use that. But I could see the advantages for an algorithm that did not already exist for which you wanted to express in Python.

OpenCV is great as a black box but its built in functions are not always sufficient or optimal.