Yeah, I think this pattern is pretty common. (Basilica's main business is an API that does deep feature extraction as a service, so we end up talking to a lot of people with tasks like yours -- and there are a lot of them.)

We're actually working on an image model specialized for human faces right now, since it's such a common problem and people usually don't have huge datasets.