You sound like you're asking this question as if it's a brand new question that nobody has ever thought of before, instead of something core to the entire idea of copyright: https://en.wikipedia.org/wiki/Derivative_work

Yes, it is a hard line to draw. It is advisable that if your business is dependent on being on the right side of copyright issues that you simply stay well away from the line.