I have built deep learning systems for similar problem domains. I am happy to chat to you about your example. Email me if you get a chance.