Ask HN: What does your production machine learning pipeline look like?

Re:Ask HN: What does your production machine learning pipeli... by AndrewKemendo on Wednesday March 08, 2017 @06:36PM (#13825061)

I am surprised that you are using AWS. It's generally cheaper and faster when you are at massive scale to build your own. Why do you do it this way?

in-house data turking setup

Can you clarify: Are you are turking with customers inputs or with internal team members?

synthetically generating millions of example data points

Are you implementing this via GAN or hand tuned?

[ Parent | on HN ]

Re:Ask HN: What does your production machine learning pipeli... by lstyls on Thursday March 09, 2017 @12:23AM (#13827190)

You're right about scale, but I think forgetting that the model training is on very different hardware than what production web and storage servers use.

Unless the have the need for dedicated GPU hardware at scale paying by compute unit still makes the best business sense.

[ Parent | on HN ]

Re:Ask HN: What does your production machine learning pipeli... by AndrewKemendo on Thursday March 09, 2017 @11:28AM (#13830329)

Disagree. That's the whole point of me asking. It's cheaper and will be better tailored to build your own GPU stack if you need it at scale than it is to "rent one" from the cloud providers.

I think it comes down to comfort and how critical it is to business processes.

[ Parent | on HN ]