News for hackers. Stuff that matters.
Re:Ask HN: What does your production machine learning pipeli... by fnbr on Wednesday March 08, 2017 @04:03PM (#13823757)
Are there any public posts discussing how you augment data?

Also, what do you use you spin up multiple jobs in parallel using EC2?

Re:Ask HN: What does your production machine learning pipeli... by bradneuberg on Wednesday March 08, 2017 @04:10PM (#13823830)
No public posts yet unfortunately. For spinning up jobs we have an internal tool that can spin up machines and provision them, but in my own experiments I just usually end up spinning up machines and rsyncing experiments over.
Re:Ask HN: What does your production machine learning pipeli... by fnbr on Wednesday March 08, 2017 @06:41PM (#13825093)
Ah, fair enough. Too bad, I'd be really interested in hearing how you do that. I work for a consulting firm as a data scientist, and we have a lot of issues with data size. I'm aware of the tricks for image data (rotating & flipping, playing with different gamma levels), but I haven't seen much for standard, tabular style data.