Re:Metaflow, Netflix's Python framework for data science, is...
by savin-goyal on Tuesday December 03, 2019 @11:26PM
(#21699574)
We erred on the side of simplicity to keep things manageable for our users.
Re:Metaflow, Netflix's Python framework for data science, is...
by beshrkayali on Wednesday December 04, 2019 @12:38AM
(#21699887)
That seems more complicated.
MetaFlow doesn't do that -- instead each 'step' has to know what to call next, which means that if I wanted to subclass e.g. the MovieStatsFlow in [here](https://github.com/Netflix/metaflow/blob/master/metaflow/tut...) and say, add some sort of input pre-processing before the compute_statistics call, I'd essentially end up having to either override what compute_statistics does to not match its name _or_ copy-past e that first step just to replace that last line.
I'm sure this design decision was considered and/or that use-case doesn't come up a lot at Netflix (although I've encountered that a lot), or maybe I'm missing something very obvious, but I'd love to hear your thoughts on that.