News for hackers. Stuff that matters.
Re:Show HN: Ploomber Cloud (YC W22) – run notebooks at scale... by idomi on Wednesday June 29, 2022 @11:29AM (#31921557)
Yes, you should follow best practices and isolate each job to the smallest task possible (and then reuse components). We have this functionality in 2 flavors, you can define hooks as part of your pipelines(https://docs.ploomber.io/en/latest/api/spec.html#id2), in addition you can define this dependency as part of your jobs DAG (https://docs.ploomber.io/en/latest/get-started/basic-concept...), e.g get the data, clean it, train the model and test it.

There are no comments on this comment yet.