News for hackers. Stuff that matters.
Re:Metaflow: Build, Manage and Deploy AI/ML Systems by vtuulos on Thursday July 17, 2025 @05:16AM (#44591334)
I don't know if it's a coincidence but we just released a major new feature in Metaflow a few days ago - composing flows with custom decorators: https://docs.metaflow.org/metaflow/composing-flows/introduct...

A big deal is that they get packaged automatically for remote execution. And you can attach them on the command line without touching code, which makes it easy to build pipelines with pluggable functionality - think e.g. switching an LLM provider on the fly.

If you haven't looked into Metaflow recently, configuration management is another big feature that was contributed by the team at Netflix: https://netflixtechblog.com/introducing-configurable-metaflo...

Many folks love the new native support for uv too: https://docs.metaflow.org/scaling/dependencies/uv

I'm happy to answer any questions here

Re:Metaflow: Build, Manage and Deploy AI/ML Systems by theOGognf on Thursday July 17, 2025 @08:33AM (#44592591)
Is it common to see Metaflow used alongside MLflow if a team wants to track experiment data?
Re:Metaflow: Build, Manage and Deploy AI/ML Systems by vtuulos on Thursday July 17, 2025 @09:42AM (#44593322)
Metaflow tracks all artifacts and allows you to build dashboards with them, so there’s no need to use MLFlow per se. There’s a Metaflow integration in Weights and Biases, CometML etc, if you want pretty off-the-shelf dashboards