News for hackers. Stuff that matters.
Re:Who needs MLflow when you have SQLite? by praveenhm on Wednesday November 16, 2022 @01:20PM (#33627910)
what is alternative to MLflow other than SQLite, like Kubeflow, Metaflow?
Re:Who needs MLflow when you have SQLite? by crucialfelix on Wednesday November 16, 2022 @03:00PM (#33629633)
Weights and Balances https://wandb.ai/site
Re:Who needs MLflow when you have SQLite? by pcerdam on Wednesday November 16, 2022 @05:04PM (#33631445)
Weights and *Biases :)
Re:Who needs MLflow when you have SQLite? by kuba_dmp on Wednesday November 16, 2022 @04:10PM (#33630665)
Re:Who needs MLflow when you have SQLite? by the83 on Wednesday November 16, 2022 @04:32PM (#33630964)
Re:Who needs MLflow when you have SQLite? by mmq on Wednesday November 16, 2022 @05:44PM (#33631988)
Re:Who needs MLflow when you have SQLite? by kumare3 on Thursday November 17, 2022 @12:49AM (#33635446)
Checkout Flyte.org and it’s sibling project https://www.union.ai/unionml
Re:Who needs MLflow when you have SQLite? by d4rkp4ttern on Thursday November 17, 2022 @06:43AM (#33637602)
I highly recommend ClearML for effortless experiment that just works. It does a lot more of MLOps besides experiment tracking but I haven’t used those functionalities

https://clear.ml/

I had researched and spent time with several other tools including DVC, GuildAI and MLFlow but finally settled on ClearML. WandB pricing is too aggressive for my liking (they force an annual subscription of $600 last I checked)

Re:Who needs MLflow when you have SQLite? by farbarg on Friday November 18, 2022 @05:57PM (#33663923)
There are a lot of tools in this space. Shameless plug to follow.

I helped build and use Disdat, which is a simple data versioning tool. It notably doesn't have the metadata capture libraries MLFlow has for different model libs, but it's meant to a lower-layer on which that can be built. Thus you won't see particulars about tracking "models" or "experiments", because models/experiments/features/intermediates are all just data thingies (or bundles in Disdat parlance). For the last 2+ years we've used Disdat to track runs and outputs of a custom distributed planning tool, and used Disdat-Luigi (an integration of Disdat with Luigi to automatically consume/produce versioned data) to manage model training and prediction pipelines (some with 10ks of artifacts). https://disdat.gitbook.io/disdat-documentation