Re:Who needs MLflow when you have SQLite?
by guangyeu on Wednesday November 16, 2022 @11:40AM
(#33626025)
Could you provide context on why SQLite would replace MLflow? From the standpoint of model tracking (record and query experiments), projects (package code for reproducibility on any platform), deploy models in multiple environments, registry for storing and managing models, and now recipes (to simplify model creation and deployment), MLflow helps with the MLOps life cycle.
[ Parent
| on HN ]
Re:Who needs MLflow when you have SQLite?
by edublancas on Wednesday November 16, 2022 @11:44AM
(#33626107)
Fair point. MLflow has a lot of features to cover the end-to-end dev cycle. This SQLite tracker only covers the experiment tracking part.
We have another project to cover the orchestration/pipelines aspect: https://github.com/ploomber/ploomber and we have plans to work on the rest of features. For now, we're focusing on those two.
Re:Who needs MLflow when you have SQLite?
by ralphc on Thursday November 17, 2022 @12:02AM
(#33635171)
Have you looked into duckdb for the database? I'm hearing for some tasks it's faster than SQLite.
Re:Who needs MLflow when you have SQLite?
by edublancas on Thursday November 17, 2022 @08:15AM
(#33638403)
Yeah, we're also looking into it and we'll probably add it as a backend in the future!