Re:Everyone wants to do the model work, not the data work [pdf]
by kfk on Monday March 29, 2021 @04:43AM
(#26618937)
I agree we need to start from an mvp and so with a data model, but does this model really need to be AI or ML? My counter point to your counter point is yes, we need a model, but probably the initial one can be done with simple BI/SQL type aggregation methods. Most of AI/ML I see is optimizing an already existing model, not create something completely new.
[ Parent
| on HN ]
Re:Everyone wants to do the model work, not the data work [pdf]
by Ntrails on Monday March 29, 2021 @08:38AM
(#26620638)
A few years back the team that do "Business analysis" came to our team asking for help setting up some machine learning. What for, we asked. Well, we'd like to predict hardware expenditures over the next n years.
Ok. Well that sure seems like a thing the business might like an estimate of! Sure. Next question: Have you run a basic regression over the data you've got, maybe a simple model would be close enough to throw some error bars up and get going.
Of course not.
Re:Everyone wants to do the model work, not the data work [pdf]
by kfk on Monday March 29, 2021 @10:04AM
(#26621712)
You see "we'd like to predict hardware expenditures over the next n years" for me is a red flag. When I hear those types of requests I hear "we'd like to shift responsibility and ownership of our financial estimates to someone else".
Re:Everyone wants to do the model work, not the data work [pdf]
by disgruntledphd2 on Monday March 29, 2021 @05:16AM
(#26619115)
I'd suggest using a lasso, tbh. It's pretty fast, relatively performant and one can interpret the coefficients.
That being said, I'd do your simple SQL aggregations first, to ensure that one can actually learn something (if we have 0.0001% positives, a simple approach probably isn't going to work well).