Re:Andreessen-Horowitz craps on “AI” startups from a great h...
by nl on Monday February 24, 2020 @10:34PM
(#22410713)
Most (?) RDBMS query planners rely on updating statistics on the data in the table to decide what type of joins to perform.
I can imagine cases (distributed databases, different speed storage) where it would make sense to test the queries and learn which optimisations make sense. It'd be self tuning and able to adapt to changing hardware.
Re:Andreessen-Horowitz craps on “AI” startups from a great h...
by perl4ever on Tuesday February 25, 2020 @06:04PM
(#22418503)
Oracle certainly has statistics and incredibly sophisticated optimization in theory, it's just that in practice, I think it sucks.
I spent way too many years writing ad hoc Oracle SQL that had to complete within a few hours and trying to guess if the optimizer had decided to finish in 15 minutes or a week.
And I would read Tom Kyte where he says obviously your database is set up wrong if the optimizer isn't working for you. And how you should do everything in one big beautiful query that uses all the latest features of Oracle.
Most of what you wrote seems fine, until I got to this. A query optimizer seems like something that tends to be very opaque, very complex, and in my experience blows up without a good explanation frequently in typical situations. It's also based on a lack of complete data about the problem domain, to the point where an optimal algorithm seems hopeless. I'm not saying an AI approach automatically can be better, but at least you (I) can envision it being better, perhaps less brittle and taking into account dimensions and possibilities a human doesn't. And the non-AI solutions aren't trustworthy in terms of bounded quality so you have not got a lot to lose.