News for hackers. Stuff that matters.
Re:Amazon CloudWatch Logs Insights by ec109685 on Tuesday November 27, 2018 @10:47PM (#18549152)
What’s wrong with seconds when implementing / running a new query?

Obviously disk iops are the bottleneck with such a system, so encouraging folks to conserve them by charging for bytes scanned seem like a good measure.

Won’t an enterprise implementing this themselves or using third party tools have to scale out their index nodes based on the amount data queries are scanning?

Re:Amazon CloudWatch Logs Insights by tyingq on Tuesday November 27, 2018 @11:55PM (#18549376)
"so encouraging folks to conserve them by charging for bytes scanned seem like a good measure."

I wonder if it warns you about potentially expensive button clicks. A little cartesian join, and...ouch.

Re:Amazon CloudWatch Logs Insights by zwily on Wednesday November 28, 2018 @06:42AM (#18550779)
It’s not powerful enough to do a Cartesian join (yet?). Most you can do is scan once over a big dataset.
Re:Amazon CloudWatch Logs Insights by tyingq on Wednesday November 28, 2018 @08:34AM (#18551268)
Hmm. I wonder if an "index only" query charges for the scan of the index, or a full table scan.
Re:Amazon CloudWatch Logs Insights by zwily on Wednesday November 28, 2018 @12:11PM (#18553280)
AFAICT, there is no indexing. It appears to just scan the logs as necessary. Maybe indexing will come later.
Re:Amazon CloudWatch Logs Insights by dberg on Wednesday November 28, 2018 @08:58AM (#18551453)
Bigquery has a cool function like this where it will tell you the cost of the query before you run it.