News for hackers. Stuff that matters.
Re:The AWS and MongoDB Infrastructure of Parse by felixge on Thursday February 09, 2017 @07:26AM (#13606418)
And that's for a sequential scan over all of those tuples?

That'd be very impressive. Does SQLServer support parallel execution? Or how come it be so fast?

Re:The AWS and MongoDB Infrastructure of Parse by philliphaydon on Thursday February 09, 2017 @08:30AM (#13606734)
> Does SQLServer support parallel execution?

For a long time as far as I know?

Re:The AWS and MongoDB Infrastructure of Parse by felixge on Friday February 10, 2017 @01:36AM (#13613669)
Cool. I'm not familiar with it, that's why I ask :).

Anyway, is the performance you mentioned for a scan over the entire table? E.g. to do an aggregate?

Re:The AWS and MongoDB Infrastructure of Parse by philliphaydon on Friday February 10, 2017 @02:38AM (#13613856)
Honestly don't remember, I'm working on new stuff in PostgreSQL now.

I know a count of the whole table takes about a minute tho. But the filter > group by was ~1s as the grouping was done on about < 50 rows of the filtered result.

Without knowing the original query above was using it's speculation on why it was slow and mine was fast. My argument is just that SQL Server isn't magically slow. MySQL/PostgreSQL/SQL Server are super fast. And if you don't massage the database it can be super slow too.

Re:The AWS and MongoDB Infrastructure of Parse by felixge on Friday February 10, 2017 @04:03AM (#13614166)
Thanks.

> I know a count of the whole table takes about a minute tho. But the filter > group by was ~1s as the grouping was done on about < 50 rows of the filtered result.

Yeah, that makes sense.

I'm running some queries in production that take a 150 million row table, filter it down to ~100-300k rows which are then aggregated/grouped. This usually takes < 1s. However, if I'd try to do a count(*) on the table, that'd be around a minute as well.

> Without knowing the original query above was using it's speculation on why it was slow and mine was fast. My argument is just that SQL Server isn't magically slow. MySQL/PostgreSQL/SQL Server are super fast. And if you don't massage the database it can be super slow too.

Yeah. The query / query plan will be needed to go more in-depth on these kind of discussions. The amount of disk vs memory hits during execution obviously as well.

Anyway, I just wanted to understand if SQL Server was e.g. an order of magnitude faster than Postgres when scanning a large number of tuples. But I guess the answer to that is: probably not.

Re:The AWS and MongoDB Infrastructure of Parse by philliphaydon on Friday February 10, 2017 @04:24AM (#13614242)
PostgreSQL has a BRIN index's as of 9.6 which may make some forms of aggregation faster than SQL Server I believe. Would need to do real-world tests to verify that tho.