News for hackers. Stuff that matters.

A comment on Postgres scaling advice. Parent comment

Re:Postgres scaling advice by srcreigh on Tuesday January 26, 2021 @03:56PM (#25920954)
Naive question. Wouldn't sampling a power law dataset be straightforward? The idea is there's only a few outlier values, and the rest are uncommon. This distribution seems extremely common. Ie column with mostly NULL values and the rest somewhat unique non null strings.

I'm curious what data you saw and why the sampling didn't work?

[ Parent | on HN ]
Re:Postgres scaling advice by ldng on Tuesday January 26, 2021 @06:19PM (#25922212)
I'm curious, will he answered given his vested interest in "exabyte-scale analytical database" ? :-)

And laurenz_albe has a vested interest in PG as he's a contributor.

So I, too, would love more concrete details.

[ Parent | on HN ]
Re:Postgres scaling advice by kikimora on Wednesday January 27, 2021 @02:09AM (#25925200)
I think the problem is PG does not know underlying data distribution and use one sampling strategy which works for normally distributed data.
[ Parent | on HN ]