News for hackers. Stuff that matters.
Re:PostgreSQL 10 Beta 1 Released by byefruit on Thursday May 18, 2017 @11:32AM (#14368072)
At my previous company we made heavy use of its lossy compression feature.
Re:PostgreSQL 10 Beta 1 Released by pkhagah on Thursday May 18, 2017 @02:07PM (#14369577)
What lossy compression? Were you guys throwing bits into /dev/null?
Re:PostgreSQL 10 Beta 1 Released by infogulch on Thursday May 18, 2017 @05:54PM (#14371439)
Is that related to the cool "hash compression" technology I hear about? Apparently it can compress an arbitrarily large file into just a few bytes, amazing!
Re:PostgreSQL 10 Beta 1 Released by X86BSD on Thursday May 18, 2017 @12:42PM (#14368724)
You would get compression with Postgres running on ZFS.
Re:PostgreSQL 10 Beta 1 Released by adamzochowski on Thursday May 18, 2017 @05:52PM (#14371426)
Postgresql has compression by default on, for all large text and other large fields that get great benefit of compression. From documentation -" The technique is affectionately known as TOAST (or "the best thing since sliced bread"). "- https://www.postgresql.org/docs/8.0/static/storage-toast.htm...
Re:PostgreSQL 10 Beta 1 Released by kinghajj on Thursday May 18, 2017 @12:45PM (#14368760)
Lossy compression, not lossless.
Re:PostgreSQL 10 Beta 1 Released by sqeaky on Thursday May 18, 2017 @04:04PM (#14370639)
Database plus Copy-On-Write file systems sound like a bad idea. I am imagining a modest 100gb database being re-written for every change.

I am sure there is some way to work around this, but wouldn't this be the default behavior with a typical database and typical COW file system?

Re:PostgreSQL 10 Beta 1 Released by X86BSD on Thursday May 18, 2017 @04:51PM (#14370986)
You might be interested in reading this paper: https://people.freebsd.org/~seanc/postgresql/scale15x-2017-p...
Re:PostgreSQL 10 Beta 1 Released by sqeaky on Thursday May 18, 2017 @05:30PM (#14371265)
I am interested and I appreciate the thought and link, however these appear to be the slides to a talk without the actual talk. If so they are of limited use because the slides never have all the information the presenter has, and that information is often just a summary.

Is this the correct talk: https://youtu.be/dwMQXLOXUco?t=5380 ?

Re:PostgreSQL 10 Beta 1 Released by X86BSD on Thursday May 18, 2017 @05:49PM (#14371406)
Yes, sorry about that, that is the corresponding talk to the slides. Thanks for pointing that out.
Re:PostgreSQL 10 Beta 1 Released by cryptonector on Thursday May 18, 2017 @05:32PM (#14371281)
First, you have to make sure the page sizes for the FS and DB match. That's a critical requirement. But yes, you'll get write expansion twice.
Re:PostgreSQL 10 Beta 1 Released by crypto5 on Thursday May 18, 2017 @03:20PM (#14370228)
In random cloud provider you may not get FS with compression on your machine..