News for hackers. Stuff that matters.

ioltas

Re:PostgreSQL 17 on Thursday September 26, 2024 @05:57PM (#41663940)
There has been a patch to extend the COPY code with pluggable APIs, adding callbacks at start, end, and for each row processed: https://commitfest.postgresql.org/49/4681/.

I'd guess that this may fit your purpose to add a custom format without having to fork upstream.

Re:Ten years of improvements in PostgreSQL's optimizer on Wednesday April 17, 2024 @05:13AM (#40062205)
The bar to merge a patch that would break on-disk format is so high that it’s really impossible to reach it ;)

More seriously, we care a lot about the format of the 8k pages to ease upgrade paths as much as possible.

I’ve met Simon for the first time in Tokyo in 2009 for a birthday related to JPUG (Japan PostgreSQL User Group) when hot standby was getting integrated into the upstream project. I saw him last time in Prague three months ago, and we have joked about a few things while discussing about life and how things were going on as I did not go to the Postgres Europe conference for 6~7 years.

The community has lost a member, and many people have lost a friend. That’s so sudden. My thoughts go to his family and people who knew him. I’m so sad. RIP, Simon.

I’ll try to do something about that tomorrow, saw your ticket.
There are hooks for the planner and the executor, so you could force their hand quite easily with a plan extracted from a previous EXPLAIN. Being able to pass a plan at protocol level would be more efficient, for sure. I’ve worked on Postgres-XC and somewhat Postgres-XL, and that’s something that we wanted to do to generate a plan on one node, and push down the compiled plan down to other nodes to avoid the overhead of the plan computation. This stuff did that for snapshots and a few more things with an extension of the protocol.
Thanks, glad to hear some good feedback.
There are many Postgres internals that people are usually not aware of, with more than one way to develop your module. I have a repo that’s a set of plugin templates here, that should be handy for your studies: https://github.com/michaelpq/pg_plugins
I’ve been doing maintenance and bug fixes for this module for over 18 months now (last commit on HEAD seems to be mine), managing the last two releases. If you have questions and/or feedback, feel free.
Re:Japanese houses have limited lifespans (2018) on Tuesday August 01, 2023 @04:09AM (#36953603)
Note that this one mentions 借地料, meaning that you are not an owner of the land, but the government is lending it to you for a yearly fee of 220,000 yens.
Re:Features I'd Like in PostgreSQL on Saturday January 28, 2023 @07:38PM (#34563618)
It's been argued a few times that we should have the possibility to make an index invalid on sight with a proper ALTER INDEX command, yes.
FWIW, amcheck can be useful but I am not 100% sure that it can detect all the broken cases either.
Looking at their code tree, this is based on 11.2 (https://www.postgresql.org/docs/11/release-11-2.html): https://github.com/alibaba/PolarDB-for-PostgreSQL/blob/maste...

So this is code from two years ago missing stability fixes from upstream up to 11.12, at short sight.

Re:A Minimal Email Client on Thursday February 25, 2021 @06:18PM (#26269617)
mutt + mbsync with a local copy is also a nice combination.
Re:PostgreSQL community impact of 2nd Quadrant purchase on Wednesday October 07, 2020 @09:41PM (#24714791)
Discussions within the core team are done on a private mailing list, so we'll know the status of things with a public announcement. Committers and contributors have no view of what gets discussed there, except if you are of course directly attached in CC of a given thread, and of course except if you are a committer also part of the core team. Four members of the current core team are committers.
Re:Time Machine in macOS 10.15.3 is very slow on first full backup on Wednesday February 12, 2020 @06:50AM (#22308044)
When it comes to backup, the time it takes for the backup to complete is not a property that matters the most in my opinion. The time it takes to restore the backup matters, and being sure that the backup is able to restore and is not corrupted matters even more.
Re:PostgreSQL 12 on Thursday October 03, 2019 @10:19AM (#21147235)
Here are some slides from a presentation of Andres Freud on the matter: https://anarazel.de/talks/2018-10-25-pgconfeu-pluggable-stor...

Slides 4 and 5 give some insight about the architecture changes which have been done.

Re:PostgreSQL 12 on Thursday October 03, 2019 @10:17AM (#21147207)
An advantage of REINDEX CONCURRENTLY is that it becomes much easier to handle dependencies of a rebuilt index with constraints, as what the feature roughly does it to add a swapping phase between the creation and the drop portions which switches the dependencies from the old index to the new fresh one. Table-level reindex also makes life easier.

The feature is equivalent to external tools like pg_repack (formerly pg_reorg) in more performant, and has a couple of limitations to be aware of: https://www.postgresql.org/docs/12/sql-reindex.html#SQL-REIN...

Re:Abacus tournaments in Japan on Wednesday September 25, 2019 @10:26PM (#21077598)
I am not sure, but doesn't it make also sense financially for some parents to send their kids to soroban classes because that's actually cheaper and more frequent in a week than other alternatives when they cannot go anymore to the public after-school services (I speak about gakudo/学童 here)?
Re:The Art of PostgreSQL on Wednesday August 21, 2019 @06:43AM (#20756064)
If that was not clear, the root comment mentioned that Dimitri was a committer, and it got edited afterwards. Regarding the book, I have a copy of the first edition close by (with a dedication from the author), and for application developers I think that it provides good insight about various aspects.
Re:The Art of PostgreSQL on Tuesday August 20, 2019 @11:11PM (#20754284)
Dimitri is a major contributor of Postgres for a very long time, still he is no committer: https://wiki.postgresql.org/wiki/Committers

Saying that, the man is really cool and his book is very good, so that's a must-have for developers in my opinion.

Re:Japan Begins Experiment of Opening to Immigration on Wednesday May 22, 2019 @11:57PM (#19988295)
> This is true. In fact, by far the fastest route to permanent residence in Japan is marriage. You can get PR in 3 years if you are married to a Japanese national vs 10 years if you aren't.

More details on that. Getting a wedding visa the first time gives 1 year. At the second application one year later, one gets once again 1 year. At the third application one year later, you get 3 three. At this point, you could ask for permanent residency. So the first three years after the wedding are a hell of paperwork, but after that there is no need to go to the immigration office (入国管理局) which is close to Shinagawa in Tokyo.

Re:We Can Do Better Than SQL on Thursday May 09, 2019 @08:59PM (#19874105)
Postgres 12, whose development has reached feature freeze and is in a stability period, has added some support for JSON path as of SQL:2016: https://git.postgresql.org/gitweb/?p=postgresql.git;a=commit...

The release is planned for roughly next September/October.

Re:MySQL Challenge: 100k Connections on Monday February 25, 2019 @05:33PM (#19250127)
There is a range of interesting problems here for Postgres. One is related to the costly way snapshots are built which needs to scan all entries in PGPROC to get back a list of transaction IDs. So even idle connections come at a cost. There have been proposed patches to improve the scalability in this area, one being called CSN (Commit Sequence Number) which I think is rather promising: https://www.postgresql.org/message-id/CA+CSw_tEpJ=md1zgxPkjH...
Re:PgFormatter: A PostgreSQL SQL syntax beautifier on Thursday October 11, 2018 @12:50AM (#18191032)
The most productive language of Gilles, well-known in the Postgres community by the way, is perl, and he can do completely crazy things with it. See for example pgbadger (https://github.com/darold/pgbadger), one of his other projects.

Older »