News for hackers. Stuff that matters.

pedrokost

We recently completed the migration of a self-hosted 3 TB PostgreSQL database from version 12 to 16, transitioning from Ubuntu 18 to Ubuntu 22. Concurrently, we had to upgrade various extensions, most notably Timescale, for which a compatible version did not exist across all scenarios. We performed the upgrade by updating a replica in the following sequence:

- Start: PG12, Ubuntu 18, TS2.9

- Step 1: Set up a read-only replica with PG12 on Ubuntu 22, maintaining TS2.9.

- Step 1.5: Enter maintenance mode and halt all services.

- Step 2: Detach the the read-only replica, upgrading from PG12 to PG15 on Ubuntu 22 with TS2.9.

- Step 3: Upgrade from PG15 with TS2.9 to TS2.13 on Ubuntu 22.

- Step 4: Upgrade from PG15 to PG16 on Ubuntu 22 with TS2.13.

- Step 4.5 : Reconnect services to the new database server, resume all services, and exit maintenance mode.

All the database upgrade steps were well-tested and automated using Ansible. Nonetheless, we did encounter an issue that had not arisen during testing. This extended our downtime to approximately half an hour, which, for our use case, was perfectly acceptable.

Employing logical replication could have mitigated the last-minute surprise. So we will consider this approach for our next upgrade cycle.

Re:Ask HN: Who is hiring? (April 2023) on Monday April 03, 2023 @04:28PM (#35430792)
Sentinel Marine solutions | Backend Engineer (Python) | HYBRID (Ljubljana, Slovenia) | Full-Time

We are looking for a Backend developer with a 5+ years of relevant experience. Our stack is Python, Django, PostgreSQL, TimescaleDB, RabbitMQ. We use Docker, Ansible, and more.

Sentinel is the maker of the "App for boats". We help make the ownership experience of the boat easier with telematics, by keeping you connected to your boat, giving you at-a-glace overview of vital boat equipment, and helping you with boat maintenance with reminders. We also connect the boat owner with the dealer and the broader ecosystem of partners relevant for boat ownership. Our products are a keystone piece of equipment on boats from the largest boat builders worldwide. We are still a small team (20 people), and are making waves in the boating industry. Your contributions will have a huge and direct on the boating experience of current and new boats.

This is a position requiring at least partial onsite presence, so it's local to Ljubljana and nearby areas. This is to facilitate working with hardware/firmware engineers when necessary, and mentoring less experienced developers.

To apply, email: jobs {at} sentinelmarine.net

We are experiencing very high CPU load caused by tinc [0], which we use to ensure all communication between cloud VMs is encrypted. This is primarily affecting the highest traffic VMs, including the one hosting the master DB.

I am starting to consider alternative tools such us wireguard to reduce load, but I am concerned of adding too much complexity. Tinc's mesh network makes setup and maintenance easy. The wireguard ecosystem seems to be growing very quickly, and it's possible to find tools that aim to simplify its deployment, but it's hard to see which of these tools are here to stay, and which will be replaced in a few months.

What is the best practice, in 2021, to ensure all communication between cloud VMs (even in a private network) is encrypted?

[0]https://www.tinc-vpn.org/

The author has gained a significant amount of Postgres-related knowledge when performing this migration.

Taking this into consideration, is it still worth using the managed Aurora, instead of the EC2 self-managed instance?

Re:RFC 8905 – The 'payto' URI Scheme for Payments on Sunday October 25, 2020 @10:09AM (#24886384)
This sounds great. Instead of trusting each company to implement their own billing system with some payment processor, just have the payment processors and banks provide "apps" that support these protocols, and users can chose which one to use to complete their payment.

One interesting follow up question in who covers the processing fee (e.g. the ~3% or so that Braintree or Paypal currently take)? Today, processing fees are mostly hidden to the user. If the user can chose their own payment processor, will they be required to cover the processing fee instead of the merchant?

Re:Dark mode for Stack Overflow on Monday March 30, 2020 @02:25PM (#22730694)
Chrome has this built-in as a flag: chrome://flags/#enable-force-dark

It will render all web pages with dark mode

Re:Undiscoverable UI Madness on Thursday February 27, 2020 @03:55PM (#22437747)
I have been observing something similar recently, but related to other technologies. People claiming they are good at Excel, but can't do a vlookup or a pivot table. People using 5% of the power of an IDE. People not realizing that if they are able to use a web-based tool at work, they could (probably) also access it remotely.

And these are just the things I have noticed in the past week.

We utilize just a tiny percentage of options that are available to us, barely enough to get the basics of out tasks done. But we are completely oblivious that there are probably better/hidden/power tools available in the software we are already using that could help us achieve our tasks much more efficiently.

Interestingly, most people probably don't care about it, or are so oblivious of their lack of knowledge that they don't even search for better ways to do things.

It's hard to blame thought. Improving this state requires a mentality of continuous active learning, where you don't just wait for someone to show you how to do your task better, but to constantly expand your knowledge into areas you don't even think you need to improve. However, most of us usually have "better things to do" than reading software manuals.

2 months ago I discovered Kepler[0] a tool by Uber for visualizing geo data. It has been of tremendous help when analyzing large geospatial datasets. It allows me to quickly visualize the results of my computations, and spot anomalies and patterns that I wouldn't have noted without it.

This seems to be a similar tool, but for charting non-geographic datasets. It should also be extremely useful.

I am glad companies are making these tools available for the masses.

[0] https://kepler.gl/

Re:Twilio Super SIM on Saturday May 11, 2019 @11:04AM (#19886518)
The value Twilio's offering is when you need coverage also outside Europe, in remote countries. Yes, you can get cheaper data plans to cover the EU, but those often come with very high data rates in other areas.
Re:Olive, a new non-linear video editor on Sunday January 06, 2019 @11:41AM (#18839111)
I have just completed a first project with OpenShot. It worked perfectly fine initially, but as the movie became more complex, everything took much longer. Saving took several seconds, sometimes freezing everything for several minutes. Dragging multiple clips in the timeline would freeze the editor for several seconds. It crashed multiple times. Just to be clear, this was from having about 30 original clips, but cut multiple times (each probably at least 10 times), so over 300 individual clips in the timeline. The bottleneck seems to be related to parsing of the JSON, which is the format in which the data is encoded internally. The final file was about 1.1MB of JSON. I've also encountered strange artifacts when adding a new layer at the bottom of the screen - I couldn't drag clips onto it, they were placed onto another layer instead.

This is on a laptop with an i7 and 12 GB of RAM.

Compared to my experience of using Premiere Pro several years ago on Windows, with just 4GBs of RAM, OpenShot has a long way to go even for basic editing.

But, having said that (and considering that Premier had years of paid development), it's a good tool and it's great that some developers are trying to built video editing tools for Linux. Things are slowly improving.

Re:FizzBuzz in ten languages on Monday December 31, 2018 @11:01AM (#18795085)
I agree, but for different reasons. I have seen a lot of code start with variables like `divisible_by_three`, only to have the requirements change to check division by 4, but programmers being too lazy to update the variable name as well.
Re:Google's cross-platform Flutter UI toolkit goes 1.0 on Tuesday December 04, 2018 @01:08PM (#18601960)
How does it handle integration with maps libraries (e.g. Google Maps) and BLE support?

Anyone has any experience with how well those work with React Native, and could share their experiences?

I have been making https://www.klubi.si/ sporadically over the past many months (it was meant to be a weekend project, but it never ends there...). It's a map of sports clubs in my country.

The idea is to help people find klubs nearby, as well as provide a basic internet presence to those klubs whore founders don't have the time or knowledge to create and maintain a website, or even a Facebook page.

The website works by volunteer revision of data, as well as twice a year email reminders to founders to review the data. This helps ensure that the data is the most up to date as possible.

Unfortunately, not all klubs even have a public working email address, so thinking of it, I could probably do something about as well.

Re:Ask HN: How can I volunteer my software skills online? on Sunday February 19, 2017 @06:12AM (#13679174)
Think about the problems in your neighborhood and try to imagine creative solutions to them that you can implement with your skillset. It doesn't need to be a global problem to be worthwhile solving - sometimes helping our just a handful of people can feel extremely worthwhile.

This is how I got involved with a personal project. A few years ago I had trouble finding a listing of all Karate dojos in my vicinity. I compiled a list of such dojos in Excel, and later decided to put them online [0]. By putting this dataset online, and maintaining it up to date I am helping other people who are looking for a new place to train a sport.

This project not only helps the community (who can now easily find karate and other sports clubs easily through the project website) but also helped me learn new technologies and practice skill that I don't excel at, like design, writing, marketing, etc. Just yesterday I took the project to the next level and started doing same simple data analysis of the dataset [1].

While the project may not have a very large impact on the community, it does sufficiently so to feel worthwhile. Moreover, being able to play with different skills in a low stress environment makes is very enjoyable.

[0] http://www.klubi.si/ [1] https://medium.com/@pedro.kostelec/analyzing-the-market-size...

Older »