News for hackers. Stuff that matters.

treybrick

Re:Using short lived Postgres servers for testing on Monday July 01, 2024 @03:44PM (#40849794)
Disclaimer: I work at Tonic AI

We have a product called Ephemeral (in some ways similar to Neon) that orchestrates a kubernetes cluster to spin up and down ephemeral databases from "snapshots" for this exact use case.

We have a more well established product called Structural that does de-identification and anonymization from production data, and we have a pretty clean integration between the two products to make creating your fleet of ephemeral testing databases nice and easy.

In case you're interested -> https://www.tonic.ai/ephemeral

What types of files and databases does this integrate with? Most of my files are in S3 and many of them are messy PDFs made from scanning physical documents. Do I need to standardize them all to txt's or csv's or something to get them to work right?