News for hackers. Stuff that matters.

joram87

Show HN: VeilStream – Per-Branch Preview Environments

https://www.veilstream.com

# Show HN: VeilStream - Per-Branch Preview Environments## Optionally with sanitized production dataI've been building VeilStream to solve a problem I kept running into: Rigorous evaluation of changes, such that they won't break production is hard. Staging is shared and often broken. Pulling to local setups are a pain. So PRs get a quick code skim and a "LGTM." VeilStream spins up isolated...

( Read More... | no comments | 6 points | on HN )
Re:Show HN: VeilStream – prod-like data without the PII on Thursday June 19, 2025 @01:08PM (#44320549)
We've not tried it with dblab engine. that would be an excellent combo (from my quick reading up on it). I'll add to my todo list to experiment with the pairing. It does look like some overlap in functionality, but mostly they are symbiotic.
Re:Show HN: VeilStream – prod-like data without the PII on Wednesday June 18, 2025 @03:04PM (#44312468)
re: streamlining the custom filters

we were considering allowing the user to inject stored procedures themselves, and then use those, but currently, we're opting to implemented them ourselves, so we have better control over the user experience. In the future, for very custom stored procedures, I think we may allow the custom path.

Re:Show HN: VeilStream – prod-like data without the PII on Wednesday June 18, 2025 @02:48PM (#44312333)
Oh yes! We made that possible through conditionals. We default to unconditional modification, but if you toggle the conditional option, you can provide a list of conditions which, if they all pass, trigger the modifications.

A future improvement to that: currently the conditions are all ANDed together, I'd like to support more types of boolean logic in the future. :)

Re:Show HN: VeilStream – prod-like data without the PII on Wednesday June 18, 2025 @02:23PM (#44312147)
- jsonb : kinda, we do static json replacement, with more complex rules on the horizon, where you could replace some regex-like path with a random func.

- uuids: no, but I should. adding to my list :)

- ip addresses: yes ip4 and ip6, but I want to go further and let you configure the replacement ips to be within specified cidr blocks

- arrays: again, not yet. Do you mind if I ask the use case? Arrays are commonly done as single rows and foreign keys/look ups, which we can do.

We've internally got the path for adding new filter types (dashboard configuration, api layer storage, and proxy rule implementation) pretty optimized. it takes us a day or two to add simple requested filters. longer for more complex ones.

Re:Show HN: VeilStream – prod-like data without the PII on Wednesday June 18, 2025 @10:35AM (#44310275)
ah yeah, I linked the web app, the landing page is here: https://www.veilstream.com/ Currently we don't have much publicly on the GitHub page.
Re:Show HN: VeilStream – prod-like data without the PII on Wednesday June 18, 2025 @10:33AM (#44310262)
Good questions.

We do not do connection pooling yet. currently it's a fresh connection per query (which adds a bit of latency). We're intending to add basic connection pooling shortly after launch. That said, if you put it in-front of pgbouncer, that would work well.

PostGIS and other extensions are on the radar, but currently are not supported. The proxy works with the extensions, but can't mask the data yet. If we get requests for specific extensions to be fully supported, we'll implement (same with extra masking data types). I look forward to the GIS data implementation, as I've met one of the postGIS contributors and have discussed several of those masking complexities.

Show HN: VeilStream – prod-like data without the PII

https://app.veilstream.com

# TL;DR We built VeilStream, a drop-in, read-only PostgreSQL proxy that strips, masks, or anonymizes sensitive values as queries stream through. In less than two minutes, you can put a proxy in front of a PostgreSQL database, whether hosted on your laptop, Neon, Supabase, or a cloud provider, and the user is able to start configuring filter rules.The use cases we're trying to solve are:-...

( Read More... | 12 comments | 7 points | on HN )
Re:PostgreSQL Anonymizer on Friday January 17, 2025 @02:59PM (#42742607)
I probably should mention the name of the tool I'm working on... oops, it's VeilStream :)
Re:PostgreSQL Anonymizer on Friday January 17, 2025 @02:57PM (#42742589)
I've been working on something similar, starting a company around the idea! We realized that a lot of people had concerns or challenges with installing an extension on their production database and also that they wanted non-technical folks in compliance or HR to be able to configure and maintain the rules for individual employees. pgAnonymizer is a database extension but we structured ours to be a proxy server that hides/anonymizes/filters the data. We made a web dashboard that simplifies the configuration process, and allows you to configure what to do if columns get added to the database (default mask or hide new columns). We're about to go GA and if anyone has any feedback or wants to a free beta testing trial, I'd love to chat