Launch HN: Hubble (YC S20) – Monitor data quality inside data warehouses

Re:Launch HN: Hubble (YC S20) – Monitor data quality inside ... by sails on Friday August 21, 2020 @02:51AM (#24232677)

> we got bought by a small PE Fund that is rolling the product into Xplenty

I'm interested to hear more about your experience building data warehouse related products, and perhaps learnings you've had along the way. I guess selling to PE wasn't the initial goal, but I'd imagine your product is very well suited to the Redshift space.

I've been working on Snowflake related products, and their adoption speaks to a world of new problems being created, similar to your product with Redshift. I suppose the risk is being squashed by Snowflake building the feature, or businesses migrating to something new (perhaps Redshift products have suffered because of Snowflake)

Basically, what do the battle scars look like :D

[ Parent | on HN ]

Re:Launch HN: Hubble (YC S20) – Monitor data quality inside ... by scapecast on Friday August 21, 2020 @09:10AM (#24234567)

there are always things the warehouses can't build themselves.

For example, with intermix.io, it was the tracing we had built for other tools like Looker and dbt. The insight was that the result of a DAG involves many different calculations across different tables. The metadata only tells you that the steps happened, but doesn't tell you in what sequence they happened, where the "hiccup", latency, etc.

Redshift is clearly suffering from Snowflake. I wrote about that in my post-mortem. That post also has a few battle scars:

https://medium.com/@larskamp/why-we-sold-intermix-io-to-priv...

Ping me on LinkedIn if you care to hear more :-)

[ Parent | on HN ]

Re:Launch HN: Hubble (YC S20) – Monitor data quality inside ... by sails on Friday August 21, 2020 @10:04AM (#24234972)

Cheers, appreciate it, will ping you on LI!

[ Parent | on HN ]