News for hackers. Stuff that matters.

lgvdp

Hey HN!

Some weeks ago we open sourced ch-kit, a schema-as-code toolkit for ClickHouse that allows teams to:

- define tables and views in TypeScript to ensure they are always correct - generate and apply migrations automatically by diffing the current and previous state, with risk classification (safe / caution / danger) and drift detection along the way - pull your existing ClickHouse schema into your repo in TypeScript with just a command - and much, much more.

As we mentioned, a python port of the toolkit was a must have for us and for many of the users that are already leveraging ch-kit. After thorough testing, we are excited to also share chkit-py with the ecosystem. It covers all the core features of the original package (some of the plugins are already built but pending testing).

Similarly to its TS counterpart, it's still in beta; so there could be changes based on users feedback, or if we determine there are better ways of managing backfills, mutations, etc.

If you use python to deal with ClickHouse® at scale, we recommend taking a look at it. And if you have any suggestions, you know where to find us!

I see a lot of people with concerns about privacy and security. Not shown in the post, but the github shows how to self host. No need to use 3rd party, you can just have your own too

Show HN: CloudClerk. We struggled with BigQuery finops, so we decided to fight

https://www.cloudclerk.ai/

Hello HN, Lucas here.I’ve been working with BigQuery for ~5 years, mostly in large (petabyte-scale) environments. Over time we ended up spending a lot of money and engineering effort just trying to understand where costs were coming from, why and how to optimize them.At some point we decided to stop, leverage all our past experience and spend a full cycle building tooling focused on cost...

( Read More... | no comments | 4 points | on HN )