News for hackers. Stuff that matters.

A comment on The new local data stack: Integrating Dagster, dbt and DuckDB. Parent comment

Re:The new local data stack: Integrating Dagster, dbt and Du... by benjaminwootton on Thursday December 14, 2023 @08:03AM (#38640877)
There are a bunch of collector tools for capturing application side events and sending them into your server.

The common stack is then to ingest them from Kafka into an OLAP datastore like ClickHouse or Pinot.

Then I think you are referring to what is sometimes called “user facing analytics” against that datastore.

We like to use a tool called Cube.dev as middleware between the app and OLAP database which gives APIs and a semantic layer.

[ Parent | on HN ]
Re:The new local data stack: Integrating Dagster, dbt and Du... by OJFord on Thursday December 14, 2023 @08:13AM (#38640957)
'user-facing analytics' and (via Cube.dev) 'embedded analytics' are helpful terms, thank you!
[ Parent | on HN ]
Re:The new local data stack: Integrating Dagster, dbt and Du... by totalhack on Thursday December 14, 2023 @11:51AM (#38643507)
+1 for using a semantic layer. I built (and open-sourced) one for use in my own business but Cube looks well done.

https://github.com/totalhack/zillion

[ Parent | on HN ]
Re:The new local data stack: Integrating Dagster, dbt and Du... by geoHeil on Thursday December 14, 2023 @12:31PM (#38644175)
Not to forget https://www.starrocks.io/ or https://risingwave.com/ - see also a recent blog post of a friend: https://juhache.substack.com/p/moving-from-bi-to-data-apps-p...
[ Parent | on HN ]