News for hackers. Stuff that matters.
Re:Show HN: Serverless Analytics Built from Scratch by InGodsName on Thursday December 20, 2018 @03:05PM (#18728607)
Please explain what is cube.js doing in this? I mean, what exactly cubejs does.
Re:Show HN: Serverless Analytics Built from Scratch by pavel_tiunov on Thursday December 20, 2018 @03:20PM (#18728734)
Thanks for the question! We should do a better job describing this. In short: 1. Generates analytic SQL queries based on Cube.js schema. It can be simple ones like calculating page views or more advanced like calculating session metrics, attribution models or funnels. 2. Caches sql responses to not to overwhelm SQL backend with user requests. 3. Pre-aggregates data to be able to query trillions of data points in matter of seconds. 4. Orchestrates SQL query execution. Organizes dependencies between pre-aggregations, queue priorities, cache refreshes. 5. Provides REST analytic API for end users.
Re:Show HN: Serverless Analytics Built from Scratch by InGodsName on Thursday December 20, 2018 @04:13PM (#18729168)
Why do you need to select all rows in your Cubejs section when you can directly run query in athena and get back the aggregates you need.

Basically you select all rows then cubjs does something on those rows when you can infact directly run queries in Athena

Am i missing something?

Re:Show HN: Serverless Analytics Built from Scratch by pavel_tiunov on Thursday December 20, 2018 @04:24PM (#18729255)
It actually works exactly as you describe. We generate SQL query to return aggregates based on SQL supplied in Cube.js schema. We never fetch raw data from SQL backend. Architecture overview can probably help to understand: https://github.com/statsbotco/cubejs-client#architecture