News for hackers. Stuff that matters.
Re:How we saved money by replacing Mixpanel with BigQuery an... by statim24 on Tuesday December 05, 2017 @02:20AM (#15850345)
I do some of this but in a slightly different, maybe simpler way: 1. App runs in App Engine (flex). It includes a simple /collect endpoint for mobile events that just logs to /var/log/app_engine/custom_logs/track.json which automatically gets picked up by Google's Stackdriver. App code can just directly log to that file as well to record server-side events. (no network involved in recording events). 2. Stackdriver stores logs in Cloud Storage and also dispatches a Cloud PubSub push to a configured topic. 3. Another mini App Engine flex app receives the message, does the ETL, and inserts the row into BigQuery.
Re:How we saved money by replacing Mixpanel with BigQuery an... by boundlessdreamz on Tuesday December 05, 2017 @02:32AM (#15850384)
The downside of app engine over GCE/GKE is lack of sustained use discounts