Show HN: Heap is a new approach to analytics. Just capture everything

Re:Show HN: Heap is a new approach to analytics. Just captur... by pc86 on Friday March 22, 2013 @02:35PM (#5424714)

I've often wondered about the efficacy of having a simple catch-all script that just tracks everything a user does on the site. I would think it would pound the database relentlessly under even modest load.

[ Parent | on HN ]

Re:Show HN: Heap is a new approach to analytics. Just captur... by darkxanthos on Friday March 22, 2013 @07:51PM (#5426537)

One trick is to not use a database but a flat text file. You can optimize for querying nightly.

[ Parent | on HN ]

Re:Show HN: Heap is a new approach to analytics. Just captur... by ukoki on Saturday March 23, 2013 @02:54AM (#5427514)

AWS comes into its own for these kinds of use cases - make a lightweight autoscaling events API on Elastic Beanstalk pumping events into DynamoDB coupled with a bunch of workers running at the EC2 spot price sorting and processing these into a traditional RDBMS = massively horizontally scalable events handling for pennies an hour.

[ Parent | on HN ]

Re:Show HN: Heap is a new approach to analytics. Just captur... by mcos on Friday March 22, 2013 @02:47PM (#5424798)

You could read all the responses into a Queue-type structure and then populate the database in the background.

[ Parent | on HN ]

Re:Show HN: Heap is a new approach to analytics. Just captur... by stevoyoung on Friday March 22, 2013 @05:08PM (#5425784)

Clickish can do this with GA is you wanted. It's also intelligent with how it routes request back to GA. http://www.clickish.org

[ Parent | on HN ]