News for hackers. Stuff that matters.
Re:Show HN: Real Time Black Friday Dashboard – using Perl, P... by vinothgopi on Saturday November 28, 2015 @02:41AM (#10640382)
Geckoboard part was relatively easy - they have a nice interface to design beautiful looking dashboards.

Main magic was in the data pipeline. We tagged products that are Black Friday specific as seen on the merchant specific "Black Friday" category pages and other aggregators. These sites' pages were checked and the products' prices updated more frequently than our regular pipeline.

Everything ran as part of the Semantics3 infrastructure but at the last step we piped the updated information of the Black Friday specific products to a separate Postgres DB as well and that allowed us to run fancy queries that could answer almost any kind of questions we have about the data.

Re:Show HN: Real Time Black Friday Dashboard – using Perl, P... by themckman on Saturday November 28, 2015 @03:13AM (#10640454)
I'm interested in knowing more about the Perl component. What can you say about that?
Re:Show HN: Real Time Black Friday Dashboard – using Perl, P... by vinothgopi on Saturday November 28, 2015 @03:29AM (#10640486)
Our entire data processing pipeline is actually written in perl (that is several 10s of thousands of lines of code). So is the subcomponent that actually pipes the data to Geckoboard.