News for hackers. Stuff that matters.

geoprofi

Re:p-Hacking and False Discovery in A/B Testing on Tuesday July 24, 2018 @04:18AM (#17599054)
My very recent meta-analysis of 115 A/B tests reveals that a large proportion are highly suspect for p-hacking: http://blog.analytics-toolkit.com/2018/analysis-of-115-a-b-t...

Going the Bayesian way, as suggested in some comments, is no solution at all, as I am not aware of an accepted Bayesian approach to dealing with the issue:

http://blog.analytics-toolkit.com/2017/bayesian-ab-testing-n...

(feel free to run sims, if you do not trust the logic ;-)) as well as on a more general level:

http://blog.analytics-toolkit.com/2017/5-reasons-bayesian-ab...

Re:Ask HN: Abusive-seeming legal threat from Semalt on Wednesday June 27, 2018 @01:40AM (#17406012)
Same here, we have one of the most authoritative blog posts on the topic of referral spam and it, of course, mentions semalt who were one of the first to use this tactic of "promotion" of their service:

http://blog.analytics-toolkit.com/2015/guide-referrer-spam-g...

We got the same letters, sent to our ISP, instead of us, and we are a legal entity, easy to identify and contact in multiple ways. Legalese is shit, of course, we will stand our ground for sure. Unfortunately, due to procedures by our ISP we might need to temporarily remove a part of the content until the issue is resolved.