Does it integrate with web master tools and google analytics?
Does it help identify page populations that are stable and similar enough to be compared?
How are the different test versions sent to you guys?
Can we use our own CDN on top of your CDN?
What about dynamic pages that change over time?
How big of a sample size is needed to get statistically significant results?
> Does it integrate with web master tools and google analytics?
Yep!
> Does it help identify page populations that are stable and similar enough to be compared?
Yep!
> How are the different test versions sent to you guys?
For the most part, we own the design of treatments. Some of our customers have their own experiments, but that's a small minority of our customers. Happy to talk more in depth about this if you're interested! [email protected]
> Can we use our own CDN on top of your CDN?
Yes, we encourage this too!
> What about dynamic pages that change over time?
We address this on a case-by-case basis, but our software is designed to be as un-invasive as possible in use cases that we do not expect.
> How big of a sample size is needed to get statistically significant results?
We have to consider several variables here. Sample size is a function of Google's crawl rate on your site, the number of pages you have, and the amount of traffic you receive.
It really would have been helpful if you'd just shared it here so others could see as well!
We've built a CDN that enables our software to provide tactical SEO execution and run A/B testing experiments for SEO across millions of pages. Experiments typically take 14-21 days for Google to index and react to changes, and we use Bayesian Structural Time Series and Negative Binomial Regression models to determine the statistical significance of our experiments.
Our software is 100% technical SEO, and doesn't do anything black-hat, spammy, or anything related to link-building. One of our goals is to bring transparency and shed light on what is largely considered a shady industry, but is so important to so many companies' revenue and growth. In fact, If SEO didn't have such a bad reputation, we think someone else would have built this a long time ago.
SEO as an industry earned itself a stigma for being spammy: between buying links, creating low-quality pages stuffed with keywords and text intended for Google rather than humans, and the used car salesmen attitude that many SEOs have, many people have been conditioned to dismiss SEO as an invalid or illegitimate growth channel.
We're software engineers-turned-SEO's, who have previously consulted for dozens of companies on SEO, from YC startups to Fortune 500 companies like Pfizer. We previously shared our case study with HN, where we increased search traffic to Coderwall with one A/B test: https://www.rankscience.com/coderwall-seo-split-test
Ask us anything! We'd love to answer any questions you have about SEO, A/B testing, and RankScience.