We are processing the data as we speak. However the movement of technology based on where your company is based is truly incredible.

Will update this in a few days with more data.

That will be an interesting correlation to see different frameworks or tech or even design elements based on geographical location.

If our company approves I would like to publish some general statistics that may be of interest to others.

How did you crawl so many sites, how did you discover them, search engine, ip ranges or another method?

The platform we used provided their own seedlist and took it from there.

How long did it take? What type of data did you record?

It took us about 13 days. We recorded reources of all types: text/, image/, application/*

As one would expect the vast majority of data recorded is text/* (html,...)