Probably depends on your jurisdiction (US, EU, etc.). In general from a EU point of view, we crawl the data like any search engine (google, bing, etc.) and extract relevant data.