Wikipedia provides a query api for accessing pages and links within pages: http://meta.wikimedia.org/wiki/Query Its very useful and I think people should use it if they want to scrape Wikipedia. At least it gives the Wikipedia guys a chance to throttle bandwidth if they need to.