Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Quora Blocks Startup Search Engines.
1. Honoring robots.txt is optional, so this doesn't actually offer any form of asset protection.
2. They are losing serious amounts of exposure that they would reap if they'd lift this restriction so that smaller engines can find them.
There are no comments on this comment yet.
1. Honoring robots.txt is optional, so this doesn't actually offer any form of asset protection.
2. They are losing serious amounts of exposure that they would reap if they'd lift this restriction so that smaller engines can find them.