News for hackers. Stuff that matters.

A comment on Gmail and Drive - a new way to send files. Parent comment

Re:Gmail and Drive - a new way to send files by uptown on Tuesday November 27, 2012 @10:06PM (#4840802)
Getting a headless browser up and running really isn't that huge of a hurdle if you're capable enough to build a search engine whose intent is to be competitive with Google.
[ Parent | on HN ]
Re:Gmail and Drive - a new way to send files by threedaymonk on Wednesday November 28, 2012 @09:04AM (#4842539)
It's not technically hard, no. However, there's an overhead in running a headless browser, of memory, CPU, time, and bandwidth, so it might cost substantially more.

You don't need a browser for everything, but working out which pages need a headless browser and which you can get away with scraping sounds like an interesting problem.

[ Parent | on HN ]