News for hackers. Stuff that matters.
Re:What is full-text search (and why you need it now) by elblanco on Wednesday December 08, 2010 @11:54AM (#1983589)
> Even more interesting than a simple full-text search would be a regular-expression full-text search of the internet

It would seem to me that indexing data in such a way as to support arbitrary regex would be difficult. Anybody know of an existing system?

Re:What is full-text search (and why you need it now) by alecthomas on Wednesday December 08, 2010 @12:24PM (#1983721)
Yes, Google code search: http://codesearch.google.com
Re:What is full-text search (and why you need it now) by sgk284 on Wednesday December 08, 2010 @02:36PM (#1984284)
It's my understanding that the amount of code is so small that they just have it all in ram (and maybe less accessed data goes to disk) and do a distributed grep.
Re:What is full-text search (and why you need it now) by elblanco on Wednesday December 08, 2010 @05:19PM (#1984882)
Right, that's more or less what all the approaches I've seen use. It's not indexing in the sense of full-text indexing for fast retrieval, all of the data is more or less greped over. It's basically just a full-text search, not an index.