News for hackers. Stuff that matters.
Re:How-to: create a real-time search app with IndexTank and ... by barmstrong on Wednesday December 22, 2010 @02:05PM (#2032111)
I played with IndexTank a bit this past weekend, and it seems like they are really hurting from lack of a good gem that fits into Active Record. When compared to something like ThinkingSphinx or a project like that it feels very un rails-ish.

I noticed this project has cropped up to try and solve it, which is awesome: https://github.com/flaptor/thinkingtank however it's not Rails 3 compatible right now.

If I were IndexTank, getting a gem like that up to speed would be my top priority I think to get real traction on Heroku or amongst rails folks.

Re:How-to: create a real-time search app with IndexTank and ... by diego on Wednesday December 22, 2010 @02:08PM (#2032118)
We also noticed that someone put out this gem:

https://rubygems.org/gems/tanker

Re:How-to: create a real-time search app with IndexTank and ... by gregwebs on Wednesday December 22, 2010 @02:08PM (#2032116)
Why would one want to use IndexTank instead of Sphinx Search?
Re:How-to: create a real-time search app with IndexTank and ... by jhandl on Wednesday December 22, 2010 @02:38PM (#2032208)
IndexTank is a hosted service, you don't have to build, configure or manage your own search infrastructure.
Re:How-to: create a real-time search app with IndexTank and ... by samd on Wednesday December 22, 2010 @01:12PM (#2031954)
When I first saw the contest I was only thinking about indexing all the existing data from some website, but clearly it's better to just start indexing the new data, and get a website up and running. Later I could write another program that fetches and indexes the old data in the background. Thanks for writing this, it gave me some new ideas.
Re:How-to: create a real-time search app with IndexTank and ... by Blankwood on Wednesday December 22, 2010 @01:38PM (#2032030)
I see I can get a free 1million size account for the contest at heroku. How big is that for this type of application, like you show in the tutorial?
Re:How-to: create a real-time search app with IndexTank and ... by diego on Wednesday December 22, 2010 @01:42PM (#2032046)
My app is using 25k docs. What I described in the article is very basic, the app that you can try at http://plixitank.heroku.com keeps a window of the 25k most recent items from Plixi and erases older stuff. That's enough for several hours' worth of search history.
Re:How-to: create a real-time search app with IndexTank and ... by Blankwood on Wednesday December 22, 2010 @01:46PM (#2032059)
Just saw that you also built trendistic. How big is that index? Am trying to get a feel for the size of index to make a compelling contest entry.
Re:How-to: create a real-time search app with IndexTank and ... by santip on Wednesday December 22, 2010 @02:03PM (#2032105)
Trendistic is a special-purpose app with several millions of documents. However, the contest accounts are limited to 1M documents so don't worry much about the size. You could try an interesting approach at indexing tweets and should be more than fine choosing up to 1M tweets with some criteria, be it recentness, popularity of the author or something else. You can contact us directly if you have other specific questions, support [at] indextank or through the chat box on our site.
Re:How-to: create a real-time search app with IndexTank and ... by diego on Wednesday December 22, 2010 @12:51PM (#2031888)
This is because many people asked us for ideas for the contest. It's a sample app built from the ground up.
Re:How-to: create a real-time search app with IndexTank and ... by eidorianu on Wednesday December 22, 2010 @12:56PM (#2031905)
diego, what was the language used to implement that search engine back in 98'?
Re:How-to: create a real-time search app with IndexTank and ... by diego on Wednesday December 22, 2010 @01:01PM (#2031923)
C, I probably still have that source code around. It was very rudimentary: an inverted index with no relevance, only AND queries (intersection of word vectors). I had the index mmap'ed because it was pretty small.