News for hackers. Stuff that matters.
Re:Search Goes Real-Time With Scoopler (YC S08) by pclark on Friday May 08, 2009 @10:28AM (#599666)
Cool. But until there are a lot of real time services their value is very limited.
Re:Search Goes Real-Time With Scoopler (YC S08) by dilanj on Friday May 08, 2009 @11:07AM (#599722)
Going by the current trend, there will only be more real time services in the future. It pays to be early in the game :)
Re:Search Goes Real-Time With Scoopler (YC S08) by axod on Friday May 08, 2009 @11:50AM (#599784)
Yeah. Soon I can imagine a time when we could talk to each other online in real time. Like twitter but without a delay. But maybe that's a couple of years off.
Re:Search Goes Real-Time With Scoopler (YC S08) by pclark on Friday May 08, 2009 @12:30PM (#599843)
have you seen mibbit.com?
Re:Search Goes Real-Time With Scoopler (YC S08) by sachinag on Friday May 08, 2009 @12:35PM (#599857)
Or some sort of instantaneous messaging or how about a telephonic device that transmits voice over copper lines (or even wirelessly) or perhaps meeting someone for a malted beverage at a public house of some sort.
Re:Search Goes Real-Time With Scoopler (YC S08) by axod on Friday May 08, 2009 @01:10PM (#599919)
>> "how about a telephonic device that transmits voice over copper lines"

In real time? You're crazy.

Re:Search Goes Real-Time With Scoopler (YC S08) by jimbokun on Friday May 08, 2009 @03:54PM (#600153)
This is a fun game to play, actually, any time a new technology is introduced.

Imagine the new technology was invented first, and the old technology is actually the new challenger. What are the advantages and benefits of the old technology you can promote over the new one?

Re:Search Goes Real-Time With Scoopler (YC S08) by jsrn on Saturday May 09, 2009 @12:28PM (#601077)
this is a tradition in the Emacs community: for each release, they publish "antinews", e.g.:

    > For those users who live backwards in time,
    > here is information about downgrading to 
    > Emacs version 21.4. We hope you will enjoy
    > the greater simplicity that results from the
    > absence of many Emacs 22.1 features.
    > [...]
http://www.gnu.org/software/emacs/manual/html_node/emacs/Ant...
Re:Search Goes Real-Time With Scoopler (YC S08) by paul9290 on Friday May 08, 2009 @04:02PM (#600167)
Does mibbit or chatterous or an Instant message client allow for search of conversations? If not I think all chat clients should make an API to search data, especially links shared in email & chat clients!
Re:Search Goes Real-Time With Scoopler (YC S08) by arasakik on Friday May 08, 2009 @07:50PM (#600490)
Members of Chatterous groups can search through chat history.
Re:Search Goes Real-Time With Scoopler (YC S08) by vaksel on Friday May 08, 2009 @11:32AM (#599752)
isn't Google pretty close to real time anyways? I know I tend to find things on Google that I just posted 5-6 minutes ago.
Re:Search Goes Real-Time With Scoopler (YC S08) by ajasver on Friday May 08, 2009 @12:12PM (#599813)
Yes Google is pretty fast for newly published static content. However, it's difficult to use for events happening right now. From the feedback we've got, people like real-time results because its engaging and effortless, a little like watching TV.
Re:Search Goes Real-Time With Scoopler (YC S08) by hamai on Friday May 08, 2009 @01:18PM (#599929)
"One element that’s really nice, is the Peek feature, which allows you to take a look at pages being linked to in an overlay on top of the results, so you don’t have to visit the actual page."

Real-Time news for the writer: you actually visit the page. It's an iframe...

In the old days, there was something called target attribute. Neat when the target is not iframe friendly.

Re:Search Goes Real-Time With Scoopler (YC S08) by snprbob86 on Friday May 08, 2009 @01:25PM (#599943)
This feature is really curious to me... why would I want to peek when I have a back button on my mouse?
Re:Search Goes Real-Time With Scoopler (YC S08) by ikayak on Friday May 08, 2009 @10:56AM (#599707)
Good execution on the trending and the real power here is the deep search on live content. Anybody who does search right has value.
Re:Search Goes Real-Time With Scoopler (YC S08) by ajasver on Friday May 08, 2009 @11:33AM (#599754)
Thanks! We're working on adding more data sources to provide broader results.
Re:Search Goes Real-Time With Scoopler (YC S08) by anuraggoel on Friday May 08, 2009 @12:32PM (#599849)
What is Scoopler built with?
Re:Search Goes Real-Time With Scoopler (YC S08) by ajasver on Friday May 08, 2009 @12:57PM (#599898)
Scoopler is written in Python. We use Cloudant (YC s08) for storing our data. I'm planning to write a blog post about this on soon on our Posterous.
Re:Search Goes Real-Time With Scoopler (YC S08) by kyro on Friday May 08, 2009 @02:43PM (#600059)
Cool. I'll take a note of that using Snipd, upload it to Scribd, then post it to Reddit, then tell my friends to upvote me using Heysan or maybe Chatterous. It depends on whether I'll have enough time, since I'm always playing on DraftMix.

Anyway, good luck with Scoopler. :P

Re:Search Goes Real-Time With Scoopler (YC S08) by quilby on Friday May 08, 2009 @03:50PM (#600147)
If you are having problems with time management why not try RescueTime? ;)
Re:Search Goes Real-Time With Scoopler (YC S08) by ajasver on Friday May 08, 2009 @02:53PM (#600074)
Tu Chez!
Re:Search Goes Real-Time With Scoopler (YC S08) by bdr on Friday May 08, 2009 @08:09PM (#600507)
Re:Search Goes Real-Time With Scoopler (YC S08) by okeumeni on Friday May 08, 2009 @11:25AM (#599739)
I have one question, are they consuming other companies search API, let’s say Twitter or are they crawling and aggregate their own data? Either way it’s a great job!
Re:Search Goes Real-Time With Scoopler (YC S08) by ajasver on Friday May 08, 2009 @11:32AM (#599750)
We actually crawl and index all the data ourselves. That's how we identify the most popular content.
Re:Search Goes Real-Time With Scoopler (YC S08) by hachiya on Friday May 08, 2009 @12:44PM (#599874)
Is this truly crawling the sites, or querying each site's search service?

e.g. for Twitter, are you crawling all the Twitter users' URLs (seems difficult to do - how do you find new accounts' URLs?), or are you fetching results from search.twitter.com ?

Re:Search Goes Real-Time With Scoopler (YC S08) by ajasver on Friday May 08, 2009 @03:45PM (#600140)
We take the raw data streams (e.g. a data mining feed from Twitter) and process them, ourselves.
Re:Search Goes Real-Time With Scoopler (YC S08) by dannyr on Friday May 08, 2009 @03:01PM (#600080)
Yeah. I'm curious if they developed something similar to Twitter's search functionality or they are using Twitter's Trends feed.

In its current form, most of the results are from Twitter which doesn't really differentiate it much from Twitter Search.

Re:Search Goes Real-Time With Scoopler (YC S08) by zaidf on Friday May 08, 2009 @02:11PM (#600002)
I don't think crawling and querying are mutually exclusive ideas.
Re:Search Goes Real-Time With Scoopler (YC S08) by okeumeni on Friday May 08, 2009 @11:41AM (#599767)
Nice Work!
Re:Search Goes Real-Time With Scoopler (YC S08) by BenS on Friday May 08, 2009 @11:45AM (#599775)
This is really cool - congrats. I'd really like to see google-trend-like features but on much shorter time scales. Even a weekly-zeitgeist tied to news stories instead of having to wait for the end of year.
Re:Search Goes Real-Time With Scoopler (YC S08) by ajasver on Friday May 08, 2009 @12:07PM (#599803)
For the most recent trends you can check out the hot topics. We also want to do news updates regularly - follow @scoopler and you'll get updates soon!
Re:Search Goes Real-Time With Scoopler (YC S08) by diego on Friday May 08, 2009 @01:42PM (#599960)
In case you haven't seen it, we do that for Twitter: http://twist.flaptor.com/
Re:Search Goes Real-Time With Scoopler (YC S08) by datums on Friday May 08, 2009 @12:39PM (#599863)
Nice start. I was expecting more from the twitter feed. It's an rss feed from a query. Maybe a better way is to group similar real-time results ? v2
Re:Search Goes Real-Time With Scoopler (YC S08) by edawerd on Friday May 08, 2009 @12:47PM (#599880)
awesome job dude! It would be awesome to have some sort of real-time alert feature, too!
Re:Search Goes Real-Time With Scoopler (YC S08) by ajasver on Friday May 08, 2009 @12:58PM (#599905)
It's in the pipeline! Thanks.