News for hackers. Stuff that matters.
Re:DuckDuckGo Architecture - 1 Million Deep Searches a Day a... by afsina on Monday January 28, 2013 @01:57PM (#5129994)
Custom Perl solution O_o. Ok seriously, no matter what, DuckDuckGo is still just a front end of some search engines.
Re:DuckDuckGo Architecture - 1 Million Deep Searches a Day a... by JoachimSchipper on Monday January 28, 2013 @02:14PM (#5130092)
Don't be so nasty.
Re:DuckDuckGo Architecture - 1 Million Deep Searches a Day a... by afsina on Monday January 28, 2013 @02:23PM (#5130138)
Ok I was harsh, but I wonder if what I said was wrong. I do not understand the over protective behavior over DuckDuckGo news and brand in HN.
Re:DuckDuckGo Architecture - 1 Million Deep Searches a Day a... by irahul on Monday January 28, 2013 @05:22PM (#5131084)
It's not about being protective over DDG. You are being an asshole again and again in this thread.

By your admission, you don't have any experience with search engines, and yet you have definitive opinion about everything related to it.

Re:DuckDuckGo Architecture - 1 Million Deep Searches a Day a... by afsina on Tuesday January 29, 2013 @08:12AM (#5133751)
DuckduckGo is not a search engine. You dont need to be an expert to see that fact.
Re:DuckDuckGo Architecture - 1 Million Deep Searches a Day a... by davidpayne11 on Tuesday January 29, 2013 @02:32AM (#5132830)
1) He never called you an asshole. He just posted his views about DDG.

2) If you are offended by what he said, it doesn't give you the right to call him an asshole.

For example, I know many people whose projects you didn't complete on time and who think you are a rotten dick for rightly being one. But I didn't call you a rotten dick, did I?

And also, stop defending DDG like a pussy that's everywhere, dude.

Re:DuckDuckGo Architecture - 1 Million Deep Searches a Day a... by irahul on Tuesday January 29, 2013 @04:58AM (#5133169)
I thought about responding, but then "wrestling, pigs" etc.
Re:DuckDuckGo Architecture - 1 Million Deep Searches a Day a... by afsina on Tuesday January 29, 2013 @08:18AM (#5133784)
I see only one pig here
Re:DuckDuckGo Architecture - 1 Million Deep Searches a Day a... by berntb on Tuesday January 29, 2013 @08:40AM (#5133859)
>> I see only one pig here

... and I see accounts (with davidpayne11) with just enough comments/karma to be useful for trolling -- and insults from them.

Please get a life or at least take this pathetic shit to some other place than HN. :-(

Re:DuckDuckGo Architecture - 1 Million Deep Searches a Day a... by davidpayne11 on Tuesday January 29, 2013 @05:23AM (#5133231)
Yep, not many people respond to insults. But you actually gave an explanation as to why you didn't, to make yourself sound cooler. Bravo 'chuthiya' (you were the one who taught me this)

Andddd, next time, before you waste time insulting people on an international forum, try to use it constructively to atleast complete projects of people whose money you've taken promising them to complete it and you actually didn't. Makes more sense than replying to my comments, right?

Re:DuckDuckGo Architecture - 1 Million Deep Searches a Day a... by pestaa on Monday January 28, 2013 @02:46PM (#5130239)
HN is helping Davids against Goliaths and I consider it a very good thing.
Re:DuckDuckGo Architecture - 1 Million Deep Searches a Day a... by badgar on Monday January 28, 2013 @08:20PM (#5131818)
What happened to merit?
Re:DuckDuckGo Architecture - 1 Million Deep Searches a Day a... by ghshephard on Monday January 28, 2013 @02:33PM (#5130180)
Could you share your search engine development experience?
Re:DuckDuckGo Architecture - 1 Million Deep Searches a Day a... by afsina on Monday January 28, 2013 @02:59PM (#5130315)
Sadly, I do not have that experience. I know what everybody knows. I guess it is extremely hard. Software-Infrastructure wise it is possibly one of the most challenging product. Competition is stiff, so going global is almost not a choice. You either go vertical, or local-national. Yes you can use available open source software (Nutch, Hadoop, Solr etc) but they can make you go up to a point. If you want to go real big, then you may need to write your own crawlers, indexing - ranking, clustering, duplicate-spam detection algorithms, distributed file systems, ad systems etc. Making a search engine of course is not enough, you need to add a gazillion service to make it attractive. Many of those services are also requires cutting edge technology (translation etc.). And it burns money 7/24.

I understand why people values DuckDuckGo for privacy reasons. I respect that. But sure devleoping it, is far far easier than developing a real search engine.

Re:DuckDuckGo Architecture - 1 Million Deep Searches a Day a... by greglindahl on Monday January 28, 2013 @03:07PM (#5130361)
If you're interested in what it takes to write a search engine with its own multi-billion-webpage crawl/index, check out the blog series starting with http://highscalability.com/blog/2012/4/25/the-anatomy-of-sea...
Re:DuckDuckGo Architecture - 1 Million Deep Searches a Day a... by gummydude on Monday January 28, 2013 @07:31PM (#5131644)
And when they said they're moving towards knowledge graph like instant results, latency not gonna be pretty, lots of small fetchings after general queries from core search servers.