Re:C# Autocomplete Demo Using Bing Code Search Engine
by yohanatan on Wednesday November 05, 2014 @09:28PM
(#8565497)
I have a similar idea where the cores are put to work optimizing the produced binaries (profile-guided optimization, genetic algorithms, SAT solvers/theorem proving, etc). You could of course also do static analysis and all forms of testing (generative, property-based, unit, integration, performance, etc.).
Re:C# Autocomplete Demo Using Bing Code Search Engine
by ThisIBereave on Wednesday November 05, 2014 @03:24PM
(#8564058)
It should be noted that public github repos are _not_ public domain and not even necessarily open source unless the author specifies a license.
Re:C# Autocomplete Demo Using Bing Code Search Engine
by timr on Wednesday November 05, 2014 @03:53PM
(#8564178)
It's part of the GitHub terms of service:
"By setting your repositories to be viewed publicly, you agree to allow others to view and fork your repositories."
Re:C# Autocomplete Demo Using Bing Code Search Engine
by rtb on Wednesday November 05, 2014 @07:00PM
(#8565021)
Permission to "view and fork" is not the same as permission to copy and paste into a proprietary software product (i.e. this may not be legit for use by "enterprise" developers)
Re:C# Autocomplete Demo Using Bing Code Search Engine
by tdicola on Wednesday November 05, 2014 @02:03PM
(#8563562)
Interesting idea, would definitely make you increase the efficiency of your time at the editor if it costs you $50/hour! But you don't need 1000 cores to fire off a bunch of search requests. Network calls are generally IO bound so even one or two cores can handle lots of requests.
Re:C# Autocomplete Demo Using Bing Code Search Engine
by andrewstuart2 on Wednesday November 05, 2014 @04:29PM
(#8564373)
> all public github code
In RAM.
Re:C# Autocomplete Demo Using Bing Code Search Engine
by dbarlett on Wednesday November 05, 2014 @08:10PM
(#8565273)
Some napkin math - as of late 2013, GitHub's main Elasticsearch cluster had ~128 shards of ~120 GB [1]. Obviously they have more data now, and it's not clear whether the number of shards includes replicas, but at current EC2 on-demand prices[2]:
RAM: 63 r3.8xlarge @ $2.80/hr = $176.40/hr
SSD: 5 i2.4xlarge @ $3.41/hr = $ 17.05/hr
HDD: 1 hs1.8xlarge @ $4.60/hr = $ 4.60/hr
[1] http://www.elasticsearch.org/case-study/github/
Re:C# Autocomplete Demo Using Bing Code Search Engine
by X-Istence on Thursday November 06, 2014 @12:47AM
(#8565945)
We don't even need to keep ALL of it in memory, we would just need to keep everything for the current language we are developing in.
Maybe one or two others. Say I am working on a Angular/Pyramid application, all I would need is JavaScript and Python loaded.
1000 cores costs around $50/hr, so if it boosted my productivity measurably it'd be worth it. Searching all public github code for strings matching around my cursor seems like the sort of thing these 1000 cores should be doing.