News for hackers. Stuff that matters.
Re:Changes to Code Search Indexing by mrcarruthers on Thursday December 17, 2020 @01:48PM (#25458820)
AKA the indexes are too large and we don't want to spend the money
Re:Changes to Code Search Indexing by sdesol on Thursday December 17, 2020 @02:09PM (#25459076)
I'm sure money played some part, but the fact is, unless you have researched code search, it's quite a difficult problem to solve. The biggest problem is, it's very difficult to define relevancy, since code search is EXTREMELY context driven. And I'm guessing purging inactive repositories, addresses most of the noise issues they have.

However, I'm kind of surprised by a blanket purge like this, as I figured they would take repo stars and other signals into consideration to decide what to purge.

Re:Changes to Code Search Indexing by _flux on Thursday December 17, 2020 @03:12PM (#25459791)
If it wasn't about money, surely they could have a second index for old code? And then asynchronously query both, filling the fast results in first.

Or maybe have a keyword for searching old code, or search if current results seem bad, etc.

Re:Changes to Code Search Indexing by alkonaut on Thursday December 17, 2020 @02:04PM (#25459017)
This is something I’d pay for. I don’t need any other GitHub services, but this I’d pay for.

Would it be possible to index externally?

Re:Changes to Code Search Indexing by chinhodado on Thursday December 17, 2020 @01:52PM (#25458869)
I doubt that's the reason, given Microsoft's resources.
Re:Changes to Code Search Indexing by MikeKusold on Thursday December 17, 2020 @02:02PM (#25458983)
A hypothetical conversation:

Eng: "Our elasticsearch database has been growing exponentially for years, and in order to keep search alive we need to completely rearchitect it. We estimate it will take a team of 8 people, 1 year to launch a stable alternative."

Product: "What if we just reduce the size of the index by removing inactive repositories? This will allow the team to focus on revenue generating features."

Eng: "Yeah, that should keep our current solution running for the foreseeable future without significant impact to our customers."