News for hackers. Stuff that matters.
Re:Lessons from building GitHub code search [video] by 100k on Thursday December 14, 2023 @12:29AM (#38638136)
Oh hey, that's my talk! Thanks for submitting it. It was a huge honor to present my team's work at Strange Loop.
Re:Lessons from building GitHub code search [video] by rmccue on Thursday December 14, 2023 @04:36AM (#38639513)
I’d just like to say: thank you!

GitHub’s previous search was not great, and when the new version launched it was a massive leap forward, where it’s now part of my daily workflow. Before this I thought good search at this scale might just be an intractable problem. :)

Re:Lessons from building GitHub code search [video] by mickael-kerjean on Thursday December 14, 2023 @06:17AM (#38640141)
Meh before Microsoft acquisition, you could get an API key for any service you want by just making a search on github, not sure how many people knew about it, it was probably a dirty secret but I used to crawl tons of stuff by just rotating API keys found from github, none of that is possible anymore.

On the plus side I don't count how many reports I've done to companies who did leak not only their username/password but also all the cool proxy you could use to go inside their network. The weirdest one of them was a guy working in security at thales which is supposed to handle security sensitive stuff for governments leaking all that information as he was working on a side project involving poker during business hours ...

Re:Lessons from building GitHub code search [video] by infecto on Thursday December 14, 2023 @07:33AM (#38640667)
This was novel 10 years ago. Maybe you were still doing it but hardly worth mentioning.
Re:Lessons from building GitHub code search [video] by costco on Thursday December 14, 2023 @09:33AM (#38641714)
This is definitely still possible. Saw a guy a year or two ago in a web scraping Discord who does this for fun and found all sorts of API keys. I think he found a 2captcha API key for an account with a 5 grand balance by spamming the search API endpoints. I hope he didn’t actually use any of that….

Pretty sure some people also made a fortune in crypto exchange API keys because I’ve seen threads where people advertise services to “cash out” Binance API keys for 5 cents in the dollar. I assume they use the balance in the account to inflate the price of some random coin that the attacker bought just before the attack. Yeah, that’s what this world is coming to.

Re:Lessons from building GitHub code search [video] by skilled on Thursday December 14, 2023 @02:34AM (#38638774)
Hi Luke,

Could you please give an update on whether or not GitHub is still considering adding “sort by recent” to search?

——

E: I just saw you answered that already. It’s a dearly missed feature.

Re:Lessons from building GitHub code search [video] by 100k on Thursday December 14, 2023 @02:37AM (#38638790)
Please see my other comment about why this is difficult: https://news.ycombinator.com/item?id=38638214
Re:Lessons from building GitHub code search [video] by xoranth on Thursday December 14, 2023 @02:02AM (#38638603)
Do you have any paper/talk that gives more details about the "geometric XOR filter"? If not, is there any plan to publish something?
Re:Lessons from building GitHub code search [video] by 100k on Thursday December 14, 2023 @02:30AM (#38638746)
Yes! My colleague who created it has started working on an open source version so we can publish it. I am not sure when it will be ready, but I'm excited because it is extremely interesting and has a lot of potential use cases.
Re:Lessons from building GitHub code search [video] by xoranth on Thursday December 14, 2023 @02:43AM (#38638834)
Amazing, thank you!

PS: where/what can I follow to know when it is published? Could you share your colleague github handle (I guess he'll have one :) )?

Re:Lessons from building GitHub code search [video] by 100k on Thursday December 14, 2023 @02:51AM (#38638880)
We'll definitely blog about it (https://github.blog/). His handle is https://github.com/aneubeck (it's on the thank you slide of my talk btw)
Re:Lessons from building GitHub code search [video] by xoranth on Thursday December 14, 2023 @02:59AM (#38638926)
Thank you!
Re:Lessons from building GitHub code search [video] by codetrotter on Thursday December 14, 2023 @02:44AM (#38638843)
> more details about the "geometric XOR filter"?

I know we don’t typically say this here but, you have a very relevant username for your question xoranth :D

Re:Lessons from building GitHub code search [video] by dc-programmer on Thursday December 14, 2023 @12:53PM (#38644515)
Does anyone know what geometric means in this context?
Re:Lessons from building GitHub code search [video] by 100k on Thursday December 14, 2023 @01:25PM (#38645027)
It refers to the geometric progression of bucket sizes used in the data structure.
Re:Lessons from building GitHub code search [video] by buraksarica on Thursday December 14, 2023 @01:45AM (#38638522)
Really great summary of a huge work! Thank you.
Re:Lessons from building GitHub code search [video] by a1o on Thursday December 14, 2023 @05:10AM (#38639706)
Hey, it would be nice to be able to browse in other branches besides main