Re:Hyperscan: High-performance multiple regex matching libra...
by clarkbw on Tuesday December 24, 2019 @03:57PM
(#21874864)
We use this at GitHub to power the commit token scanning. It is very fast and handles multiple regexes at once. We are looking for secrets from multiple providers. Couldn’t find a better option for this type of usage.
[ Parent
| on HN ]
Re:Hyperscan: High-performance multiple regex matching libra...
by klaas- on Wednesday December 25, 2019 @04:20AM
(#21877721)
Can you run this as a pre-receive hook to actually prevent a public commit if it has suspicious patterns in it?
Re:Hyperscan: High-performance multiple regex matching libra...
by pr0tocol_7 on Wednesday December 25, 2019 @09:32AM
(#21878614)
You can use gitleaks to do this now. I added that feature in v3: https://github.com/zricethezav/gitleaks/releases/tag/v3.0.0
Re:Hyperscan: High-performance multiple regex matching libra...
by jakeogh on Tuesday December 24, 2019 @04:08PM
(#21874918)
Can you elaborate? What providers?
Re:Hyperscan: High-performance multiple regex matching libra...
by walls on Tuesday December 24, 2019 @04:18PM
(#21874979)
For example, if someone commits AWS keys to a GitHub repo, GitHub will alert AWS, AWS will revoke your keys and freeze the account until they're satisfied nothing is compromised.
> https://github.blog/2018-10-17-behind-the-scenes-of-github-t...
Re:Hyperscan: High-performance multiple regex matching libra...
by unixhero on Wednesday December 25, 2019 @04:08AM
(#21877688)
What??? Even in a private repo?
Re:Hyperscan: High-performance multiple regex matching libra...
by esnard on Wednesday December 25, 2019 @04:35AM
(#21877771)
From the article:
> Since April, we’ve worked with cloud service providers in private beta to scan all changes to public repositories and public Gists for credentials (GitHub doesn’t scan private code).
Private repos are not scanned.
Re:Hyperscan: High-performance multiple regex matching libra...
by clarkbw on Monday January 06, 2020 @05:46PM
(#21974347)
Private repos aren't scanned and if we did offer the service to scan private repos we would only ever contact the repo owners and not the service providers. In the case of public repos we're in a race against time where bad actors are scraping the site and have automation created to use your tokens within seconds of a leak. Private repos scenarios are much simpler to deal with.
Re:Hyperscan: High-performance multiple regex matching libra...
by jakeogh on Wednesday December 25, 2019 @04:34AM
(#21877769)
the blog says public repos... but good question. Is it only some people that can subscribe to high entropy strings?
Github: I didnt opt-into 2FA: #439658 (3rd party auth required without 2FA)