News for hackers. Stuff that matters.
Re:Show HN: 5+ Billion Passwords in Order of Most Popular by bradleyjg on Sunday June 11, 2017 @05:06PM (#14533791)
Since the list is only rarely updated, this seems a perfect application Botelho's for minimal perfect hashing algorithm[1]. At about 8 bits per item storage and constant lookup it would be quite practical to use the top 32 Million list (appeared at least 10 times).

[1] http://cmph.sourceforge.net/papers/tr06.pdf

Re:Show HN: 5+ Billion Passwords in Order of Most Popular by berzerk0 on Sunday June 11, 2017 @05:20PM (#14533847)
Speaking of rarely updated - version two will come out mid-July at the latest.

I'm also going to attempt to attribute the sources to given countries or at least language families. The list as it stands has a heavily US-centric bias.

I plan to grep through it and pull out things like Cyrillic or Arabic characters, and then repeat the process using only those characters. That's not to say that everyone who uses Arabic or Cyrillic characters is guaranteed to use them, but it's more specific.

If "password" is #2 in the world, perhaps пароль (password) will be the #2 most popular password with Russian Cyrillic Characters

Re:Show HN: 5+ Billion Passwords in Order of Most Popular by lucasgonze on Sunday June 11, 2017 @05:42PM (#14533943)
I wonder about how to package your data as developer tools.

There should be libraries in any language used to develop systems which validate user-entered passwords.

Re:Show HN: 5+ Billion Passwords in Order of Most Popular by berzerk0 on Sunday June 11, 2017 @09:39PM (#14534769)
Dropbox has their zxcvbn method which incorporates a list of 30k of the most common passwords

https://github.com/dropbox/zxcvbn

Re:Show HN: 5+ Billion Passwords in Order of Most Popular by bradleyjg on Monday June 12, 2017 @11:15AM (#14537944)
It looks like they gzip the file over the wire and then work with it uncompressed. That's probably a reasonable choice given they use only 30,000 passwords.