News for hackers. Stuff that matters.
Re:Big List of Naughty Strings by minimaxir on Friday November 16, 2018 @02:58AM (#18467275)
Repo maintainer here.

...can someone explain how the repo keeps resurfacing? I haven’t promoted it in a long time. (Looking at the repo traffic, it recently spiked on the 6th, but nothing since then.)

Re:Big List of Naughty Strings by boyter on Friday November 16, 2018 @03:40AM (#18467422)
Since you are here. Thanks for making this. I recently used it to prove to a client that the api I delivered could take any content they cared to throw at it. They were especially impressed considering they were coming from a 35 year old system that only allowed ASCII.

The BLNS allowed me to prove it and I hooked it into our integration and fuzz tests which managed to shake out a few bugs.

Re:Big List of Naughty Strings by minimaxir on Friday November 16, 2018 @11:37AM (#18469792)
You're very welcome! :D
Re:Big List of Naughty Strings by awalton on Friday November 16, 2018 @05:24AM (#18467804)
It was brought up during VMware's internal security conference called "MooseCon" earlier today during a talk on Unicode.

No idea if it's just coincidental resonance though.

Re:Big List of Naughty Strings by minimaxir on Friday November 16, 2018 @10:49AM (#18469466)
Yes, a few people from VMWare made a PR (which I just merged).
Re:Big List of Naughty Strings by sbr464 on Friday November 16, 2018 @06:00AM (#18467930)
Tangentially related to the original project intent;

Is there a place where common things in the dev world like this are accumulated? For example, a list of all countries or list of the US states, for use with an HTML dropdown. I know there are various repos on Github that maintain these types of lists, such as English stop words, profanity word lists etc, but is there a service that accumulates these in a familiar, structured api?

Re:Big List of Naughty Strings by majewsky on Friday November 16, 2018 @06:32AM (#18468039)
Look at Wikipedia's lists of things. For your particular examples:

https://en.wikipedia.org/wiki/List_of_sovereign_states

https://en.wikipedia.org/wiki/U.S._state

Some of them are quite meta, such as https://en.wikipedia.org/wiki/List_of_lists_of_lists

For a more structured source, Wikidata aims to be that, but I cannot comment on its completeness.

Re:Big List of Naughty Strings by JacobDotVI on Friday November 16, 2018 @07:56AM (#18468385)
Often times instead of the list of US Sates, you actually want to list of US States and Territories:

https://en.wikipedia.org/wiki/List_of_states_and_territories...

For example when the intent is "list of place where the USPS ships" or "list of state-level political jurisdictions where US residents live"

Re:Big List of Naughty Strings by sbr464 on Friday November 16, 2018 @08:31AM (#18468568)
Let’s move this tidbit to a structered api of common knowledge! Dewey decimal for data, not just a generic search engine for datasets in different formats (like the recent google datasets site), but a familiar, goto resource.
Re:Big List of Naughty Strings by Piskvorrr on Friday November 16, 2018 @12:05PM (#18469987)
Re:Big List of Naughty Strings by bpchaps on Friday November 16, 2018 @08:50PM (#18473427)
Have you ever used wikidata? It's kind of a shitshow.
Re:Big List of Naughty Strings by eli on Friday November 16, 2018 @11:39AM (#18469798)
Yes! Surprisingly often I am unable to complete a form because there is no option in the State field for Washington, DC.
Re:Big List of Naughty Strings by sbr464 on Friday November 16, 2018 @06:35AM (#18468055)
Structured, maintained API though, not general knowledge. I personally see an issue that someone has to accumulate their own stash of structured data for common knowledge (random examples) like: countries, zip codes, valid HTML5 element names, css properties, hex colors, common naming prefix/suffixes/professional titles, etc. A growing list of work repeated by each dev team/company for really no reason. No complaint about this repo, at all, just seeking if a solution exists.
Re:Big List of Naughty Strings by thinkalone on Friday November 16, 2018 @07:27AM (#18468265)
Re:Big List of Naughty Strings by sedatk on Friday November 16, 2018 @07:42AM (#18468318)
> Corpora is a collection of small files. It is not meant to be an exhaustive source of anything: a list of resources should contain somewhere in the vicinity of 1000 items.
Re:Big List of Naughty Strings by sbr464 on Friday November 16, 2018 @07:36AM (#18468296)
Thanks, will check it out.
Re:Big List of Naughty Strings by darkerside on Friday November 16, 2018 @07:02AM (#18468164)
Here's a platform specific example. https://github.com/SmileyChris/django-countries/
Re:Big List of Naughty Strings by bennofs on Friday November 16, 2018 @07:54AM (#18468370)
Wikidata has a SPARQL API though
Re:Big List of Naughty Strings by bluntfang on Friday November 16, 2018 @07:19AM (#18468227)
I've used faker [0] for stuff like this. I think originally a perl package, has similar packages in other languages as well. I've used the python implementation and enjoy it, along with it's localization feature.

It looks like 1.0 was just released as well :D

[0] https://github.com/joke2k/faker/releases

Re:Big List of Naughty Strings by davinic on Friday November 16, 2018 @12:11PM (#18470035)
SecLists (https://github.com/danielmiessler/SecLists) contains a wealth of security-related lists of this sort, including a useful section containing the most common passwords.
Re:Big List of Naughty Strings by CSMastermind on Friday November 16, 2018 @07:05AM (#18468178)
That's a cool idea. I've seen individual packages for things like US states and HTTP status codes but I don't think I've ever seen them all packaged together.
Re:Big List of Naughty Strings by wastedhours on Friday November 16, 2018 @11:40AM (#18469807)
Would it essentially be like a graph with multiple nested nodes with different strands of info?
Re:Big List of Naughty Strings by ioulian on Friday November 16, 2018 @03:16AM (#18467342)
Somebody needed to find strings to test his/her app with, saw your repo, found it interesting and posted it here.

About the repo: nice job, I've used it a lot when testing sites/apps I did, good job on providing different formats too so it's easy to automate testing!

Re:Big List of Naughty Strings by systematical on Friday November 16, 2018 @07:55AM (#18468377)
I imagine because it's useful and has a fun name. So when someone stumbles across it, they post it. I've seen it on here a number of times and I still upvote it...because its useful and has a fun name.
Re:Big List of Naughty Strings by jacquesm on Friday November 16, 2018 @05:23AM (#18467799)
It's a pretty useful list. I do wonder how many people actually end up having to rebuild their databases after running a test!
Re:Big List of Naughty Strings by mmcclellan on Friday November 16, 2018 @12:31PM (#18470215)
It sounds like the VMWare comment is most likely, but I thought I would share how I learned of the project just yesterday. There was a HN post yesterday about https://sr.ht/ and in looking at that I noticed the project used a blacklist of usernames that I thought was cool, so when I took a look at that project it had a link to this repo.
Re:Big List of Naughty Strings by layog on Friday November 16, 2018 @12:20PM (#18470101)
The current spike might be due to a recent post [1] on programming subreddit

[1] https://www.reddit.com/r/programming/comments/9xla2j/naughty...

Re:Big List of Naughty Strings by minimaxir on Friday November 16, 2018 @12:49PM (#18470430)
That Reddit post was made after this HN submission hit the top.
Re:Big List of Naughty Strings by judah on Friday November 16, 2018 @09:30AM (#18468937)
Thanks for this list! And I appreciate that the RTL naughty string contains Hebrew for the first line of Genesis 1. :-)
Re:Big List of Naughty Strings by PhasmaFelis on Friday November 16, 2018 @08:50AM (#18468689)
I would guess because it's a useful tool that gets shared whenever people think about these issues. It's a nice reminder that not everything needs to be regularly updated or promoted to be useful. :)
Re:Big List of Naughty Strings by throwaway2048 on Friday November 16, 2018 @12:30PM (#18470203)
Its the kind of thing that sticks in your mind when you think of weird things going wrong with string input or unicode rendering.
Re:Big List of Naughty Strings by croo on Friday November 16, 2018 @04:06AM (#18467528)
Because you have created something great and novelty.

I stumbled on it for the first time and already saved it for future testing. Thanks :)

Re:Big List of Naughty Strings by andendau on Friday November 16, 2018 @10:03AM (#18469176)
It's a great testing resource. Way more concrete than 'well just test all the different strings'
Re:Big List of Naughty Strings by DonHopkins on Friday November 16, 2018 @08:40AM (#18468626)
Have you gotten any interesting or offensive pull requests?