News for hackers. Stuff that matters.
Re:Big List of Naughty Strings by sbr464 on Friday November 16, 2018 @06:00AM (#18467930)
Tangentially related to the original project intent;

Is there a place where common things in the dev world like this are accumulated? For example, a list of all countries or list of the US states, for use with an HTML dropdown. I know there are various repos on Github that maintain these types of lists, such as English stop words, profanity word lists etc, but is there a service that accumulates these in a familiar, structured api?

Re:Big List of Naughty Strings by majewsky on Friday November 16, 2018 @06:32AM (#18468039)
Look at Wikipedia's lists of things. For your particular examples:

https://en.wikipedia.org/wiki/List_of_sovereign_states

https://en.wikipedia.org/wiki/U.S._state

Some of them are quite meta, such as https://en.wikipedia.org/wiki/List_of_lists_of_lists

For a more structured source, Wikidata aims to be that, but I cannot comment on its completeness.

Re:Big List of Naughty Strings by JacobDotVI on Friday November 16, 2018 @07:56AM (#18468385)
Often times instead of the list of US Sates, you actually want to list of US States and Territories:

https://en.wikipedia.org/wiki/List_of_states_and_territories...

For example when the intent is "list of place where the USPS ships" or "list of state-level political jurisdictions where US residents live"

Re:Big List of Naughty Strings by sbr464 on Friday November 16, 2018 @08:31AM (#18468568)
Let’s move this tidbit to a structered api of common knowledge! Dewey decimal for data, not just a generic search engine for datasets in different formats (like the recent google datasets site), but a familiar, goto resource.
Re:Big List of Naughty Strings by Piskvorrr on Friday November 16, 2018 @12:05PM (#18469987)
Re:Big List of Naughty Strings by bpchaps on Friday November 16, 2018 @08:50PM (#18473427)
Have you ever used wikidata? It's kind of a shitshow.
Re:Big List of Naughty Strings by eli on Friday November 16, 2018 @11:39AM (#18469798)
Yes! Surprisingly often I am unable to complete a form because there is no option in the State field for Washington, DC.
Re:Big List of Naughty Strings by sbr464 on Friday November 16, 2018 @06:35AM (#18468055)
Structured, maintained API though, not general knowledge. I personally see an issue that someone has to accumulate their own stash of structured data for common knowledge (random examples) like: countries, zip codes, valid HTML5 element names, css properties, hex colors, common naming prefix/suffixes/professional titles, etc. A growing list of work repeated by each dev team/company for really no reason. No complaint about this repo, at all, just seeking if a solution exists.
Re:Big List of Naughty Strings by thinkalone on Friday November 16, 2018 @07:27AM (#18468265)
Re:Big List of Naughty Strings by sedatk on Friday November 16, 2018 @07:42AM (#18468318)
> Corpora is a collection of small files. It is not meant to be an exhaustive source of anything: a list of resources should contain somewhere in the vicinity of 1000 items.
Re:Big List of Naughty Strings by sbr464 on Friday November 16, 2018 @07:36AM (#18468296)
Thanks, will check it out.
Re:Big List of Naughty Strings by darkerside on Friday November 16, 2018 @07:02AM (#18468164)
Here's a platform specific example. https://github.com/SmileyChris/django-countries/
Re:Big List of Naughty Strings by bennofs on Friday November 16, 2018 @07:54AM (#18468370)
Wikidata has a SPARQL API though
Re:Big List of Naughty Strings by bluntfang on Friday November 16, 2018 @07:19AM (#18468227)
I've used faker [0] for stuff like this. I think originally a perl package, has similar packages in other languages as well. I've used the python implementation and enjoy it, along with it's localization feature.

It looks like 1.0 was just released as well :D

[0] https://github.com/joke2k/faker/releases

Re:Big List of Naughty Strings by davinic on Friday November 16, 2018 @12:11PM (#18470035)
SecLists (https://github.com/danielmiessler/SecLists) contains a wealth of security-related lists of this sort, including a useful section containing the most common passwords.
Re:Big List of Naughty Strings by CSMastermind on Friday November 16, 2018 @07:05AM (#18468178)
That's a cool idea. I've seen individual packages for things like US states and HTTP status codes but I don't think I've ever seen them all packaged together.
Re:Big List of Naughty Strings by wastedhours on Friday November 16, 2018 @11:40AM (#18469807)
Would it essentially be like a graph with multiple nested nodes with different strands of info?