Open Source Datasets

Re:Open Source Datasets by zitterbewegung on Thursday June 15, 2017 @08:17PM (#14565579)

I have been thinking about what this solves in respect to other datasets. Nearly all shape recognition datasets have a restriction that you can't use unless you are an academic. I feel like that Open Sourcing data sets will allow us to be more democratic with data and the things that are generated by them. Creative Commons seems like a good license for this though. Once you have the data is half the battle . The rest is to make open models (google is good at this) and then you could take pretrained models and not have your data leave your house . I hope and dream we can do this.

[ Parent | on HN ]

Re:Open Source Datasets by vog on Friday June 16, 2017 @08:00AM (#14568163)

> Creative Commons seems like a good license for this though

I don't think that CC licenses are a good fit for data collections in general. Let's see what other open data projects do:

Some open data projects were not satisfied with CC licenses, which is why ODbL was created:

https://opendatacommons.org/licenses/odbl/

Also, many open data projects choose to put their stuff into the public domain (or license it as "CC0" which means exactly the same). This is, for example, what Wikidata does:

https://www.wikidata.org/wiki/Wikidata:Main_Page

(Wikidata the structured sister project of Wikipedia.)

[ Parent | on HN ]

Re:Open Source Datasets by zitterbewegung on Friday June 16, 2017 @10:18AM (#14569184)

I agree that CC licenses aren't a good fit for data collections. I have been meaning to create a new license but I don't have the expertise or credibility to reasonably market it. ODbL seems really close to what I was envisioning. Thanks!

[ Parent | on HN ]

Re:Open Source Datasets by nerdponx on Friday June 16, 2017 @10:54AM (#14569537)

Nearly all shape recognition datasets have a restriction that you can't use unless you are an academic. I feel like that Open Sourcing data sets will allow us to be more democratic with data

Just because something is open source doesn't mean it can't have an academia-only restriction. Data sets should cost money in for-profit uses, open or not.

[ Parent | on HN ]

Re:Open Source Datasets by tuukkah on Friday June 16, 2017 @01:11PM (#14570724)

“Open data and content can be freely used, modified, and shared by anyone for any purpose” http://opendefinition.org/

"The license must not restrict anyone from making use of the program in a specific field of endeavor. For example, it may not restrict the program from being used in a business, or from being used for genetic research." https://opensource.org/osd

[ Parent | on HN ]

Re:Open Source Datasets by nerdponx on Saturday June 17, 2017 @08:32AM (#14575616)

Interesting. So is a nominally open-source program like RStudio not actually open-source because enterprise uses need a license?

[ Parent | on HN ]

Re:Open Source Datasets by SloopJon on Sunday June 18, 2017 @10:50AM (#14580874)

It looks like RStudio is AGPL v3, which is a free and open source license. Enterprise users only need a different license if they don't want to abide by the AGPL's strong copyleft requirements.

[ Parent | on HN ]

Re:Open Source Datasets by zitterbewegung on Friday June 16, 2017 @11:33AM (#14569858)

I agree that people who use a dataset for profit should be required for a for profit use. I didn't mean to imply that academics should give their data away for free. Maybe there needs to be a way for academics to sell their data or any other tangible benefit.

[ Parent | on HN ]

Re:Open Source Datasets by TeMPOraL on Friday June 16, 2017 @11:14AM (#14569693)

Academia doesn't cover all non-profit uses though. What about hobbyists?

[ Parent | on HN ]

Re:Open Source Datasets by tuukkah on Friday June 16, 2017 @01:03PM (#14570636)

Open data is a concept separate from free and open source software. However, they have similar concerns such as copyleft: GPL for source code and ODbL for data both require changes to be published.

Outside of copyleft, Creative Commons 4.0 licenses (CC-BY 4.0, CC-BY-SA 4.0, CC0) from 2013 are good licenses for open data: https://theodi.org/blog/cc-40-and-open-data

[ Parent | on HN ]