News for hackers. Stuff that matters.
Re:AWS Data Exchange by buboard on Wednesday November 13, 2019 @06:01PM (#21530713)
Wow we were just talking about selling shovels in a (ML) gold rush.

Incidentally, what is the open source alternative of this? Data is so cheap that it should be actually free, unlike counterfeit nike shoes.

(Does a bittorrent tracker specifically for research data exist? Edit: there's http://academictorrents.com/)

Re:AWS Data Exchange by meritt on Wednesday November 13, 2019 @07:23PM (#21531395)
> What is the open source alternative of this?

There are many public-domain datasets:

* https://aws.amazon.com/opendata/public-datasets/

* https://cloud.google.com/public-datasets/

* https://github.com/awesomedata/awesome-public-datasets

> Data is so cheap that it should be actually free

I feel like you haven't had the opportunity to work with data that has value.

Re:AWS Data Exchange by buboard on Wednesday November 13, 2019 @07:57PM (#21531655)
if a dataset is really valuable, it wont be available for public consumption/copying, and, like nike, won't be selling itself on amazon
Re:AWS Data Exchange by thedudeabides5 on Wednesday November 13, 2019 @09:22PM (#21532226)
Sometimes it's not that the data itself doesn't have value, it's that to get the value out of that data requires a lot of blood, toil and treasure in human capital to extract.

That's how data companies make money, by doing that work for you.

Re:AWS Data Exchange by meritt on Wednesday November 13, 2019 @08:08PM (#21531739)
> if a dataset is really valuable, it wont be available for public consumption

Data vendors sell valuable data all the time to essentially anyone who is willing to pay their asking price. I don't see how this is any different? Just because aws is trying to run a marketplace doesn't suddenly make the data "public" in an open/free sense, there's still a price tag attached to it.

> and, like nike, won't be selling itself on amazon

Not every data vendor (or retailer since you keep bringing up Nike) has the necessary brand recognition, marketing budget, or technical proficiency to only sell direct to customers: that's why centralized marketplaces and alternate distribution channels exist.

Re:AWS Data Exchange by buboard on Thursday November 14, 2019 @07:20PM (#21541076)
> valuable data all the time to essentially anyone

if it s truly valuabe it isn't sold to 'essentially anyone'. like high value financial info or security.

Re:AWS Data Exchange by Bubbadoo on Wednesday November 13, 2019 @11:17PM (#21532738)
Sorry, I don't agree. There have been a number of successful start-ups that monetized publically available data in their products. Real estate and finance come to mind, but there's a ton of data, you just have to grab it and make sense of it for someone who's will to pay for that service.
Re:AWS Data Exchange by fnord123 on Thursday November 14, 2019 @04:41AM (#21534151)
Thompson Reuters, Bloomberg, FTSE, LSE, NYSE, Nasdaq, etc all sell data that is very valuable.

I feel like you haven't had the opportunity to work with data that has value.

Re:AWS Data Exchange by buboard on Thursday November 14, 2019 @05:26AM (#21534327)
i doubt TR or bloomberg will be selling on amazon, considering what they do to other lines of business. unless they re foolish, of course
Re:AWS Data Exchange by say_it_as_it_is on Thursday November 14, 2019 @05:52AM (#21534434)
Bloomberg usually prevents customers from using their other services and platforms if the customers pay for data from a competing provider. The settlements from lawsuits that follow are only a fraction of what Bloomberg gains by compelling customers to use the Bloomberg suite, so they continue to conduct business this way.

It will be a very busy, but lucrative time for corporate law firms as they battle things out.

Re:AWS Data Exchange by tanilama on Wednesday November 13, 2019 @09:12PM (#21532145)
Emmmm. Wikipedia is pretty valuable yet it is free.
Re:AWS Data Exchange by buboard on Thursday November 14, 2019 @07:21PM (#21541082)
sorry, i meant valuable in the monetary sense. Wikipedia is very valuable but its market price is $0
Re:AWS Data Exchange by Tenoke on Thursday November 14, 2019 @05:15AM (#21534278)
Thinking that there are no useful freely available datasets is beyond naive.
Re:AWS Data Exchange by AznHisoka on Wednesday November 13, 2019 @07:28PM (#21531434)
Data by itself is cheap.

Data that has an useful business or predictive purpose that is clean and constantly updated is not cheap at all.

Re:AWS Data Exchange by buboard on Wednesday November 13, 2019 @07:31PM (#21531456)
why not sell them directly through an API instead of paying an amazon tax?
Re:AWS Data Exchange by Godel_unicode on Wednesday November 13, 2019 @08:05PM (#21531714)
Most people would host that API using AWS, and there you are.
Re:AWS Data Exchange by AznHisoka on Wednesday November 13, 2019 @08:07PM (#21531732)
Most people probably already are. The marketplace is just another distribution channel.
Re:AWS Data Exchange by AmericanChopper on Wednesday November 13, 2019 @07:18PM (#21531348)
> Data is so cheap that it should be actually free, unlike counterfeit nike shoes.

Getting data is not cheap, and maintaining a dataset is certainly not cheep either.

Re:AWS Data Exchange by nabdab on Saturday November 16, 2019 @09:05AM (#21552665)
> Data is so cheap that it should be actually free, unlike counterfeit nike shoes.

This really depends on the data. In pharma the right 50 bytes of data can be worth billions. Not all data is personal product preferences for add targeting.

Re:AWS Data Exchange by trystero on Thursday November 14, 2019 @10:07AM (#21535917)
DBnomics (https://db.nomics.world/) is an example of a free & open API to source large volumes of data, in this case economic data. It's also completely open source.
Re:AWS Data Exchange by tingletech on Thursday November 14, 2019 @01:15AM (#21533203)