News for hackers. Stuff that matters.
Re:The sad state of personal data and infrastructure by choward on Friday December 20, 2019 @12:58PM (#21846027)
I have thought about these issues a lot; especially lately. With regards to being able to scrape your data or just get your data back from 3rd party's, I think that's a losing battle. You need to be in control of your data before it gets to them. Web sites and APIs are constantly changing and sometimes just disappear. This idea of polling for changes seems very brittle and would never be up to date.

What I picture is an a program that you use to store your own microblogs, blogs, contacts, comments, etc. and then you publish to whoever from that app via their API or crawling.

Imagine you just created a new microblog entry. You can now either post to your Twitter, Mastodon, etc. accounts with the click of a button. You would have to poll for replies though and it would be up to you to store them if you wished (you probably want to if you are storing your replies). As an added benefit you could see the replies in one place instead of bouncing between two sites.

The point is, when you create the data, it's yours first. Then if you want to, you can post it other places. Tools like this are abundant for businesses, but we don't seem to build tools for actual people anymore.

Re:The sad state of personal data and infrastructure by jeena on Friday December 20, 2019 @01:50PM (#21846473)
Sounds like you're inventing POSSE https://indieweb.org/POSSE

That's how I do it, see the original https://jeena.net/photos/524 the mastodon copy https://toot.jeena.net/@jeena/103214370709720207 and the Twitter copy https://twitter.com/jeena/status/1199954031134887936

Facebook on the other hand removed that API so I stopped crossposting there: https://github.com/snarfed/bridgy/issues/817

Re:The sad state of personal data and infrastructure by choward on Friday December 20, 2019 @04:01PM (#21847351)
The problem I see with this as with most other projects linked in this thread is that they aren't actually "solutions". They're just ideas. You need programming and/or sysadmin experience to even begin using these approaches. What I'm thinking of is more of a solution that people can just start using without any friction.
Re:The sad state of personal data and infrastructure by shaki-dora on Friday December 20, 2019 @01:39PM (#21846409)
> With regards to being able to scrape your data or just get your data back from 3rd party's, I think that's a losing battle.

Both Google and Facebook have tools that allow you to export your data in both (usable) JSON and HTML.

Re:The sad state of personal data and infrastructure by choward on Friday December 20, 2019 @01:47PM (#21846460)
That's fine but how often do you export? How do you merge it with other exported data? Are you exporting your entire history every time? What about when Google/Facebook breaks their API or get rid of it?
Re:The sad state of personal data and infrastructure by sroussey on Friday December 20, 2019 @02:11PM (#21846619)
That is why we are creating PrivicyPal -- to set a schedule to download and merge data from many sources and monitor over time. Will be adding beta testers soon.

See https://www.privicy.com/privicypal/about

Re:The sad state of personal data and infrastructure by karlicoss on Friday December 20, 2019 @03:24PM (#21847106)
Yep, exactly that!

As in, you can do GDPR export or Google Takeout now and then, but then you request it, enter your password/etc; in few days you will get a link to the archive. You can put a reminder to do it now and then, but then your export stales, it's just so frustrating. It's almost ok as a means of backup, but it's hard to use this data in a meaningful day.

Re:The sad state of personal data and infrastructure by fuzzybeard on Friday December 20, 2019 @03:04PM (#21846967)
The lack of an export feature is rather common among smaller services. What Google and Facebook are capable of doesn't scale down to other service providers.