News for hackers. Stuff that matters.
Re:Internet Archive as a default host-of-record for startups by kodah on Tuesday December 21, 2021 @12:16PM (#29639526)
Personally, I think eternally archiving everything and infinitely available public data has been not-so-great. If this was an "archive with consent" sort of system, then sure. My response may be better summarized as, "Does IA support robots.txt, and if not why?"
Re:Internet Archive as a default host-of-record for startups by FrostKiwi on Tuesday December 21, 2021 @12:34PM (#29639779)
Public data is... public. No one should be stopped from saving a public page and nothing should stop Internet Archive, be it robot or human. There is if course a need for removal of archived content infringing on someone's rights, whatever that might be, but "archive with consent" will fail for the goal of preserving culture. I think it's worrying that some online newspapers enacted archive blockers or IA needing DMCA excemptions, just so companies can't DMCA anything with their name on it. To preserve journalistic integreity and to save culture, even if it collides intellectual property rights, "archive with consent" won't cut it.
Re:Internet Archive as a default host-of-record for startups by orev on Tuesday December 21, 2021 @12:42PM (#29639884)
Content posted on a web site is NOT “public” (domain), it is (in the US) automatically copyrighted to the author, unless they specifically waive those rights. Just because you can see it through a browser doesn’t in any way mean you can make it yours and do what you want with it.
Re:Internet Archive as a default host-of-record for startups by Mezzie on Tuesday December 21, 2021 @03:50PM (#29641950)
It doesn't matter.

Archives are exempt from being forbidden to create copies due to copyright infringement. The Library of Congress can make all the copies it wants, it just can't SELL them.

Now, there is a question whether a private company should legally be able to BE an archive of record, but as of now there's no legal reason they can't be, I believe. So it's legal.

Re:Internet Archive as a default host-of-record for startups by FrostKiwi on Tuesday December 21, 2021 @12:55PM (#29640074)
Absolutely true. "unless they specifically waive those rights" - if archiving entailed contacting the owner with a legal archive request, we would have archived basically nothing. Luckily there are exceptions for Internet Archive in place. My point is, if "by consent" was the requirement to archive information, we would have archived nothing.
Re:Internet Archive as a default host-of-record for startups by ImprobableTruth on Tuesday December 21, 2021 @12:51PM (#29640000)
We store books in public libraries even if they aren't public domain and authors can do nothing to prevent them from doing so.
Re:Internet Archive as a default host-of-record for startups by ghaff on Tuesday December 21, 2021 @01:10PM (#29640248)
First sale doctrine in the US. If I buy a physical book, I can give it, loan it, throw it in the trash, etc. This doesn't apply to making electronic copies--see what happened with Google Books for example.
Re:Internet Archive as a default host-of-record for startups by rat9988 on Tuesday December 21, 2021 @12:56PM (#29640085)
If you buy the book, you have an authorization to do so. But you can't put copies of it.
Re:Internet Archive as a default host-of-record for startups by Mezzie on Tuesday December 21, 2021 @03:51PM (#29641956)
You do if you're an archive, actually.
Re:Internet Archive as a default host-of-record for startups by rectang on Tuesday December 21, 2021 @12:27PM (#29639681)
Throughout human history, records have been forgotten, rewritten, changed, mutated, degraded, eroded away to nothingness. "The internet is forever" has always struck me as inhumane. Make a mistake or expose a weakness on the internet and it will always accompany you.

It turns out that the internet is not always forever. I find that comforting.

Re:Internet Archive as a default host-of-record for startups by treesknees on Tuesday December 21, 2021 @01:06PM (#29640195)
Depends on how you think of "forever". If you post an embarrassing video and someone saves and reposts it with your name attached, odds are that video isn't going to be around in 200 years. But what about the next 10, 20 or 40 years? In the context of your overall professional adult life, that's a long time.

"The Internet is forever" isn't some natural law by which all content abides as though it can never disappear. It's a warning that you don't control the content once it's accessible on the Internet.

Re:Internet Archive as a default host-of-record for startups by oconnor663 on Tuesday December 21, 2021 @01:48PM (#29640606)
I think there's inhumanity of a kind on both sides of this question. "Everything you've done will be forgotten, and no one will remember your name" is the sort of thing the bad guys say in movies. But that's what happens to most of us in the end. I think it's natural not to want that.
Re:Internet Archive as a default host-of-record for startups by symlinkk on Tuesday December 21, 2021 @12:53PM (#29640027)
Maybe humans should become more accommodating of past mistakes.
Re:Internet Archive as a default host-of-record for startups by _jal on Tuesday December 21, 2021 @01:47PM (#29640591)
Suggest that to them. I'm sure they'll get right on it.
Re:Internet Archive as a default host-of-record for startups by garaetjjte on Tuesday December 21, 2021 @12:27PM (#29639685)
You're consenting by posting it on public internet in the first place.
Re:Internet Archive as a default host-of-record for startups by ghaff on Tuesday December 21, 2021 @12:37PM (#29639814)
Posting something on the public internet is not consent for you to scrape it and post it on your own site forever.

And requiring an explicit opt-in would basically mean no IA.

To be clear, the IA is a positive, maybe even a great one. But it skirts by because most people don't care. (They did as you say post whatever on the public internet.) Add the facts that they're a non-profit, aren't trying to monetize their hosting, and will generally take things if the owner asks.

Libraries and other archives have some very limited special rights (which mostly relate to making physical backups of physical books). But invoking "library" isn't some general get out of jail free card with respect to copyright.

Re:Internet Archive as a default host-of-record for startups by pessimizer on Tuesday December 21, 2021 @01:29PM (#29640423)
It can be. The reason libraries and other archives have special rights is because they fought for them against the express wishes of people who sold paper. There are no arguments made against archive.org that weren't also made against libraries.
Re:Internet Archive as a default host-of-record for startups by Mezzie on Tuesday December 21, 2021 @03:53PM (#29641970)
Thank you.

These rights are also under constant attack: It's normal to charge libraries exorbitant prices for digital materials compared to their analogue counterparts, for example.

Re:Internet Archive as a default host-of-record for startups by _jal on Tuesday December 21, 2021 @01:52PM (#29640638)
> Posting something on the public internet is not consent for you to scrape it and post it on your own site forever.

It effectively is. Your consent is not required, and people are doing far worse than just keeping it available (Clearview; there are also reports of people hoovering up encrypted data to crack in the coming decades when we're post-quantum).

This is no different than demanding people not keep track of anything else, and attacking archive.org might make you feel better, but that won't make anyone else stop.

Re:Internet Archive as a default host-of-record for startups by blackearl on Tuesday December 21, 2021 @01:24PM (#29640374)
People have recorded others without their consent for millennia. Whether it's telling a story about what someone said, a photo, or now a screenshot of a twitter post, that is reality. You'll never be able to stop someone from telling another that you said X.
Re:Internet Archive as a default host-of-record for startups by f3rnando on Thursday December 23, 2021 @12:15AM (#29658901)
I strongly believe that theres no freedom of speech without the freedom to replicate that speech.
Re:Internet Archive as a default host-of-record for startups by netrus on Tuesday December 21, 2021 @12:40PM (#29639870)
Do you think most people who post publicly on the internet would agree if asked? I think most people would like to have a choice to make old stuff disappear. If most people think so, THAT should be the rule. You might not like that and argue that there is no way to enforce it, but that does not mean it is a good rule to assume consent.
Re:Internet Archive as a default host-of-record for startups by ghaff on Tuesday December 21, 2021 @01:08PM (#29640220)
There are two things:

1.) Most people won't opt-in because a significant majority accept defaults and don't opt into most things.

2.) For people like yourself probing a bit deeper, you might well ask whether you really want to give up your ability to decide you don't want something you thought was so funny when you wrote it at 20 now that you're a politician running for office or up for a political appointment.

Re:Internet Archive as a default host-of-record for startups by kodah on Tuesday December 21, 2021 @03:40PM (#29641844)
I mean even honoring the opt-out of robots.txt would be fantastic. As another commenter pointed out they willfully ignore it: https://blog.archive.org/2017/04/17/robots-txt-meant-for-sea...

It's fairly unethical.

Re:Internet Archive as a default host-of-record for startups by BeFlatXIII on Tuesday December 21, 2021 @02:08PM (#29640842)
How about this? Archives will still exist regardless of consent. Does that makes them digital rapists?
Re:Internet Archive as a default host-of-record for startups by anaganisk on Wednesday December 22, 2021 @10:47AM (#29650835)
Lets say someone posted a private video and some zero day made it public, what’s the take on this scenario. Somehow robots crawled it.
Re:Internet Archive as a default host-of-record for startups by 1MachineElf on Tuesday December 21, 2021 @12:21PM (#29639586)
There is some public discussion about why IA does not strictly adhere to robots.txt:

https://blog.archive.org/2017/04/17/robots-txt-meant-for-sea...

Re:Internet Archive as a default host-of-record for startups by kodah on Tuesday December 21, 2021 @03:35PM (#29641790)
They're basically saying they're choosing to ignore a web convention that explicitly states that people don't want their websites archived or searchable because they want them to be. Sounds pretty unethical to me.
Re:Internet Archive as a default host-of-record for startups by BenjiWiebe on Tuesday December 21, 2021 @07:25PM (#29643920)
When those people die and quit paying for hosting, the information on their website doesn't magically become useless.

Perhaps other people still have a need for it.

Thank goodness the IA doesn't blindly obey robots.txt.

Re:Internet Archive as a default host-of-record for startups by Ericson2314 on Tuesday December 21, 2021 @12:39PM (#29639856)
There are clearly some things we, and the author, wants to persist, and yet the internet fails to do so.

Trying to muddle in privacy concerns with the accumulation of public knowledge undermines the whole concept of a shared society, or there being even the potential of accumulating "progress" in the first place.

Also, historically speaking, people with means used to save their letters for posterity, which proved to be a very valuable resource for future academics, so the idea of, what, deleting all your proton mails and signal messages as encouraged is arguably overshooting the return to some pre-internet norm.

Re:Internet Archive as a default host-of-record for startups by kodah on Tuesday December 21, 2021 @12:52PM (#29640020)
> Also, historically speaking, people with means used to save their letters for posterity, which proved to be a very valuable resource for future academics

Your example is an example of choice or consent. They also had the option to burn their hand written books and scrolls down periodically. Systems like IA take that choice away.

Re:Internet Archive as a default host-of-record for startups by Ericson2314 on Tuesday December 21, 2021 @02:54PM (#29641349)
There is no reason to do person communication with staticish websites. Don't foist the problems of social media onto the Internet Archive.
Re:Internet Archive as a default host-of-record for startups by kodah on Tuesday December 21, 2021 @03:38PM (#29641826)
I'm not sure I understand. robots.txt was a matter of consent and was standardized well over twenty years ago. The IA willfully ignores it because they believe it interferes with their mission. This was long before social media, when static websites were more dominant than dynamic ones.

Source: https://blog.archive.org/2017/04/17/robots-txt-meant-for-sea...

Re:Internet Archive as a default host-of-record for startups by Ericson2314 on Tuesday December 21, 2021 @06:47PM (#29643558)
This is a fair philosophical quibble, but the tiny amount of harm done in in real world makes this a waste of time discussing.

You made it public on the damn web, people doing what they wanted with it is fair game per the original ethos of the web. If you wanted it to be private, you should have some auth or encryption.

The actual real world harm is in actually-common-used means of personal communication were network effects preclude on carrying out they business with technology appropriate to desired privacy levels. Chatting on my custom website was always niche, and therefore the network effects argument doesn't carry water.

We should refrain from worrying about robots.txt minute until the elephant in the room is put to rset.

Re:Internet Archive as a default host-of-record for startups by kodah on Tuesday December 21, 2021 @07:03PM (#29643716)
Issues are not single track. I can rightfully claim that IA is founded on unethical behavior while I can also say other things in the world are bad.
Re:Internet Archive as a default host-of-record for startups by luckylion on Tuesday December 21, 2021 @02:18PM (#29640958)
"You shouldn't have privacy because it undermines the concept of a shared society, and also future historians might find your life interesting."

Thanks.

Re:Internet Archive as a default host-of-record for startups by Ericson2314 on Tuesday December 21, 2021 @02:54PM (#29641355)
Rediculus Strawman
Re:Internet Archive as a default host-of-record for startups by jrwr on Tuesday December 21, 2021 @10:20PM (#29645249)
They do respect robots.txt matter of fact, it will remove the website outright and most of its archives will be hidden until that website's robots.txt is offline.

Their documentation about it is rather crap right now, but its in several of their FAQs about it

Re:Internet Archive as a default host-of-record for startups by pseudalopex on Sunday January 02, 2022 @08:32PM (#29776275)
Respecting robots.txt would mean not saving pages blocked by robots.txt. Not just hiding.