News for hackers. Stuff that matters.
Re:Verizon/Yahoo Blocking Attempts to Archive Yahoo Groups –... by mtmail on Sunday December 08, 2019 @06:41PM (#21739276)
“My understanding is that [the group] will still function as a mailing list, which is for all practical purposes, what people use this as,” https://www.theverge.com/2019/10/17/20919630/yahoo-groups-uk...
Re:Verizon/Yahoo Blocking Attempts to Archive Yahoo Groups –... by Diagon on Sunday December 08, 2019 @07:00PM (#21739393)
That's right, but (our main concern) is that the archives are being deleted. With no further history being recorded, it's utility for some purposes is limited. I have also come across some complaints that even as a list-serve it can be problematic. Posts, for example, are no longer coming in order.
Re:Verizon/Yahoo Blocking Attempts to Archive Yahoo Groups –... by Alex3917 on Monday December 09, 2019 @01:19AM (#21740772)
But as a mailing list, each subscriber has the entire archive, at least from the date they joined. And any one of them can make it publicly accessible at any point in the future. In practice it will undoubtedly result in the destruction of enormous amounts of human knowledge, but at least in theory not much is getting immediately lost.
Re:Verizon/Yahoo Blocking Attempts to Archive Yahoo Groups –... by philpem on Monday December 09, 2019 @04:03AM (#21741299)
The difficulty in a lot of cases is finding someone who has a complete copy of the group. Yahoo Groups also had file, photo and database features, and archives of those are likely to be incomplete. You'd have to go through the member list (primarily early members) and find someone who still had a copy of all the messages.

The other problem is making it available - I ran a Yahoo group for many years, and have Mbox and Maildir format archives. I'm still looking for a decent web-based browser for these. HyperKitty (Mailman's archive browser) came close, but seems to require most of Mailman to be installed in order to work.

In my case, I managed to archive a bunch of groups related to amateur radio -- and I will be placing these on archive.org as soon as I have a spare moment to zip them up. A difficult-to-access archive is better than no archive at all, the important part is getting the data into a safe place.

Re:Verizon/Yahoo Blocking Attempts to Archive Yahoo Groups –... by Alex3917 on Monday December 09, 2019 @10:10AM (#21743243)
I'm actually applying for an SBIR grant right now to work on the NLP algorithms that power fwdeveryone.com, if you have any interest in writing a letter of support. Basically it would eventually enable someone to mass export something like an MBOX archive onto the web in a cleaned up format with accessible typography. You can play around with prettyfwd.com to get an idea of the current state of the tech, it works well for 95% of (non-commercial) email threads but still needs some more work to support the rest.
Re:Verizon/Yahoo Blocking Attempts to Archive Yahoo Groups –... by Diagon on Monday December 09, 2019 @04:42AM (#21741423)
I have the same problem. I used some old script back in 2006 to download a couple of groups in ... I think it's Mbox format. It's just not clear what to do with it.
Re:Verizon/Yahoo Blocking Attempts to Archive Yahoo Groups –... by nicoburns on Monday December 09, 2019 @10:08AM (#21743228)
Hmm... a standalone viewer for these formats (that exposed a webserver that could be accessed in a browser) sounds like it would pretty trivial given a parser for the email format itself. Especially maildir!

How big are these archives? Do you have any samples? Does the viewer need any special features? (threading?)

Re:Verizon/Yahoo Blocking Attempts to Archive Yahoo Groups –... by Alex3917 on Monday December 09, 2019 @10:19AM (#21743327)
> pretty trivial given a parser for the email format itself

The problem is that there isn't any standard that defines what can and can't go inside the body of an email message. So if you want to post each email message exactly in a thread exactly as is, i.e. each with completely different typography and with all the replies attached and not sanitized in any way, then that's relatively easy. But it's also completely unreadable for more than about 30 seconds, and doesn't allow for good search functionality. These problems aren't a deal breaker if you're only trying to make sense of your own inbox, but when you're looking for specific information across millions of people's inboxes then they're a complete nonstarter.

Re:Verizon/Yahoo Blocking Attempts to Archive Yahoo Groups –... by WorldMaker on Tuesday December 10, 2019 @04:23PM (#21757005)
I remember how great Gmane used to be with several incredible web-based views of mailing list archives. Too bad it sounds like the source code was lost and never open sourced. Another on the list of services that died without passing on enough of the torch.
Re:Verizon/Yahoo Blocking Attempts to Archive Yahoo Groups –... by tedunangst on Sunday December 08, 2019 @07:43PM (#21739600)
Oh, neat, that's a pretty interesting read. Also good to know people will be able to keep their phone number after this.