News for hackers. Stuff that matters.
Re:Scaling Mastodon Is Impossible by jameshart on Monday November 14, 2022 @05:01PM (#33601867)
> Imagine you're a rather small server and suddenly Eli Lilly and Company joins your instance.

The point of mastodon is not that big companies will join small volunteer-run instances. They can run their own mastodon servers, just like they run their own mail servers and chat servers (or, more accurately, they outsource running their own mail and chat servers to Google and slack).

The right place for ActivityPub to land is that businesses and institutions will host their own (or pay a SaaS offering to do it for them, like they do with email and their CMS today), individuals will sign up to shared services (like you sign up with gmail for email, or blogger.com to blog).

The problem is going to be holding the barbarians at bay. All the same stuff we have to do for email will need to be deployed: Community blocklists for misbehaving servers, IP reputation, ML spam detection…

And funding it will require cash which the adtech industry will spiral in and offer to provide. ‘Federate with our servers and we’ll pay you 1c for every message you allow us to post to your users…’ Server admins will resist for a while but eventually, the walls will crack.

Enjoy it while it lasts, this burst of old school volunteer-run internet. It won’t survive this eternal September. It never does. As the architect of the Matrix said: Denial is the most predictable of all human responses. But, rest assured, this will be the sixth time we have destroyed it, and we have become exceedingly efficient at it

Re:Scaling Mastodon Is Impossible by TaylorAlexander on Monday November 14, 2022 @05:19PM (#33602103)
Yep and there’s already a paid service offering hosted instances!

https://masto.host/

There’s also an open and active GitHub issue on mastodon discussing how to separate server hosting from domain name so you can point DNS at an existing instance and use it from that domain: https://github.com/mastodon/mastodon/issues/2668

Many thanks to my friend on twitter for pointing me to both of these: https://twitter.com/__jesse_li/status/1592006641897320448

Re:Scaling Mastodon Is Impossible by MonkeyMalarky on Monday November 14, 2022 @05:45PM (#33602448)
I just had nightmares of internal corporate instances.

>Mastodon by Teams (tm), please log in with your active directory credentials to see the latest posts from HR!

Re:Scaling Mastodon Is Impossible by trelane on Monday November 14, 2022 @06:30PM (#33602949)
At least they'd (Microsoft) have to make the changes publicly available, since it's AGPL. So they can't have secret shenanigans that others don't have.
Re:Scaling Mastodon Is Impossible by doctor_eval on Monday November 14, 2022 @06:43PM (#33603068)
Genuinely don’t understand. Is the ActivityPub protocol AGPL? Is there something stopping MS from just building their own server from scratch?
Re:Scaling Mastodon Is Impossible by codefreakxff on Monday November 14, 2022 @06:52PM (#33603168)
They would also make a Microsoft owned version of the protocol to support features only their client and server supported
Re:Scaling Mastodon Is Impossible by sitkack on Monday November 14, 2022 @10:55PM (#33605073)
Why wouldn't they just implement SOAP over JSON?
Re:Scaling Mastodon Is Impossible by esarbe on Wednesday November 16, 2022 @02:42AM (#33620126)
ActivityPup is an API.

APIs are not protected by copyright.

Re:Scaling Mastodon Is Impossible by fragmede on Monday November 14, 2022 @06:49PM (#33603139)
The AGPL only applies if they make it available externally though. If they have their own internal instance the AGPL only says that Microsoft employees must be able to access the source code.
Re:Scaling Mastodon Is Impossible by mr_toad on Monday November 14, 2022 @07:04PM (#33603289)
Microsoft hosts teams for their customers. So if they modified the code all their customers users would be entitled to see it.
Re:Scaling Mastodon Is Impossible by LinuxBender on Tuesday November 15, 2022 @09:03AM (#33609271)
While I agree with this, I've interfaced with many lawyers that interpret AGPL differently mostly due to following license dependency trees. They nuked any project that went anywhere near AGPL even if the project was internal-only. This was not limited to places I worked either. There are others in my circle that had their projects shot down for using AGPL code. I do not fully grasp the logic the lawyers arrive at. Perhaps they are treating it the same way I treated PCI compliance, in that anything touching it gets infected by the zombie virus and must also be compliant.
Re:Scaling Mastodon Is Impossible by JAlexoid on Monday November 14, 2022 @10:51PM (#33605057)
Re:Scaling Mastodon Is Impossible by alisonatwork on Monday November 14, 2022 @07:11PM (#33603362)
This already existed. It was called Yammer, and nobody used it, and then Microsoft bought it anyway. Apparently it's rolled into Teams now, but since my last few companies were Slack shops I don't know how many people use the Teams-branded Yammer feature. Probably still nobody. Unlike chat, email and wiki, I don't think microblogging has ever proved to be useful in the workplace.
Re:Scaling Mastodon Is Impossible by lmm on Monday November 14, 2022 @07:24PM (#33603482)
Yammer was pretty nice for what it did. It felt more structured and formal than Slack, but wasn't as painful to edit as wikis tend to be.
Re:Scaling Mastodon Is Impossible by happymellon on Tuesday November 15, 2022 @07:22AM (#33608254)
Teams is already more structured and formal than slack. And it's an absolute pain to send team messages.

Everyone always just starts a group chat instead, as the reply is always so small and hidden, and the card system makes it hard to manage more than one or two threads at a time.

Re:Scaling Mastodon Is Impossible by Angostura on Monday November 14, 2022 @08:00PM (#33603791)
Yammer is separate from Teams, still
Re:Scaling Mastodon Is Impossible by ekianjo on Monday November 14, 2022 @08:51PM (#33604239)
> Apparently it's rolled into Teams now

Yes, and still nobody uses it

Re:Scaling Mastodon Is Impossible by jackvalentine on Monday November 14, 2022 @11:15PM (#33605198)
It is absolutely massive at my org.

The comms team religiously using it, and the ‘what’s happening’ digest being on by default meaning posts are surfaced in to people’s inboxes regularly until they unsubscribe means everyone knows about it.

Re:Scaling Mastodon Is Impossible by MattDemers on Tuesday November 15, 2022 @12:25AM (#33605644)
Oddly, I know a few EVE Online corporations used it.
Re:Scaling Mastodon Is Impossible by shagie on Tuesday November 15, 2022 @11:18AM (#33611106)
EVE Online has some of the most dedicated "fake companies in space" that I've seen - complete with accountants.

Eve Online fans literally cheer Microsoft Excel features at annual Fanfest - https://arstechnica.com/gaming/2022/05/eve-onlines-ms-excel-... /// https://news.ycombinator.com/item?id=31292593

Re:Scaling Mastodon Is Impossible by WorldMaker on Tuesday November 15, 2022 @02:51PM (#33614088)
> I don't know how many people use the Teams-branded Yammer feature.

So this has only gotten weirder recently. Microsoft decided to rename Yammer when inside of Teams to Viva Engage. Nothing about this branding decision makes sense. It's still Yammer if you open a link to the web version. It's still Yammer.com if you want to go to the public web version. It's just called Viva Engage inside of Teams and now Outlook. (To use an ancient dumb aphorism, apparently it is now called Yammer in the streets and Viva Engage in the sheets.)

On top of different brand name (for the same app!) there's also a different UI design. It's almost the most confusing you could possibly make it.

Whoever is at Microsoft in charge of these marketing decisions has either lost their mind or this is some sort of long con that doesn't make sense yet. (There's hints that Microsoft is trying to rename Cortana to Viva, and they did rename what used to be Cortana Insights emails to Viva Insights, all of which are also dumb brand names. This seems an effort play up that these various inside-Teams and inside-Outlook sub-services are some sort of "intelligent business assistant for business users only" to jettison the final remaining ties to consumer Cortana [RIP] and the fun gaming-originated name for something bland and soulless and not-fun capital-E Enterprise, sigh.)

Anecdotally, the rebrand so far seems to be diminishing use of Yammer inside of Teams at my employer. They had Yammer as a default app in the default sidebar of Teams but when the branding switched Viva Engage is no longer in the default list. There's still something of a "well, post it on Yammer" culture here and people don't even seem to realize they can do it directly in Teams anymore because Teams no longer has a "Yammer app" and no one knows to look for "Viva Engage".

This is all just really wild and feels a bit like Microsoft has lost some of its mind here.

Re:Scaling Mastodon Is Impossible by Terretta on Wednesday November 16, 2022 @08:49AM (#33622804)
For hypothetical grand plan, see: Loop
Re:Scaling Mastodon Is Impossible by selfhoster11 on Tuesday November 15, 2022 @04:46AM (#33607176)
That don’t sound too bad. I would use it, if it meant avoiding the Teams client application.
Re:Scaling Mastodon Is Impossible by nikolay on Monday November 14, 2022 @07:21PM (#33603461)
Having a specilized hosting company means that self-hosting Mastodon is challenging! So, it's MastoDon't, basically!
Re:Scaling Mastodon Is Impossible by TaylorAlexander on Monday November 14, 2022 @08:17PM (#33603972)
I mean, yes self hosting a Linux computer in the cloud requires certain skills and time. This is the basis of the business model for the biggest companies on the internet - we will run a service for you so you don’t have to run your own server. This is true even for hosting a basic HTML web page - a whole lot of people do not want to operate their own server, and this in no way means the service is bad.
Re:Scaling Mastodon Is Impossible by nikolay on Monday November 14, 2022 @09:05PM (#33604367)
Wrong! Hosting Mastodon is a different type of challenge, not to mention how much wasteful it is due to the poor choice of Ruby! Yes, Oracle Labs are trying Truffle, but it's not officially supported yet.
Re:Scaling Mastodon Is Impossible by derefr on Monday November 14, 2022 @09:51PM (#33604647)
What does the choice of programming language for a reference implementation have to do with the cost/benefit analysis of the protocol it implements?
Re:Scaling Mastodon Is Impossible by nikolay on Monday November 14, 2022 @10:05PM (#33604747)
Oh, it's now a reference implementation... since when?! Do those people who climb on the Mastodon bandwagon know this is just a POC turned into a Product, which now competes with Twitter?!

The language makes a huge difference as you need to deploy the whole Ruby toolchain, and front it with all the hard choices Rubyists had to deal with for ages to make it kinda work! You don't make a distributed competitor of Twitter following its own wrong design chocies!

Mastodon is old, and it's a shaky foundation, and it should be rebuilt from scratch instead of disappointing the millions of people who suddenly like Dorsey more than Musk... although Dorsey is working on Bluesky, not Mastodon, or ActivityPub!

Re:Scaling Mastodon Is Impossible by jsjohnst on Monday November 14, 2022 @10:56PM (#33605084)
> Oh, it's now a reference implementation... since when?! Do those people who climb on the Mastodon bandwagon know this is just a POC turned into a Product, which now competes with Twitter?!

Might I suggest you take a deep breath and tell yourself ‘it’s ok, I don’t need to pick fights with random people over trivial things’?

> The language makes a huge difference

If a decentralized social network is a good thing (jury is out imho), guess it’s a good thing that there’s ActivityPub implementations in multiple wildly different languages then?

Re:Scaling Mastodon Is Impossible by libraryatnight on Tuesday November 15, 2022 @12:52AM (#33605788)
What's your beef? Seriously.
Re:Scaling Mastodon Is Impossible by nikolay on Tuesday November 15, 2022 @01:19AM (#33605912)
Seriously? We used to have comptuters with just 48KB RAM and created great software for it. Now, we have mobile apps like Facebook, which is over 2GB in size, and they are just a gigafat client of a server app!!! Mastodon is just like that - slow, wasteful, not scalable! And what's the worst is that people are getting hopeful about it not remembering how Ruby tanked Twitter back then! Doesn't anyone remember the Fail Whale?!
Re:Scaling Mastodon Is Impossible by libraryatnight on Tuesday November 15, 2022 @02:02AM (#33606146)
You need to calm down
Re:Scaling Mastodon Is Impossible by TaylorAlexander on Tuesday November 15, 2022 @03:22AM (#33606663)
For real.
Re:Scaling Mastodon Is Impossible by nikolay on Tuesday November 15, 2022 @03:40AM (#33606776)
Actually, I'm pretty calm - I can't say the same about the super excited users of Mastodon in the near future though! And, honestly, all this "movement" or "exodus" being based on Elon Musk taking over, really?! How was Twitter any better before him?! The blatant censorship actually made many people flee Twitter long before ELon Musk and it was heavily infested with bots since day 1 and I find no utility in it. Twitter is an acute form of masochism trying to follow a "conversation" on it. I do have Twitter Blue and I've been a paying subscribero of Threadreader before, but they don't help.

ANyway, just try to imagine the same spammy bots taking down all Mastodon servers when the super eager to leave Twitter move to the next cool thing... It won't be pretty! The Fail Whale will feel like a joke compared to what's about to come.

Re:Scaling Mastodon Is Impossible by mrtranscendence on Tuesday November 15, 2022 @09:58AM (#33609866)
Characterizing Twitter moderation as "blatant censorship" does not, to my mind, indicate that you are a serious conversant here.

> How was Twitter any better before him?!

Before Musk took over it wasn't saddled with the $13B in debt he took on to buy it. Before Musk took over advertisers weren't fleeing the platform in droves. Before Musk took over no one could impersonate Eli Lilly with a blue checkmark and cause its stock to crash. There's no indication now that Twitter will do anything to stop hate campaigns and abuse when they arise (hate speech is free speech, after all, and isn't illegal in the US). I could imagine some kind of future for Twitter before Musk, but that's immensely more difficult now.

I don't think Mastodon is the solution, mind you. But it's no surprise to me that a lot of folks are looking for an alternative.

Re:Scaling Mastodon Is Impossible by vidarh on Tuesday November 15, 2022 @03:20AM (#33606654)
Having actually looked at and run Mastodon, of the problems Mastodon have, and there are quite a few, the choice of Ruby is far down the list, and your focus on it suggests you haven't spent any time looking at where the complexity is.
Re:Scaling Mastodon Is Impossible by nikolay on Tuesday November 15, 2022 @03:29AM (#33606721)
Why is there no Ruby web framework in the most iconic benchmark [0]?

[0]: https://www.techempower.com/benchmarks/#

Re:Scaling Mastodon Is Impossible by vidarh on Tuesday November 15, 2022 @07:09AM (#33608163)
You're moving goalposts. Gone from "complexity" to performance. Ironically I'd have been more willing to agree with you that the complexity of Mastodon is a challenge.

But presumably because very few people cares about that benchmark and what is supported depends on what they choose to add. You're the first person I've ever seen mention it.

For a simple reason: Performance on dynamic requests is a choke point only for a miniscule proportion of sites, and the federation that is a selling point for Mastodon ensures that any single Mastodon instance is far less likely to ever approach a size where that becomes an issue. There are certainly sites where I wouldn't run Ruby, even though it's a language I love to use.

But I'll repeat myself: The choice of Ruby is far down the list of issues with Mastodon.

Returning to the benchmark, it's also contrived to reference as a general measure for a web app. Anyone building actual systems using Ruby puts Ruby behind a reverse proxy exactly because we're fully aware you focus on avoiding hitting the Ruby app server for anything static or cacheable, and so the setups on that benchmark (there are at least four frameworks and a couple of dozen entries) are entirely atypical for Ruby app server setups (they all hit the web server hosting the Ruby app directly).

That's fine - they measure what they measure, but they don't measure a realistic web app setup with any relevance to Mastodon.

E.g. the vast majority of traffic for a Mastodon instance is read-only requests to toots and media that are trivially statically cached, and so the vast majority of hits to a Mastodon server set up to actually scale should never hit the app server at all.

I have a deep distaste for Rails, and think Mastodon is more complex than it needs to, and there's plenty to criticise Mastodon for, but you're barking up the wrong tree.

Re:Scaling Mastodon Is Impossible by derefr on Tuesday November 15, 2022 @04:02PM (#33614962)
> Oh, it's now a reference implementation... since when?!

For any software that embodies an open and formally-specified protocol (in this case, the protocol is ActivityPub), any first implementation of it is a reference implementation (as opposed to a defining implementation), because at any point someone else can create another implementation, and then both implementations will have to deal with adhering to the standard, rather than either being able to bully the other into implementing things a certain way. It's not about whether anyone else has implemented a second client for the standard; it's just about whether they can, and what would happen if they did.

Examples of things that are reference implementations of open protocols/formats, where the protocol/format "came from" the reference implementation but then became its own thing, with other implementations: Memcached, Redis, IPFS; PNG, OpenDocument.

Example of something that's not a "reference implementation of an open protocol", despite seeming like it: Amazon S3. There are many other "S3-compatible" servers; but there's no open, formalized standard for what "S3 compatibility" means; and so Amazon can change S3's API at any time, and everyone else will just have to deal with that. (They won't — it's been the same stable API forever — but they could. And what they can do is the point here.)

Re:Scaling Mastodon Is Impossible by tomrod on Monday November 14, 2022 @10:09PM (#33604773)
If I may suggest, I recommend reading up on the concept of comparative advantage. Economics suggests that an org that spends more on self serving Mastodon or any service outside their core offering costs should be willing to offload that to a specialized service if the service offering is lower.
Re:Scaling Mastodon Is Impossible by nikolay on Monday November 14, 2022 @10:33PM (#33604925)
I know no commercial organization running their own Mastodon - all instances I know are some non-commercial communities who are just too attached to their favorite domain. As communities run by volunteers, the cost is more important than the volunteer effort.
Re:Scaling Mastodon Is Impossible by tomrod on Tuesday November 15, 2022 @12:44AM (#33605749)
> I know no commercial organization running their own Mastodon

Key to remember is yet. The internet started as DARPAnet, after all.

Re:Scaling Mastodon Is Impossible by robin_reala on Tuesday November 15, 2022 @01:38AM (#33606009)
You’ve got an extra D, it was ARPANET.
Re:Scaling Mastodon Is Impossible by tomrod on Tuesday November 15, 2022 @07:53AM (#33608537)
Serves me right typing on a phone without my glasses.
Re:Scaling Mastodon Is Impossible by cricalix on Tuesday November 15, 2022 @01:17AM (#33605901)
It may not quite count as commercial, but the EU as an entity has their own instance. European Commission and others are on it.

https://social.network.europa.eu/about

Re:Scaling Mastodon Is Impossible by nikolay on Tuesday November 15, 2022 @01:22AM (#33605926)
Are we now giving bureaucrats as a positive example? I see so many people running closed servers with just a couple of accounts of it, which is another failure of Mastodon - not easily allowing people to use their own domains as identities instead of having to run a whole new server, which is a total waste, and not helping the ecosystem!
Re:Scaling Mastodon Is Impossible by echelon on Monday November 14, 2022 @09:20PM (#33604459)
> Yep and there’s already a paid service offering hosted instances!

> https://masto.host/

What's old is new again!

https://en.wikipedia.org/wiki/Ezboard [1]

And later,

https://en.wikipedia.org/wiki/VBulletin

https://en.wikipedia.org/wiki/Invision_Community

[1] I'm upset that archive.org can't display any of this content due to the robots.txt of one of the later owners of the domain name.

Re:Scaling Mastodon Is Impossible by dredmorbius on Monday November 14, 2022 @09:57PM (#33604688)
Oh man, memories and flashbacks...
Re:Scaling Mastodon Is Impossible by skinnymuch on Monday November 14, 2022 @10:21PM (#33604858)
Do you know if Masto Host will open their doors to customers again?
Re:Scaling Mastodon Is Impossible by TaylorAlexander on Tuesday November 15, 2022 @03:32AM (#33606739)
I don’t know.
Re:Scaling Mastodon Is Impossible by WorldMaker on Tuesday November 15, 2022 @03:02PM (#33614229)
The owner/admin of Masto Host has made various statements that he doesn't want to host more than a small target % of users and instances at any given time, because he wants to keep the fediverse diverse in hosts/doesn't ever want to be the single-point-of-failure in a federated network. (Which truly is a great attitude and one of the things I like about supporting masto.host.) So the impression I have here is that he is waiting for some of this massive influx of users to slough off a bit and give him a better idea of something resembling the new steady state before deciding on if masto.host's hosted percentage still fits within his self-imposed cap.

All of this also coincides with a massive migration to Mastodon v4 adding to current maintenance burdens.

So the short answer is: masto.host probably will open its doors again if it doesn't seem to be hosting too much of the Fediverse, and it will probably be at least a few more days if not a few more weeks before registrations open back up if they do.

(There are some alternative hosts to consider if you don't want to wait on masto.host.)

Re:Scaling Mastodon Is Impossible by solaceb on Monday November 14, 2022 @10:39PM (#33604968)
A really, really deep irony that you found these cool new Masto things on twitter. The king still reigns
Re:Scaling Mastodon Is Impossible by JAlexoid on Monday November 14, 2022 @10:48PM (#33605036)
Twitter is free, operational, easily accessible and known.

Finding a mastodon instance is a pain today. And "run your own" is not a great option. (It's a pain to run your own publicly accessible anything, these days. I will never go back to running my own email server ever again)

Re:Scaling Mastodon Is Impossible by TaylorAlexander on Tuesday November 15, 2022 @03:32AM (#33606735)
Also I have 20x the followers on Twitter because I’ve been using it longer! And I still get a lot out of mastodon.
Re:Scaling Mastodon Is Impossible by TaylorAlexander on Tuesday November 15, 2022 @03:31AM (#33606732)
I suppose. I’ve also got 20x the followers on Twitter because I’ve been using it actively for years, but I’ve only recently started using mastodon. I can certainly say I’ve learned more about mastodon from posts on mastodon, but in this instance a user from twitter was helpful. Notably that user is also on mastodon. I’ll have to check to see if we’re following each other there. Every day I find more of my twitter friends on mastodon, and it’s a lovely feeling.
Re:Scaling Mastodon Is Impossible by weinzierl on Tuesday November 15, 2022 @01:43AM (#33606042)
Actually there are several and some are listed on the Mastodon website[1]. Look in the "So you want to run your own Mastodon server" section.

I have only heard the best about masto.host but they have closed subscriptions for now (which only speaks for them IMHO). I have personal experience with Ossrox and Weingärtner IT, they are both excellent and I can recommend them without hesitation. I have no affiliation with any of those companies except being a customer of the later two.

EDIT: The price of a small instance is less than a Twitter subscription. So, if you want your own instance - which as pros and cons - nothing is holding you back.

[1] https://docs.joinmastodon.org/user/run-your-own/

Re:Scaling Mastodon Is Impossible by user3939382 on Monday November 14, 2022 @05:08PM (#33601969)
> the architect of the Matrix

Who was, by the way, an homage to Vint Cerf, creator of TCP/IP.

Re:Scaling Mastodon Is Impossible by kerblang on Monday November 14, 2022 @05:15PM (#33602048)
Mmmm I think this is popular urban legend
Re:Scaling Mastodon Is Impossible by googlryas on Tuesday November 15, 2022 @01:53AM (#33606085)
Urban legends are definitionally false. This is more of a theory but without any verification from the people who actually created the content. I would bet $1, but not more, that he is modeled after Vint Cerf.
Re:Scaling Mastodon Is Impossible by class4behavior on Monday November 14, 2022 @05:45PM (#33602447)
As a side note, imho, there's little incentive for (large) businesses to associate with any particular instance because of the evident risk that users would target and harm their brands.
Re:Scaling Mastodon Is Impossible by shagie on Monday November 14, 2022 @10:21PM (#33604856)
There are several reasons why they wouldn't want to associate with a public server.

While the verification green check mark is nice, it is much better to have PR hosted on toot.company.com instead.

Furthermore, there's the "who can see what" - https://restoreprivacy.com/mastodon-privacy-issues-risks/

> Because these messages aren’t end-to-end encrypted, the server owner can read everything in plaintext.

(See also https://github.com/mastodon/mastodon/issues/18079 )

That's a BIG "companies should be hosting their own servers."

Re:Scaling Mastodon Is Impossible by jameshart on Monday November 14, 2022 @10:38PM (#33604962)
Exactly. You're not going to go find Hertz on mastodon.social to complain about your rental car booking being screwed up, any more than you would expect to reach their helpdesk through [email protected].
Re:Scaling Mastodon Is Impossible by 094459 on Monday November 14, 2022 @06:32PM (#33602969)
I can see most companies not spinning up Mastadon servers simply because of the license.
Re:Scaling Mastodon Is Impossible by tptacek on Monday November 14, 2022 @06:34PM (#33602983)
If ActivityPub succeeds, it's unlikely that the Mastodon server will be the only mainstream implementation.
Re:Scaling Mastodon Is Impossible by wizzwizz4 on Monday November 14, 2022 @07:40PM (#33603595)
Mastodon is already not the only mainstream implementation. It wasn't even the first mainstream implementation. https://fediverse.party/ lists ten.
Re:Scaling Mastodon Is Impossible by hugs on Monday November 14, 2022 @08:45PM (#33604201)
It's been a looooong time since I mostly did web dev, but if anything got me back in the game, this is it. I'm sad to see Twitter implode, but this unnatural disaster is a window of opportunity that feels like the mid-2000s social media Cambrian explosion all over again.
Re:Scaling Mastodon Is Impossible by godelski on Monday November 14, 2022 @07:25PM (#33603490)
> The point of mastodon is not that big companies will join small volunteer-run instances.

But does this really address that issue? I see this as an attack vector really. Let's say Elon isn't happy with the competition. He can join a small server and force them to either increase hosting fees or to shut down. That's really the point of the author's comment and the relationship to scaling.

Re:Scaling Mastodon Is Impossible by Bilal_io on Monday November 14, 2022 @07:33PM (#33603548)
I don't know the underlying architecture of mastodon, so forgive my naive question, but why wouldn't rate-oiniting be a solution in this instance? Or if one believes they're under attack by a large group of people by aimpling registering and posting 1 post, then rate limiting won't be affecting, so they could realistically pause registration, right?

Please correct my misunderstanding.

Re:Scaling Mastodon Is Impossible by polytely on Monday November 14, 2022 @08:32PM (#33604104)
the admin can just ban elon and set the instance to invite only, easy
Re:Scaling Mastodon Is Impossible by rsynnott on Monday November 14, 2022 @08:53PM (#33604256)
... I mean, they could just kick him off.
Re:Scaling Mastodon Is Impossible by bartread on Monday November 14, 2022 @07:32PM (#33603541)
> Enjoy it while it lasts, this burst of old school volunteer-run internet. It won’t survive this eternal September. It never does. As the architect of the Matrix said: Denial is the most predictable of all human responses. But, rest assured, this will be the sixth time we have destroyed it, and we have become exceedingly efficient at it

This is perhaps my biggest regret. I've ignored Mastodon because it seem too much like a PITA to deal with. Now I've been looking at it more seriously, but so has everybody else who's on Twitter, so by the time I get there it's going to be... Twitter pre Musk. This isn't really that appealing. Coulda woulda shoulda, etc., but I just wasn't paying enough attention at the right time. Rather like Bitcoin. Don't get me started.

Re:Scaling Mastodon Is Impossible by madrox on Monday November 14, 2022 @07:59PM (#33603779)
You may enjoy private Discord servers more if you're seeking online community
Re:Scaling Mastodon Is Impossible by int_19h on Monday November 14, 2022 @10:36PM (#33604948)
The influx is going to be contained on a few large servers. If you run your own instance, you can just not federate with them.
Re:Scaling Mastodon Is Impossible by naravara on Tuesday November 15, 2022 @09:49AM (#33609753)
If you're not federated with them your instance is going to be a ghost town. I think it'll be hard to run an independent instance with enough activity on its own to be worth joining unless you have some external source of community/fandom to keep fresh streams of users coming in to manage churn. The largest community Discords, for example, tend to be around YouTubers, streamers, podcasters, etc. where they build the community around their content and fanbase. This was also the way the big PHP forums used to go.
Re:Scaling Mastodon Is Impossible by WorldMaker on Tuesday November 15, 2022 @03:17PM (#33614422)
People used to love the relative calm of the small PHP (and Perl) forums. For some of us in the early internet the big forums were toxic place to generally be avoided. You can have a wonderful time on a tiny instance that only federates with mostly other tiny instances and never sees the biggest instances.

Mastodon doesn't need to be Twitter where you "must" follow celebrities of any sort or streamers/podcasters/YouTubers/Influencers. People claiming that Mastodon is terrible because it isn't focused solely on massive instances with maximal "reach" are missing the point: that is a *feature* and not a bug. People have forgotten the early days of Twitter when it was mostly about following real life friends, or conference acquaintances. There's a usefulness to quieter, stiller social media. It's great to have tiny instances with tiny follow streams.

Re:Scaling Mastodon Is Impossible by cmrdporcupine on Monday November 14, 2022 @10:58PM (#33605098)
The influx has already cooled down. Growth rate for the past 4-5 days is less than half of what it was on the weekend.

Also, on Mastodon you will only see what you explicitly follow. You won't even see the rabble unless you go looking for it.

Re:Scaling Mastodon Is Impossible by pelorat on Tuesday November 15, 2022 @02:18AM (#33606238)
That's not true, you can see a RT federated view, or a local view, i.e. all incoming posts on your server.
Re:Scaling Mastodon Is Impossible by JAlexoid on Monday November 14, 2022 @11:01PM (#33605107)
Meh... It was a pain years ago and Mastodon is still a pain today.

It's not like torrents and likes of PirateBay that make downloading movies easy. It's very complex to get into the network. It's like Mastodon is trying to not let you in.

Re:Scaling Mastodon Is Impossible by memish on Tuesday November 15, 2022 @12:06AM (#33605534)
It's not too late. Joining Mastodon and tooting hasn't caught on yet.
Re:Scaling Mastodon Is Impossible by MattDemers on Tuesday November 15, 2022 @12:26AM (#33605649)
You're definitely not too late.
Re:Scaling Mastodon Is Impossible by spion on Monday November 14, 2022 @07:44PM (#33603631)
> Community blocklists for misbehaving servers, IP reputation, ML spam detection…

Not really. Email and ActivityPub are radically different in one way that makes all the difference: AP is whitelist-based (follows).

> Federate with our servers and we’ll pay you 1c for every message you allow us to post to your users...

And this is a fine model - much better than all the power concentrated in one stagnant entity that forbids everyone else from participating, extending or improving.

Re:Scaling Mastodon Is Impossible by jameshart on Monday November 14, 2022 @08:47PM (#33604211)
I don't see how follow-driven whitelisting eliminates issues with misbehaving peers. ActivityPub servers can receive 'Follow' requests to any of their inboxes, from any server. Seems like a peer that just pops up on a random address, spams out a bunch of follow requests referencing actor profiles containing crypto pump-and-dump scams, then vanishes would be just as much of a nuisance to Mastodon as an equivalent SMTP-based spammer.
Re:Scaling Mastodon Is Impossible by ekianjo on Monday November 14, 2022 @08:53PM (#33604257)
Follow requests and then what? you can set follows to approve-only in the Mastodon settings.
Re:Scaling Mastodon Is Impossible by jameshart on Monday November 14, 2022 @08:57PM (#33604286)
The user has to be shown the follow request to approve, right?

So now your user's incoming follow request inbox is a list of viagra ads, .eth scams, and pornstars.

Re:Scaling Mastodon Is Impossible by JAlexoid on Monday November 14, 2022 @11:04PM (#33605124)
Ah... The "good old days" of poor spam filtering
Re:Scaling Mastodon Is Impossible by spion on Tuesday November 15, 2022 @02:49PM (#33614067)
Since this is federated, you're not limited to "mastodon settings". You can choose to simply ignore follow requests fully, or to not show them to the user, or whatever else you wish.
Re:Scaling Mastodon Is Impossible by jameshart on Tuesday November 15, 2022 @05:16PM (#33615869)
I.e., implement spam blocking measures.
Re:Scaling Mastodon Is Impossible by spion on Wednesday November 16, 2022 @04:28AM (#33620684)
No, just ignore aspects that are prone to spam and bring little value.
Re:Scaling Mastodon Is Impossible by WorldMaker on Tuesday November 15, 2022 @03:11PM (#33614345)
Follow requests are a relatively weak spam vector: you have a tiny 32x32 avatar and an "email address" format username. Maybe you hope people visit your profile page from there but no one sees it by default in their follow request list. If you try to put spam content in the avatar or username people automatically block you. If you don't and hope on someone glancing at your profile, a lot of people ignore follow requests from unknown/unexpected usernames by habit. If you try to put the spam in your domain name people automatically block your entire instance.
Re:Scaling Mastodon Is Impossible by jameshart on Tuesday November 15, 2022 @05:16PM (#33615855)
Ie, servers have to do spam blocking.
Re:Scaling Mastodon Is Impossible by WorldMaker on Tuesday November 15, 2022 @05:37PM (#33616157)
No one is arguing that spam blocking isn't a part of instance moderation.

I'm saying that in terms of economic "bang for the buck", if you were going to spam the fediverse doing it with follow requests is a terrible way to do it with very low likelihood of success. You are better off trying for other means of virally distributing toots than follow request spam.

Re:Scaling Mastodon Is Impossible by jameshart on Tuesday November 15, 2022 @07:46PM (#33617394)
My intent was not to identify a viable channel for spamming the fediverse, but more to point out that permitting messages from random new nodes happens in at least one standard interaction on an activitypub server - an ‘existence proof’ of a sort for a message channel that doesn’t get solved by follow-based whitelisting.
Re:Scaling Mastodon Is Impossible by WorldMaker on Wednesday November 16, 2022 @08:34PM (#33633753)
Economics effects still apply to spam. Low useful signal still is an economic factor on if it is worth to do follow request spam "at scale" or not.

Also, federation itself may be allowlist-based. Some instances already run that way. Likely many more would if inter-instance spam follow requests rose above a certain threshold.

Re:Scaling Mastodon Is Impossible by spion on Tuesday November 15, 2022 @02:36PM (#33613879)
> Seems like a peer that just pops up on a random address, spams out a bunch of follow requests referencing actor profiles containing crypto pump-and-dump scams, then vanishes would be just as much of a nuisance to Mastodon as an equivalent SMTP-based spammer.

I'm not thats anywhere near the disruptiveness of SMTP. As a private person, I could simply have the server not notify me of any follows and it wouldn't affect my own feed at all.

Re:Scaling Mastodon Is Impossible by zmmmmm on Monday November 14, 2022 @09:17PM (#33604438)
Fully centralised, but the best counter example I have in my mind is Reddit; here you have largely community moderated content under a general umbrella of quite loose policies. Reddit is I think pretty successful in that even though some subreddits are totally overrun with moronic content, the ones I care about are high quality. So even though it's centralised I don't think any of the fundamentals that make it work can't be decentralised. If Mastodon can follow these rough guides for how to make community moderation work, I think there's a chance it can be successful without falling into the cavern that email did.
Re:Scaling Mastodon Is Impossible by tootie on Monday November 14, 2022 @09:29PM (#33604507)
Twitter could have done what Reddit did. Dorsey just didn't get it and Musk gets it even less. Reddit has been growing slowly, making some very public mistakes along the way but never getting ahead of their skis. I think it's definitely true that Twitter was bloated, but firing half the company on a lark was a pretty stupid plan. They need to cull features, pay down technical debt and reduce costs. They also need to strongly affirm that their moderation policy is to create a platform that is free of abuse and amenable to the most people possible. Not "free speech".

The two smartest people in this business are Yishan Wong and Ellen Pao.

Re:Scaling Mastodon Is Impossible by mrtranscendence on Tuesday November 15, 2022 @10:31AM (#33610334)
The fact of mass layoffs immediately after the takeover just baffles me. I understand the pressure to reduce costs, and I understand that in some sense Twitter might be overstaffed for the features it offers. But the blunt of instrument of firing over half the company with a week's preparation feels extraordinarily inept. It's a wonder they've been able to keep the lights on -- losing access to their official Twitter handle was a nice touch. The money they saved over a more reasonable, long-term solution can't be that much in the scheme of things.

Just spitballing ... offer a generous severance for voluntary layoffs now along with a hiring freeze, and give a mandate to simplify the offering and reduce infrastructure costs. Take the time to learn the business and identify which areas can be profitably wound down. Only then reorganize the company and make targeted layoffs. (Bonus idea: don't rush features like Twitter Blue that no one asked for, are ripe for abuse, and might even lose money overall if reports are correct.)

I've never been a huge Musk fan, but any respect I had for him as an effective business leader has evaporated.

Re:Scaling Mastodon Is Impossible by fortuna86 on Monday November 14, 2022 @10:27PM (#33604890)
subreddit are still centralized...on reddit
Re:Scaling Mastodon Is Impossible by nine_k on Tuesday November 15, 2022 @07:40AM (#33608394)
If many of more niche subreddits technically existed on other infrastructure than r/pics and such, most users of these subreddits likely won't mind.
Re:Scaling Mastodon Is Impossible by fortuna86 on Tuesday November 15, 2022 @11:25AM (#33611216)
At the very least every subreddit has the same domain reddit.com/r/*
Re:Scaling Mastodon Is Impossible by fire on Monday November 14, 2022 @09:32PM (#33604532)
is there a reason we couldn't or shouldn't use existing mail infra and maybe auto-negotiate a protocol upgrade for mastodon servers?
Re:Scaling Mastodon Is Impossible by derefr on Monday November 14, 2022 @09:49PM (#33604633)
> Federate with our servers and we’ll pay you 1c for every message you allow us to post to your users…

What's the problem there, if you know all your users have corporate-mandated spam-blockers installed that will drop the spam they're paying you to forward?

Re:Scaling Mastodon Is Impossible by jameshart on Monday November 14, 2022 @10:19PM (#33604841)
I see you've never interacted with the adtech industry before.
Re:Scaling Mastodon Is Impossible by dredmorbius on Monday November 14, 2022 @09:56PM (#33604682)
"Eli Lilly" did effectively join Mastodon, in 2018, except that it was Wil Wheaton, and ... things went poorly.

Wil joined what was at the time my own home instance, following something of a flameout on Twitter, itself caused by 1) people harassing him there, 2) Wil employing a shared, user-generated blocklist which 3) by both its own size and celeb-driven adoption rendered many other Twitter accounts effectively blocked --- not by Twitter, but as a result of individual adoptions of that blocklist. How legitimate inclusions were, and/or how feasible it was to get off the blocklist, I really can't say. That said, Wil arrived on Mastodon with both a large fan and foe base.

Harassment of Wil began on Mastodon.

<https://www.theglobaldispatch.com/mastadon-shuts-down-wil-wh...>

The admin/moderator was ... less than transparent or capable, and responded to a case of "this profile is causing me problems" by banning that profile rather than seeking out the root cause of the griefers who'd in fact triggered the problem.

<https://mastodon.cloud/@wilw/100635779449174251>

Ultimate, Wil left Mastodon as well, writing his own account of the matter:

<https://wilwheaton.net/2018/08/the-world-is-a-terrible-place...>

Mastodon's evolved its own tools and practices (both technically and as a community, including a community of admins), and should perform better in future, though much engineering progress emerges through pain, suffering, or worse.

Wil is, in the world of celebrity, fairly modest stakes. I've heard tales of Twitter that there was a point where it could only handle a tweet from one major celeb (e.g., Justin Bieber, Katy Perry, or one of the 'dashians) at a time, and effectively had servers dedicated to sufficiently large accounts. Celebrities proved an interesting stress-testing mechanism.

Mastodon ... has not yet experienced this, and I've my concerns with how well it might handle such scaling, or what specific elements of scaling (users, instances, posts, interactions, ...) will prove most problematic. I've certainly seen and heard of numerous cases of growing pains over the past few weeks, though nothing insurmountable.

But:

1. Celebs and brands are profile types that should be considered.

2. Mastodon's had some experience and performed poorly, both technically and culturally.

3. Adding very-high-profile profiles to the network needs some consideration. It's quite likely that there will be poorly-thought-through adoptions in future, however.

Re:Scaling Mastodon Is Impossible by jameshart on Monday November 14, 2022 @10:33PM (#33604922)
Right, the issue here is like if Wil Wheaton starts hanging out at a café, and it's just a small café, and the owner at first thinks it's pretty cool that a celeb is hanging out there, and some trekkies start coming by, which increases the vibe of the place...

... but then a bunch of guys in stormtrooper outfits start showing up every day and the trekkies start fighting with them and the cops are getting called out and pretty much eventually the owner is going to ask Mr. Wheaton to stop coming by.

And because it's just someone else's café, he pretty much has to do that.

The good news is, going to that café is not the only way for him to participate in the fediverse. He is the proud owner and operator of wilwheaton.net, and he can point that at his own activitypub server, that nobody can kick him off. He can bulk block all stormtroopers, interact with the trekkies in the café, and handle his own bandwidth and compute bills for delivering his content to all his fans.

Bonus: the fact he's posting from @[email protected] acts as a pretty solid cast iron guarantee of authenticity, that you are dealing with the one and only actual Wil Wheaton.

Meanwhile, Stephen King is sat at the café down the road trying to figure out why the new owner there wants him to pay him $8 a month to have the owner keep telling people who walk in 'yep, that's the real Stephen King over there'.

Re:Scaling Mastodon Is Impossible by dredmorbius on Tuesday November 15, 2022 @02:39PM (#33613922)
If the cafe advertises itself for all, and as a kinder, gentler, happier, more ethical, and safer place than BigCafe, then ... at least some of the onus is on the cafe owner(s), creator(s), and operator(s).

I've been on Mastodon since 2016. I enjoy and appreciate it. I admire the goals.

But much of the "it's intrinsically better / safe / scalable" talk seems based on little more than hope and faith, rather than evidence and engineering.

And given the Fediverse's own protocols, operating out of MyCafe rather than SafeCafe or BigCafe ... only provides modest additional protections. Yes, it helps assert identity more effectively (as I've previously noted: <https://news.ycombinator.com/item?id=33512169>), but it only solves a small portion of the abuse, trust, and safety concerns. Mechanisms simply are not yet sufficiently robust for a large-scale (100m -- billions of MAU) social network.

Some of that will come in time, though I've concerns that there are weaknesses that have already been baked into the underlying architecture and assumptions.

Re:Scaling Mastodon Is Impossible by WorldMaker on Tuesday November 15, 2022 @03:49PM (#33614812)
Celebs likely need to pay instances directly for their traffic they generate and the admin overhead of any Reports they get. They likely need to pay for personal instances that someone entirely controls for them. It may take a while for this knowledge to disseminate, and it is unfortunate Wil Wheaton was the early adopter that ran ahead of such knowledge.

To my understanding, there were further complicating factors involved beyond just "scaling":

- At the time I heard that the mastodon.cloud instance admins and moderators spoke English as a second language (it was started to primarily focus on Japanese Mastodon, to my understanding), which added an accidental language barrier to the challenge of moderating that many reports (and being able to seek out a "root cause of the griefers")

- I still don't know how to make sense of the whole counter.social thing and Wil's supposed involvement there (which happened before the mastodon.cloud incident). I think it was partly a scam that accidentally honey trapped Wil with very bad timing, but he doesn't refer to it directly in his own account, only obliquely, so I don't think we know an answer for sure. (Only what I observed in federated Meta drama from a tiny instance at the time.) But to my understanding it still relates to some of the root causes of some of the grievances. (counter.social is a now entirely defederated instance with alt-Right associations and markets itself as "safe" and "secure" and "celebrity friendly" and "InfoSec focused" and is run by an admin referred to most commonly as "The Jester", seemingly somewhat in homage to/love for Batman's nemesis The Joker.) I can't imagine knowing the full facts ahead of time that Wil would have ever chosen to associate with that sort of instance on purpose, but I can understand (some) of why once accidentally associated with that sort of instance it caused some lasting grievances.

Re:Scaling Mastodon Is Impossible by dredmorbius on Tuesday November 15, 2022 @10:12PM (#33618348)
Agreed both that celebs need specifically tuned/managed instance(s), and that that knowledge will likely diffuse poorly.

My understanding is that Mastodon.cloud's admin was a native German speaker. The instance was subsequently purchased by a Japanese firm. (I left during this process due both to dissatisfaction with the WW incident and lack of clarity on the transfer.)

WW had nothing to do with CounterSocial AFAIU. As the link I'd provided above shows, he'd been on mastodon.cloud at the time: <https://mastodon.cloud/@wilw/100635779449174251>

That said, I'm frankly not familiar w/ CounterSocial, though it appears to be a Mastodon fork:

<https://counter.social/license.html>

Re:Scaling Mastodon Is Impossible by WorldMaker on Tuesday November 15, 2022 @11:13PM (#33618748)
My understanding was (and again, I mostly have more confusion than specific answers and was mostly only observing all this as a tiny instance admin listening to other instance admins I trusted):

- counter.social's admin "The Jester" was the "InfoSec expert to the stars" that was behind at least one of the post-GamerGate blocklists for the safety of celebrities that Wil had been recommending to other celebrities and because of that Wil had some sort of (para)social relationship with The Jester, at least on Twitter.

- In 2017 (nearly a full year before the mastodon.cloud incident), The Jester allegedly convinced Wil to join counter.social (or deeply faked an account for him on counter.social). [1]

- That @[email protected] account went viral on Mastodon among instance admins because up until that point counter.social was only a weakly federated instance few were familiar with/"no one had heard of".

- counter.social going viral brought a lot of scrutiny on counter.social. It was quickly found to be full of accounts of transphobes and racists and worse.

- This lead to a public re-examining of The Jester's Twitter blocklists. Those blocklists were found to be themselves biased towards transphobia and subsequently celebrities were asked to disassociate with The Jester and stop using his blocklists.

- Most Mastodon instance admins I trusted blocked/defederated from counter.social in the middle of these events in 2017. (For what it was worth, I made the same decision and also blocked it.)

- I still don't think this association with counter.social was intentional by Wil. This part is mostly my speculation: It sounded like "InfoSec expert to the stars" The Jester had been trying to get any celebrity to take the bait to join Mastodon via his instance and it was a bit of an intentional honey pot trap from someone who had built up a "trustworthy" reputation on Twitter taking advantage of the consequences of GamerGate to build that reputation and only with hindsight seems to have been doing that "for the lols" and was pro-GamerGate while pretending to be anti-. (That era GamerGate of Twitter was a different time and wilder place. Hard to imagine people not having immediate paranoid reactions to someone calling themselves "The Jester" today, but hindsight is 20/20 and easy to armchair quarterback when not in the middle of the stress of it all.)

[1] The best receipt I have found so far is mastodon.social's ancient copy of the account profile and 2017 pinned intro post: https://mastodon.social/@[email protected] (this is also what I saw on my own instance at the time and matches what my instance still shows; I don't trust counter.social enough to see if permalinks track all the way back into that instance's own slimy history.)

(ETA: Also, sadly counter.social has been in the Mastodon news again lately because new people in this massive wave of Twitter users looking for a Twitter alternative have been duped into thinking counter.social is a "safe" alternative to Twitter and not a Gab-like haven for trolls.)

Re:Scaling Mastodon Is Impossible by dredmorbius on Wednesday November 16, 2022 @01:21AM (#33619570)
I appreciate the backstory. I was unaware of much of this.
Re:Scaling Mastodon Is Impossible by WorldMaker on Wednesday November 16, 2022 @03:39PM (#33630184)
Yeah, it's a weird backstory and I recall 2017 was a relatively quiet year between the big 2016 and 2018 waves of Mastodon adoption so a lot of this tale has already passed into as much "Mastodon legend" as remembered history. Plus, with so many questions left open over how it happened and why it happened that presumably for good reason don't exist in open blogs about the incidents, it's still an incomplete history and that makes it even tougher to bring it to people's awareness without sounding either conspiratorial or a grudge of some sort. (I hope I did alright in my telling of it. I certainly tried not to sound too accusative of the presumed innocent.) It is such an unfortunate thing that happened for everyone involved at the time.
Re:Scaling Mastodon Is Impossible by hinkley on Tuesday November 15, 2022 @11:23AM (#33611181)
> ‘Federate with our servers and we’ll pay you 1c for every message you allow us to post to your users…’

Isn’t that a protection racket?

Re:Scaling Mastodon Is Impossible by jameshart on Tuesday November 15, 2022 @09:18PM (#33618014)
I see you've interacted with the adtech industry before.