News for hackers. Stuff that matters.
Re:The Fediverse is an opportunity learned societies can't i... by calamari4065 on Sunday December 03, 2023 @08:55PM (#38512868)
I'm not sure how much you actually know about this stuff, but this take reads like you fundamentally don't understand the subject.

Most of the problems you pose exist with every social media platform, and only get worse as scale goes up. We can all agree that as user count goes up, abuse and moderation scales as well.

A centralized platform takes all of that moderation load at once. You need a team of people or some crazy moderation software that doesn't work. Abuse runs rampant as the company doesn't want to invest in proper moderation. We see that on twitter, Facebook, tumblr, all of them.

The fediverse aims to solve this problem by limiting scale. Smaller communities are easier to moderate. We see this with forums and chat rooms. When the community is small, they tend to self-police more. People tend to self-identify with that community and actively protect it.

But small communities are small and don't reach far. So we connect these small communities into larger networks. The implementation details of that are IMO pretty much irrelevant, but to answer your question: posts are duplicated throughout the network. Each server caches copies of all incoming posts to serve them directly to their local users. There are downsides to this approach, but the positive is that it crudely balances server load across the network.

Bad actors aren't much of a concern. If you start a server that just blasts spam into the fediverse, the network will quickly drop you. Individual servers have the option to refuse connections from other servers or domains. Server admins actively network with each other to warn of malicious servers. So far it's been incredibly effective.

As a user, you also have the option to block servers or other users. You also have extensive filtering options so that you can effectively moderate your own timeline.

And of course, there's also the drama between server admins blocking each other and harming users by cutting them off from part of the network. The solution I chose was to start up my own server. It took a weekend and operates exactly the same as the big instances I've been on.

When a server shuts down, users can move elsewhere. You can keep all your follows and followers, but lose your post history. That's obviously not ideal, but what were you able to keep when MySpace closed down? It's not perfect, but you can still keep going. Plus there are limited workarounds, but that's not important.

The fediverse has problems, but not the ones you pose.

Ask yourself how one scales a website to tens of millions of users. It's pretty complicated, right? Lots of servers and load balancers and whatever else.

But what about a website for a thousand users? Ten thousand? That's much more doable. That's just a single machine. The magic of federation is linking ten thousand websites run by volunteers that each host only a thousand users into a more or less cohesive network.

No matter which node in the network your account belongs to, you get roughly the same experience. No one has to spend millions filling up a datacenter. Most servers are run on donations from users or out of their admin's pocket. It doesn't cost too terribly much unless you're serving thousands of users.

When one server goes down, even a very large server, the network stays intact and absorbs the load and the users as they migrate. When a server with tens of thousands of users shuts down, we don't see a dramatic drop in total network users. Nearly all of them just move. This makes the network very resilient. No one person can do any meaningful damage to the network as a whole.

Fediverse is far from perfect. And I agree that it won't be a monetized ad- and celebrity-friendly platform like Facebook or twitter. But that's fundamentally misunderstanding what and why it is.

The fediverse is the next logical step from hundreds of small isolated forums. People built and use federated services because they want small communities driven by and for people who simply want to talk to other people. Nothing more, nothing less. It's not going to grow to encompass billions of users because that's simply not the goal.

The goal of the fediverse is simple: give people a place to talk and share with each other that is controlled exclusively by people who want the same thing. No money, no tracking, no corporations, just people talking to other people.

Everyone I know on mastodon is perfectly happy with the way things are. We see a very stable network with slow and steady growth. That's pretty much all we want or need.

Re:The Fediverse is an opportunity learned societies can't i... by shagie on Monday December 04, 2023 @12:28AM (#38514010)
> Each server caches copies of all incoming posts to serve them directly to their local users. There are downsides to this approach, but the positive is that it crudely balances server load across the network.

https://mastodon.social/@jwz/109411593248255294 (safe to link to - and its following page via mastodon)

> Every time I do a new blog post, within a second I have over a thousand simultaneous hits of that URL on my web server from unique IPs. Load goes over 100, and mariadb stops responding.

> The server is basically unusable for 30 to 60 seconds until the stampede of Mastodons slows down.

> Presumably each of those IPs is an instance, none of which share any caching infrastructure with each other, and this problem is going to scale with my number of followers (followers' instances).

Re:The Fediverse is an opportunity learned societies can't i... by account42 on Monday December 04, 2023 @11:05AM (#38518950)
Which URL is the one getting hammered? The HTML blog post? Or some ActivityPub resource? Why do all requests need to hit the database instead of being served by a (micro) cache?

Is there anything besides the inbox endpoint that actually needs to be real-time dynamic?

Re:The Fediverse is an opportunity learned societies can't i... by creer on Sunday December 03, 2023 @10:18PM (#38513345)
So this is one thing that I don't understand:

> No matter which node [...] you get roughly the same experience.

How do you mean this? Besides HN, I'm on some big guys, a few discords, and some private groups. Some of the big guys delegate moderation to private participants in each sub-forum - of course. NO TWO of these have the same rules. Not even close. Some have fundamentally different basic rules of conduct. Many of the moderators enthusiastically want to block "the bad guys" but they mostly agree to each other's label on that in spite of their rules being all different. Basically if someone was lynched by some other group, that's good enough for them.

I'm willing to be amazed that it works but for now I do not believe that two of these systems actually will agree long term to use the other guy's forum rules.

Re:The Fediverse is an opportunity learned societies can't i... by calamari4065 on Thursday December 07, 2023 @06:27PM (#38563222)
When you move an account between servers, you also move your following list. Your new account follows all the same accounts and your home timeline is identical between accounts.

Of course the local and federated feeds are different, but those are local to the server and will always be unique.

What you're describing is drama, which is pretty easy to ignore.

My previous server got wrapped up in some ridiculously inane large-scale drama that I couldn't avoid. So I started my own server and moved everything over. I still see all the same posts from the same people and they still see mine. It's all exactly the same except for the local and federated feeds.

Re:The Fediverse is an opportunity learned societies can't i... by creer on Wednesday December 13, 2023 @07:09PM (#38636083)
As I read you, when you switch server, you still see your favorite people's own independent writings (the kind of thing HN posts link to). And perhaps their own local responses? And you give up the discussion threads or groups that are between the members of this or that server and moderated by the corresponding server people? These discussions are just among one server's members? Isn't that a rather small group?
Re:The Fediverse is an opportunity learned societies can't i... by jmyeet on Sunday December 03, 2023 @11:42PM (#38513812)
> Most of the problems you pose exist with every social media platform, and only get worse as scale goes up.

It's the opposite. We have monolithic services because all of these problems benefit from scale. Is it easier to build one system for site safety and the ability to report illegal content or to build more than one?

> Each server caches copies of all incoming posts to serve them directly to their local users. There are downsides to this approach, but the positive is that it crudely balances server load across the network.

It doesn't load balance anything. It just multiplies the work, particularly given that any such service is going to have a long tail of low-distribution content. Are you going to replicate that preemptively? Or cache-on-demand? If it's the first, it's more work. If it's the second, it's not clear it actually works and certainly adds propagation delay. By this I mean, you can't really produce a feed of content you don't have, for example.

> If you start a server that just blasts spam into the fediverse, the network will quickly drop you.

Famously, POTS has no issue with spam because of this.

> Bad actors aren't much of a concern.

Just like POTS, just like email, just like SMS.

> As a user, you also have the option to block servers or other users.

Blocking servers makes as much sense as blocking a country on Twitter would.

> But what about a website for a thousand users? Ten thousand?

But it's not. You still have to deal with all the traffic from the rest of the network. Otherwise, what are you displaying to your users?

> Fediverse is far from perfect.

It's completely unworkable, offers no value proposition to users, is more expensive to implement and is way more complex.

Re:The Fediverse is an opportunity learned societies can't i... by mariusor on Monday December 04, 2023 @03:14AM (#38514869)
> Blocking servers makes as much sense as blocking a country on Twitter would.

That's not really the case. Blocking a user is done when the user is mallicious, blocking a server is done when the sysop is malicious, the server is host to bad behaviour, used for spam, etc. Domains and IP's are blocked in SMTP all the time, and the fediverse is just email with social elements attached to it.

Re:The Fediverse is an opportunity learned societies can't i... by OfSanguineFire on Monday December 04, 2023 @07:15AM (#38516339)
The founding generation of the fediverse may operate with definitions of “sysop is malicious” and “bad behavior” that make little sense to most of the world. For example, back when centralized blocklists were still in vogue, some insisted that servers that failed to ban discussion of libertarianism, ought to go on the blocklist. For whatever reason, some of the founding generation see libertarianism as beyond the pale, as equal to fascism or hate speech. Even as someone who has been annoyed for decades by the libertarian idealism occasionally encountered on nerd forums, that strikes me as a bizarre policy.
Re:The Fediverse is an opportunity learned societies can't i... by calamari4065 on Thursday December 07, 2023 @07:02PM (#38563580)
>It's completely unworkable, offers no value proposition to users, is more expensive to implement and is way more complex.

And yet we still have thriving communities with tens or hundreds of thousands of people who are all pretty happy and satisfied with the way things are.

Because you don't understand what the value is doesn't change the fact that a ton of people do find it valuable. Calling mastodon a failed platform is laughable when we have so many people who enjoy it. I mean that literally, it's a running joke and we all laugh at takes like this. We even have memes about it.

The value proposition is actually quite simple: it's small, it's decentralized, theres no algorithm, it's wholly independent of corporate or advertiser influence, and it's full of people who value those things highly. It is the antithesis of centralized corporate social media, built by and for people who find the modern corporate web intolerable.

What you're complaining about is ActivityPub. It's bad, everyone knows it's bad, we talk about it all the time. There's a great deal of discussion and effort being put into improving it. It comes with some frustrations and odd behavior, but it's largely irrelevant to most users.

The fediverse in general has quite a lot of active users, and that count is growing slowly and steadily. Clearly these people find value and utility in these platforms. Claiming it's an unworkable platform with no value is objectively incorrect.

> Famously, POTS has no issue with spam

You should do some research into this claim.