News for hackers. Stuff that matters.
Re:The Centralized Internet Is Inevitable by fossuser on Monday October 19, 2020 @05:27PM (#24831221)
I think Urbit's approach here is actually pretty good.

Pseudonymous IDs that have a small, but non-zero cost.

Your reputation is tied to the ID and the economics don't allow spinning up millions of them to spam people.

They're building a from the feet up first principles approach to really solving the centralization incentive issues of the modern web and operating systems.

It's super ambitious, but I think it's pretty cool (and it's not vaporware, the current stuff actually works - it's just early on).

A lot of the other attempts at decentralized systems can't fix the server/client model or the spam problem - all which push users back to centralized services.

https://urbit.org/understanding-urbit/

Re:The Centralized Internet Is Inevitable by diggernet on Monday October 19, 2020 @06:54PM (#24831938)
Urbit is interesting, but this troubles me:

> there are only 2^32 (~4B) Urbit IDs, so they cost something.

> Ultimately, we want your Urbit ID to feel like a civilizational key. If your Urbit ID were a piece of hardware, you could tap it to unlock a door, swipe it to buy a coffee, and plug it into any computer to log in. Your Urbit ID should be a unique, beautiful object that’s both an address and a wallet. It’s a key to a secret club and the ticket to your digital life.

So I guess almost half the current global population is excluded from civilization?

Re:The Centralized Internet Is Inevitable by jlehman on Monday October 19, 2020 @09:00PM (#24832967)
Apparently it's taken us ~30 years to come close[1] to this number of users on the current internet. Seems like not an issue for a very long time, and if it becomes one, it can be amended.

That said, anyone can get on Urbit for free as a comet. The only real limitations on comets are social in nature—not technological.

[1]https://en.wikipedia.org/wiki/List_of_countries_by_number_of...

Re:The Centralized Internet Is Inevitable by fossuser on Monday October 19, 2020 @08:32PM (#24832705)
They talk about that - if they're approaching the limit they'd make changes to produce more IDs.

The network has a built in governing body that can do things like that (and they would since restricting access isn't the goal).

Re:The Centralized Internet Is Inevitable by tremon on Tuesday October 20, 2020 @06:31AM (#24835794)
But if the number of available Urbit IDs can be scaled up and down on an as-needed basis, why did they start with 4B and not, for example, 1M?
Re:The Centralized Internet Is Inevitable by rtkwe on Tuesday October 20, 2020 @09:42AM (#24837165)
32-bits is just a convenient round number to wrap everything around.
Re:The Centralized Internet Is Inevitable by rtkwe on Monday October 19, 2020 @05:37PM (#24831307)
I like the idea but it does seem like you're setting up a poll tax to participate fully in the internet, simultaneously having it high enough to deter or at least raise the bar on scams and low enough to be affordable to the whole world is a hard ask.
Re:The Centralized Internet Is Inevitable by fossuser on Monday October 19, 2020 @05:42PM (#24831348)
They have free IDs too, but groups can block them to reduce spam.

The free IDs have some other negatives too I think (long names, harder to recover, etc.).

The price is quite low ~$10 for a 'planet' or standard ID. Maybe in the developing world that price is too high, but I'd suspect if it succeeded to the point where that was an issue it could be solved without too much trouble.

The ID solution is cool because it fixes the spam issue which is one of the core incentives behind centralization.

The other core reason to centralize is server management and finding other users. If you design an OS that has this bit baked into it from the start you can make this complexity invisible to the user. You can have apps be p2p by default without the user having to know about it, you can make it easy for users to send photos or messages directly to each other rather than always having to interoperate with a middleman company (FB, Google etc.).

Their approach of starting as a VM that runs in linux is a good idea, it allows iteration on something that's immediately usable. Their initial focus on chat too I think is smart - it gets people using it while they improve it and immediately seeing changes.

Long term goal would be getting urbit running on its own hardware without the virtual layer, but I think if they started trying to do that they wouldn't succeed. With the current approach they might.

Re:The Centralized Internet Is Inevitable by AnthonyMouse on Monday October 19, 2020 @06:16PM (#24831642)
> I like the idea but it does seem like you're setting up a poll tax to participate fully in the internet, simultaneously having it high enough to deter or at least raise the bar on scams and low enough to be affordable to the whole world is a hard ask.

It's not actually that hard, because ordinary users can generate one ID and use it for many years, but spammers have to generate a new ID every five minutes because they immediately get blocked and have all content associated with the blocked IDs get retroactively dumped in the spam folder. So the cost to spammers is literally a million times higher than it is for ordinary users, which is exactly the sort of thing that actually works.

Re:The Centralized Internet Is Inevitable by rtkwe on Monday October 19, 2020 @06:47PM (#24831876)
It's still important to think about how much $10, the current Urbit ID price, represents in some parts of the world. The World Bank has a poverty line of ~$3-4 per day and over half of India lives (or did in 2017) on less than that and the official rural poverty line is around $6-7 a month. If we're setting up the next internet we really shouldn't be locking out anyone due to price.
Re:The Centralized Internet Is Inevitable by AnthonyMouse on Monday October 19, 2020 @09:30PM (#24833149)
Even for someone living on $3/day, paying $10 once every ten years represents 0.09% of their income. You could also plausibly impose alternative costs, like making someone solve captchas for an hour. Then people in rich countries pay $10, people in poor countries spend an hour (which to them is significantly less than $10 of their time).
Re:The Centralized Internet Is Inevitable by ddalex on Tuesday October 20, 2020 @04:37AM (#24835105)
that's like 500-1000 USD for the average middle class american - a steep price to pay for a membership with no obvious benefits

I wonder why can't score IDs by page-rank them - one's identity gets credibility based on the social score - hacker news manages to be quite effective at preventing spam using this technique

Re:The Centralized Internet Is Inevitable by AnthonyMouse on Tuesday October 20, 2020 @10:17AM (#24837542)
> that's like 500-1000 USD for the average middle class american

Which would be $50-$100/year, i.e. still not very much.

Recall that it costs significantly more than that to have internet access.

> a steep price to pay for a membership with no obvious benefits

The obvious benefit being that you get to be in the same network as the people in rich countries, and that network is not overrun by spam or controlled by a multinational conglomerate that uses its ownership of the means of communication to cost you significantly more than $10.

> I wonder why can't score IDs by page-rank them - one's identity gets credibility based on the social score - hacker news manages to be quite effective at preventing spam using this technique

What do you do with new IDs that have no reputation? If they can't post they can't earn a reputation, if they can post they can spam.

Re:The Centralized Internet Is Inevitable by olah_1 on Monday October 19, 2020 @06:44PM (#24831858)
> So the cost to spammers is literally a million times higher than it is for ordinary users, which is exactly the sort of thing that actually works.

The law-abiding user is the one that incurs the real cost. Spammers pump and dump millions of IDs. This drives up the cost of getting an ID. The normal user that just needs a new ID for some reason is the one that suffers the most here.

I don't care if it's expensive for a scammer. If it's cost-prohibitive for grandma to get a new ID, then it defeats the purpose.

Re:The Centralized Internet Is Inevitable by Teever on Monday October 19, 2020 @05:35PM (#24831287)
Email spam could be almost totally eliminated if you had to send someone a 1-24c micro transaction for them to receive your mail.

Over the course of a year the costs to send would be balanced by the profit from receiving for your average person but for spammers it would be untenable.

Re:The Centralized Internet Is Inevitable by ghaff on Monday October 19, 2020 @06:31PM (#24831755)
Is email SPAM really a serious problem today? (Unless by SPAM you refer to marketing emails of various sorts that you agreed to in some manner and that provide an unsubscribe link.) Sure. Charging for emails would cut down on the volume some--and would eliminate the email that's occasionally interesting but I don't routinely read--but would also marginalize the use of non-commercial email for those with little money.
Re:The Centralized Internet Is Inevitable by fossuser on Monday October 19, 2020 @06:33PM (#24831773)
It's only not a problem because centralized megacorps solved it and everyone has to use them because of the spam problem.

If you're trying to come up with a model that isn't using centralized companies to solve the problem for you then it's still a problem.

Part of the incentive towards centralization is because the spam problem is hard to solve in a decentralized way with the modern web.

Re:The Centralized Internet Is Inevitable by jjav on Tuesday October 20, 2020 @02:20AM (#24834418)
> It's only not a problem because centralized megacorps solved it and everyone has to use them because of the spam problem.

Is this a perception or do you have data on this?

See my response to parent. Email spam from the point of view of self-hosted infrastructure is no longer a problem in my experience. No megacorps needed (or wanted, IMO).

Re:The Centralized Internet Is Inevitable by michaelt on Tuesday October 20, 2020 @06:43AM (#24835863)
The problem I had, when I tried to de-megacorp my e-mail, was with knowing whether the e-mails I sent got reliably delivered.

I set up SPF, DKIM, DMARC, used an IP not on any blacklists, and so on - everything guides told me I ought to do. Still, not only would my test messages often go to spam, I'm pretty sure I saw some vanish entirely, not even making it to the spam folder.

And this is a very insidious problem - did I e-mail X and they just didn't deign to reply? Or did my message never reach them?

Re:The Centralized Internet Is Inevitable by Snitch-Thursday on Tuesday October 20, 2020 @03:12PM (#24841251)
I wish there was a 1-step process for white-listing known good emails, for a single address, or a single domain, or a list of either.

I also wish there was a process for exporting/importing these lists.

With SPF/DKIM/DMARC (whichever of those verifies that the email header was actually set by someone who has access to that email sending address) on and open-relay on STMP turned off, I envision a web-of-trust-lite world (which is probably the wheel I'm reinventing) where I and everyone I exchange email-address-trust-cards like business cards help to crowdsource what is and is not spam based on shared whitelists and degree-of-separation weighting. If I think something is spam, my 1st degree of separation (who has handshaked with me to verify that yes we've met) also probably does, but his colleague, maybe not.

MUAs and online email service providers would check the compiled whitelist for each account before running their own spam filtering.

We have good online adblock lists, can we do the same for email spamlists without 27 clicks to whitelist or blacklist emails?

Servers would have to not blackhole spam-tripping emails and reply with 'you spam = bad', that is another problem entirely.

Re:The Centralized Internet Is Inevitable by umanwizard on Wednesday October 21, 2020 @01:54AM (#24845125)
Personal anecdote: I wrote my own email server; it has no spam blocking of any kind other than checking the Spamhaus blacklist. That gets me down to a spam message every few days at most.
Re:The Centralized Internet Is Inevitable by Teever on Monday October 19, 2020 @06:39PM (#24831808)
I've wondered how much spam filters actually cost in terms of compute resources and electricity.

I bet it's a lot. I bet there has to be a better way.

Re:The Centralized Internet Is Inevitable by edoceo on Monday October 19, 2020 @06:57PM (#24831962)
One tool I use is called greylog for postfix. Effective for me.
Re:The Centralized Internet Is Inevitable by ghaff on Monday October 19, 2020 @06:57PM (#24831965)
Totally fair. Though the only way to solve spam control in a decentralized way is probably to put in a system that no one will actually use.
Re:The Centralized Internet Is Inevitable by jjav on Tuesday October 20, 2020 @01:45AM (#24834252)
> Is email SPAM really a serious problem today?

Spam in email is basically not a problem anymore, in my experience.

~15 years I would get literally thousands of spam emails per day in my spam folder. But this was the days when email servers were configured to accept anything no matter how malformed. And many people had misconfigured smtp clients, thus attempting to enforce constraints would drop a lot of legitimate mail. So spam was a huge problem.

Today it's very different. I no longer see any smtp clients from legitimate senders with any protocol misconfiguration. So for years now I enforce every detail at the smtp connection level (with postfix), before the email is accepted.

I still see failed attempts in the postfix logs but they get blocked right there. Actual spam getting through to the spam filter is down to a few a week.

Then checking DKIM drops all of these in the spam folder.

Spam that gets through these steps to my actual inbox is now so rare that it's always a surprise. Less than ten a year, tops.

So from my perspective (running my own email infrastructure for a handful of domains, personal and business, friends and family) email spam is no longer a concern.