News for hackers. Stuff that matters.
Re:How Shadow Banning Can Silently Shift Opinion Online by brightball on Tuesday May 21, 2024 @11:43AM (#40429916)
I saw Mark Cuban advocating for any platform which shows content to children to be required to publish their algorithm. IMO it is the most logical approach to the entire discussion.
Re:How Shadow Banning Can Silently Shift Opinion Online by saalweachter on Tuesday May 21, 2024 @11:59AM (#40430178)
Just out of curiosity, what do people mean when they say "publish the algorithm"? A poster-sized UML diagram? A million lines of spaghetti code saying "if foo > 11.78 then bar += 2.6"? An exhaustive design document exactly specifying the entire ranking system (which absolutely does not exist at any company)? The ranking signals the algorithm operates on?
Re:How Shadow Banning Can Silently Shift Opinion Online by asah on Tuesday May 21, 2024 @12:07PM (#40430288)
speaking practically, I'd start with open source repo and (somehow) a chain-of-custody proving that this is the (only) code that gets to production.
Re:How Shadow Banning Can Silently Shift Opinion Online by vasco on Tuesday May 21, 2024 @12:59PM (#40430953)
You assume recommendation systems are mostly code. AI models depend mostly on data, not code, and AFAIK we can see activation functions for neurons but nobody actually can explain in->out for the global thing.
Re:How Shadow Banning Can Silently Shift Opinion Online by janalsncm on Tuesday May 21, 2024 @02:08PM (#40431751)
In other words, you won’t be able to tell the difference between a net that prefers pro-Chinese propaganda and one that prefers pro wrestling.

To make things worse, for 99% of people things might look normal but for 1% it may show a large skew. The net can have memorized this.

Re:How Shadow Banning Can Silently Shift Opinion Online by asah on Tuesday May 21, 2024 @07:31PM (#40435530)
I'm a bit more optimistic: the CI/CD pipeline can include adversarial model(s) which probes for the worst behavior. We already have codebases of sufficient complexity that attacks can be inserted into the software supply chain.

Obviously, this becomes an arms race. The usual strategy is to add random checks, friction to contribution and severe-enough punishments for offenders (lifetime RL bans, etc.)

Expert opinions welcome - I'm a tourist.

Re:How Shadow Banning Can Silently Shift Opinion Online by lupusreal on Tuesday May 21, 2024 @12:05PM (#40430261)
They should have to publish everything required to independently reproduce the recommendations, given a user's inputs. If their code is spaghetti that makes this neigh impossible, that's their problem and they shouldn't be in business.
Re:How Shadow Banning Can Silently Shift Opinion Online by gruez on Tuesday May 21, 2024 @12:41PM (#40430738)
>They should have to publish everything required to independently reproduce the recommendations, given a user's inputs.

So they also have to give up all their user data?

Re:How Shadow Banning Can Silently Shift Opinion Online by lupusreal on Tuesday May 21, 2024 @02:06PM (#40431734)
> given a user's inputs

Meaning if I record my own inputs, I should be able to recreate the suggestions I see using the published software. This doesn't mean the inputs of other users are exposed to me, but it does imply that "the algorithm" can only use data that is either publicly exposed or is my own inputs.

Re:How Shadow Banning Can Silently Shift Opinion Online by gruez on Tuesday May 21, 2024 @02:18PM (#40431887)
>but it does imply that "the algorithm" can only use data that is either publicly exposed or is my own inputs.

That seems pretty restricting given that even the most basic recommendation would try to cluster users based on interests and use that to recommend stuff (eg. Amazon's "customers who viewed this item also bought..." from decades ago).

Re:How Shadow Banning Can Silently Shift Opinion Online by janalsncm on Tuesday May 21, 2024 @02:10PM (#40431774)
“The inputs” here is going to include every video, or at least a large subset of every video.
Re:How Shadow Banning Can Silently Shift Opinion Online by lupusreal on Tuesday May 21, 2024 @04:21PM (#40433380)
The videos themselves are public, and I think it would be good for all the relevant video metadata to be public as well.
Re:How Shadow Banning Can Silently Shift Opinion Online by brokenmachine on Wednesday May 22, 2024 @07:48PM (#40448393)
Also how long a user spent watching each individual video, and what order they were watched in.

That would be very hard/impossible to recreate in order to test the algorithm.

Re:How Shadow Banning Can Silently Shift Opinion Online by munksbeer on Thursday May 23, 2024 @04:44AM (#40452174)
> Just out of curiosity, what do people mean when they say "publish the algorithm"?

In whatever form it takes such that a regulator can scrutinise it. If that seems arduous or impacts the social media business model, too bad. Nothing of value will have been lost. I am not typically a person who favours over regulation, even my views on AI are likely too liberal for HN, but on the matter of social media impacting children, I'm all in for regulation.

Re:How Shadow Banning Can Silently Shift Opinion Online by cortesoft on Tuesday May 21, 2024 @12:28PM (#40430576)
I feel like this sort of idea is one of those that sounds great until you actually start to think about it.

If you publish your algorithm, you are giving interested parties the instruction manual on how to game it; spammers and propagandists can use that algorithm to make sure their content gets to the top.

Re:How Shadow Banning Can Silently Shift Opinion Online by InvisGhost on Tuesday May 21, 2024 @12:31PM (#40430610)
Instruction manuals make it easy to game it but people can still game it without an instruction manual. This seems similar to the idea of security through obscurity. The same argument could be made about linux, right?

Letting people see into it could make it easier for people to learn how to game the system but it could also make the system harder to game in the first place.

Re:How Shadow Banning Can Silently Shift Opinion Online by gruez on Tuesday May 21, 2024 @12:45PM (#40430792)
The "security by obscurity is bad" mentality works in cases where issues are easy to fixed when identified. Most bugs fit in this category. It's doubtful this applies to recommendation algorithms. If you know which factors are most important in making a post go viral, and a bad actor exploits this, how are you supposed prevent them from doing so?
Re:How Shadow Banning Can Silently Shift Opinion Online by biftek on Tuesday May 21, 2024 @12:01PM (#40430204)
Sounds good in theory but how many people are actually qualified to interpret those algorithms? Average Joe on facebook is going to believe it does what ever Bob tells him it does.
Re:How Shadow Banning Can Silently Shift Opinion Online by Intralexical on Tuesday May 21, 2024 @02:23PM (#40431958)
> Sounds good in theory but how many people are actually qualified to interpret those algorithms?

Enough researchers, at enough institutions with sufficiently diverse motives, that if multiple of them identify a problem and agree about it, Joe can make a reasonably confident assessment that there's probably something there.

Re:How Shadow Banning Can Silently Shift Opinion Online by cortesoft on Tuesday May 21, 2024 @12:03PM (#40430229)
Knowing the algorithm doesn't help much... you wouldn't know the data that is going into the algorithm, and you would have no way of proving they were actually using said algorithm.
Re:How Shadow Banning Can Silently Shift Opinion Online by _factor on Tuesday May 21, 2024 @12:39PM (#40430699)
Right, if my algorithm stores weights based on recent input data, the execution path will vary.
Re:How Shadow Banning Can Silently Shift Opinion Online by vasco on Tuesday May 21, 2024 @11:57AM (#40430142)
The problem is the "algorithm" should be a timestamp reverse sorted list of whoever they follow.

They will make less ad money and engagement will go down because we won't be training children to become 5 second scrollers, but this doesn't seem like an issue to me.

Re:How Shadow Banning Can Silently Shift Opinion Online by cortesoft on Tuesday May 21, 2024 @12:01PM (#40430201)
This would be a horrible experience. Do you only view hackernews through the "new" feed? Or do you prefer to view the front page that has had an "algorithm" applied.

How would new content discovery happen in your proposed world?

Re:How Shadow Banning Can Silently Shift Opinion Online by biftek on Tuesday May 21, 2024 @12:05PM (#40430266)
Maybe you're too young to remember or there's some sarcasm I'm missing, but that's literally how social media sites used to work.

Content discovery was word of mouth or a separate page dedicated to popular stuff.

Re:How Shadow Banning Can Silently Shift Opinion Online by cortesoft on Tuesday May 21, 2024 @12:26PM (#40430557)
I am in my 40s, so certainly not too young. Depending on how you define social media, they have had sort order besides 'latest posts first' for about as long as listing sites have existed.

There is no sarcasm; does anyone genuinely only browse sites like hackernews by viewing the 'new' page? That is what the comment is advocating, that the only view should be the new page, with submissions listed by post date only.

If discovery is by a separate page dedicated to popular stuff, how is that any better? Whatever 'algorithm' is used to create that page would have the same problems that people are complaining about; why would putting it on a different page change anything? That is sort of how things are currently; you can view a feed by 'latest first' or by the 'algorithm'. You can choose either one, but most people prefer the algorithm version because it curates.

People WANT curation. You can argue with the particular type of curation, but I think the concept itself is pretty universally desired.

Re:How Shadow Banning Can Silently Shift Opinion Online by biftek on Tuesday May 21, 2024 @01:01PM (#40430982)
Yea maybe our definitions are just different, because I wouldn't call HN a social media site. It's a content aggregator to me, with some social features, like Reddit or Slashdot.

Look at Instagram, Twitter, or Facebook, I believe there is a desire for a less algorithmic approach on those sites, hence all the uproar about the algorithms and shadow banning. Reverse chronological ordering from people you follow was the standard before, and a feature before revenue mattered as much. You curated your own feed by following people, not by a black box

Re:How Shadow Banning Can Silently Shift Opinion Online by cortesoft on Tuesday May 21, 2024 @09:15PM (#40436305)
I think HN fits the standard definition of a social media site:

> Social media are interactive technologies that facilitate the creation, sharing and aggregation of content, ideas, interests, and other forms of expression through virtual communities and networks.

Hacknews is one virtual community. The whole point of visiting the site is to aggregate content and read and make comments about that content.

Reddit and slashdot are also both social media sites.

https://en.wikipedia.org/wiki/Social_media

Re:How Shadow Banning Can Silently Shift Opinion Online by pjc50 on Tuesday May 21, 2024 @12:08PM (#40430309)
Ranking has been a thing since at least Slashdot. There is simply too much stuff for most people to go back to pure chronological only.
Re:How Shadow Banning Can Silently Shift Opinion Online by gunapologist99 on Tuesday May 21, 2024 @12:27PM (#40430566)
> Maybe you're too young to remember

An ad hominem attack doesn't seem necessary to prove your point (speaking as someone who actually is old enough to remember).

Re:How Shadow Banning Can Silently Shift Opinion Online by biftek on Tuesday May 21, 2024 @12:49PM (#40430836)
Sorry wasn't meant as an attack, the algorithm based feeds of instagram and twitter are almost a decade old now, and I believe facebooks older.

There are definitely people in the tech field who have only (or mostly) experienced algorithmic based feeds.

Re:How Shadow Banning Can Silently Shift Opinion Online by vasco on Tuesday May 21, 2024 @12:31PM (#40430609)
This specific thread is about children. Children might also want to drink alcohol but we have laws against that.

If there's a need to provably ensure kids are not being influenced by algorithm, I think my solution works. Making social media less engaging for children is something I'm fine with. Adults can have whatever experience they want.

Re:How Shadow Banning Can Silently Shift Opinion Online by cortesoft on Tuesday May 21, 2024 @12:42PM (#40430744)
It seems strange to me to think that the algorithm is the only issue with kids and social media.
Re:How Shadow Banning Can Silently Shift Opinion Online by vasco on Tuesday May 21, 2024 @12:47PM (#40430807)
I don't, but this is what this topic is about. Open another one and I can share my opinions about that. I don't even think "publishing algorithms" is feasible, so my point is if you want to do this for adults, I disagree, if you want to do it for children, I don't disagree, but would rather just simplify the experience for them because its easier to prove the mechanism.
Re:How Shadow Banning Can Silently Shift Opinion Online by vundercind on Tuesday May 21, 2024 @12:09PM (#40430327)
The front page of a site that’s the same for everyone (more or less) is different from individualized feeds.

> How would new content discovery happen in your proposed world?

Seconding other posts—entirely fine, like it did before that kind of garbage.

Re:How Shadow Banning Can Silently Shift Opinion Online by lupusreal on Tuesday May 21, 2024 @12:07PM (#40430290)
Last I checked, HN has published it's algorithm. Probably out of date now I suppose, but it proves the premise. Slashdot also used to.
Re:How Shadow Banning Can Silently Shift Opinion Online by cortesoft on Tuesday May 21, 2024 @12:19PM (#40430464)
The comment I replied to said that the only algorithm should be sorted by reverse post date, so it doesn't matter that the algorithm is published or not.
Re:How Shadow Banning Can Silently Shift Opinion Online by krapp on Tuesday May 21, 2024 @12:12PM (#40430367)
Hacker News doesn't publish anything. It's based on Arc Forum, but YCombinator has made numerous undocumented changes and it may as well be a proprietary fork at this point.

Also a part of HN's "algorithm" is literally the mods manually adjusting things, and you can't publish that.

Re:How Shadow Banning Can Silently Shift Opinion Online by vundercind on Tuesday May 21, 2024 @12:00PM (#40430187)
Doing almost anything else with a “feed” should expose a company to liability for anything they elect to promote, I’d say.
Re:How Shadow Banning Can Silently Shift Opinion Online by klyrs on Tuesday May 21, 2024 @12:37PM (#40430670)
The best conversations I've had online have been on phpBB forums which would be destroyed by this algorithm.
Re:How Shadow Banning Can Silently Shift Opinion Online by vasco on Tuesday May 21, 2024 @12:45PM (#40430784)
Forums are literally this, only aggregated by topic / title.
Re:How Shadow Banning Can Silently Shift Opinion Online by klyrs on Tuesday May 21, 2024 @03:04PM (#40432473)
You're not wrong! However, your original proposal was to only allow sorting by time; which forbids aggregation into threads.
Re:How Shadow Banning Can Silently Shift Opinion Online by AlexandrB on Tuesday May 21, 2024 @11:49AM (#40430017)
Why limit it to sites that show content to children?
Re:How Shadow Banning Can Silently Shift Opinion Online by lupusreal on Tuesday May 21, 2024 @12:08PM (#40430314)
It makes for a more realistic proposal that is more likely to survive legal scrutiny.
Re:How Shadow Banning Can Silently Shift Opinion Online by dmix on Tuesday May 21, 2024 @11:49AM (#40430012)
That would be great, never going to happen.
Re:How Shadow Banning Can Silently Shift Opinion Online by nradov on Tuesday May 21, 2024 @11:58AM (#40430164)
Sounds good. I'm sure the Chinese Communist Party would be entirely truthful and never "accidentally" run a different algorithm on the TikTok servers.
Re:How Shadow Banning Can Silently Shift Opinion Online by digital_sawzall on Tuesday May 21, 2024 @12:27PM (#40430564)
The 'TikTok servers' are actually Oracle servers hosted in the USA.
Re:How Shadow Banning Can Silently Shift Opinion Online by gruez on Tuesday May 21, 2024 @12:46PM (#40430798)
I thought that deal fell through?
Re:How Shadow Banning Can Silently Shift Opinion Online by vasco on Tuesday May 21, 2024 @01:06PM (#40431043)
Did you read Project Texas goals? I don't think there's a better way to do it. I don't know insider details but when I heard Shou Zi Chew explain it and I read the plan, I think it'd be easy for the US to have the assurances it needs.
Re:How Shadow Banning Can Silently Shift Opinion Online by Analemma_ on Tuesday May 21, 2024 @11:54AM (#40430091)
I'm not opposed to "open algorithm requirements" on social media sites, but the chattering about them is starting to remind me of back when we thought real-name requirements might fix toxic behavior online, until YouTube and Facebook implemented them and found that, no, they absolutely do not: people will happily be despicable under their real names too. It seems to me like something people are desperately grasping for in the naive hope that there's a quick-and-easy fix to the endemic problems of human nature.

X/Twitter does now publish their algorithm, and it hasn't made it any less of a shithole.

Re:How Shadow Banning Can Silently Shift Opinion Online by giantg2 on Tuesday May 21, 2024 @12:02PM (#40430218)
I agree. Most people just want the quick and easy fix regardless of efficacy. Make them show the algorithm, some other entity will review it for you and tell you if you should be outraged or not, you continue using the site while complaining about the changes that need to happen. The most effective method is to severely limit or elimate your own (or kids) usage. But creating your own standards and standing by them seem to be out of favor these days (integrity and self control). It's all about FOMO and consumption.
Re:How Shadow Banning Can Silently Shift Opinion Online by jarjoura on Tuesday May 21, 2024 @12:41PM (#40430736)
The algorithm isn’t really the problem if the content itself isn’t made accessible. The moderators could just remove content they disagree with and that’s more than enough power.

The engagement ranking done to keep you hooked is probably not that interesting.