News for hackers. Stuff that matters.
Re:How Shadow Banning Can Silently Shift Opinion Online by saalweachter on Tuesday May 21, 2024 @11:59AM (#40430178)
Just out of curiosity, what do people mean when they say "publish the algorithm"? A poster-sized UML diagram? A million lines of spaghetti code saying "if foo > 11.78 then bar += 2.6"? An exhaustive design document exactly specifying the entire ranking system (which absolutely does not exist at any company)? The ranking signals the algorithm operates on?
Re:How Shadow Banning Can Silently Shift Opinion Online by asah on Tuesday May 21, 2024 @12:07PM (#40430288)
speaking practically, I'd start with open source repo and (somehow) a chain-of-custody proving that this is the (only) code that gets to production.
Re:How Shadow Banning Can Silently Shift Opinion Online by vasco on Tuesday May 21, 2024 @12:59PM (#40430953)
You assume recommendation systems are mostly code. AI models depend mostly on data, not code, and AFAIK we can see activation functions for neurons but nobody actually can explain in->out for the global thing.
Re:How Shadow Banning Can Silently Shift Opinion Online by janalsncm on Tuesday May 21, 2024 @02:08PM (#40431751)
In other words, you won’t be able to tell the difference between a net that prefers pro-Chinese propaganda and one that prefers pro wrestling.

To make things worse, for 99% of people things might look normal but for 1% it may show a large skew. The net can have memorized this.

Re:How Shadow Banning Can Silently Shift Opinion Online by asah on Tuesday May 21, 2024 @07:31PM (#40435530)
I'm a bit more optimistic: the CI/CD pipeline can include adversarial model(s) which probes for the worst behavior. We already have codebases of sufficient complexity that attacks can be inserted into the software supply chain.

Obviously, this becomes an arms race. The usual strategy is to add random checks, friction to contribution and severe-enough punishments for offenders (lifetime RL bans, etc.)

Expert opinions welcome - I'm a tourist.

Re:How Shadow Banning Can Silently Shift Opinion Online by lupusreal on Tuesday May 21, 2024 @12:05PM (#40430261)
They should have to publish everything required to independently reproduce the recommendations, given a user's inputs. If their code is spaghetti that makes this neigh impossible, that's their problem and they shouldn't be in business.
Re:How Shadow Banning Can Silently Shift Opinion Online by gruez on Tuesday May 21, 2024 @12:41PM (#40430738)
>They should have to publish everything required to independently reproduce the recommendations, given a user's inputs.

So they also have to give up all their user data?

Re:How Shadow Banning Can Silently Shift Opinion Online by lupusreal on Tuesday May 21, 2024 @02:06PM (#40431734)
> given a user's inputs

Meaning if I record my own inputs, I should be able to recreate the suggestions I see using the published software. This doesn't mean the inputs of other users are exposed to me, but it does imply that "the algorithm" can only use data that is either publicly exposed or is my own inputs.

Re:How Shadow Banning Can Silently Shift Opinion Online by gruez on Tuesday May 21, 2024 @02:18PM (#40431887)
>but it does imply that "the algorithm" can only use data that is either publicly exposed or is my own inputs.

That seems pretty restricting given that even the most basic recommendation would try to cluster users based on interests and use that to recommend stuff (eg. Amazon's "customers who viewed this item also bought..." from decades ago).

Re:How Shadow Banning Can Silently Shift Opinion Online by janalsncm on Tuesday May 21, 2024 @02:10PM (#40431774)
“The inputs” here is going to include every video, or at least a large subset of every video.
Re:How Shadow Banning Can Silently Shift Opinion Online by lupusreal on Tuesday May 21, 2024 @04:21PM (#40433380)
The videos themselves are public, and I think it would be good for all the relevant video metadata to be public as well.
Re:How Shadow Banning Can Silently Shift Opinion Online by brokenmachine on Wednesday May 22, 2024 @07:48PM (#40448393)
Also how long a user spent watching each individual video, and what order they were watched in.

That would be very hard/impossible to recreate in order to test the algorithm.

Re:How Shadow Banning Can Silently Shift Opinion Online by munksbeer on Thursday May 23, 2024 @04:44AM (#40452174)
> Just out of curiosity, what do people mean when they say "publish the algorithm"?

In whatever form it takes such that a regulator can scrutinise it. If that seems arduous or impacts the social media business model, too bad. Nothing of value will have been lost. I am not typically a person who favours over regulation, even my views on AI are likely too liberal for HN, but on the matter of social media impacting children, I'm all in for regulation.