News for hackers. Stuff that matters.
Re:Twitter open sourced the recommendation engine by jaywalk on Friday March 31, 2023 @03:27PM (#35392166)

  \*
  \* These author ID lists are used purely for metrics collection. We track how often we are
  \* serving Tweets from these authors and how often their tweets are being impressed by users.
  \* This helps us validate in our A/B experimentation platform that we do not ship changes
  \* that negatively impacts one group over others.
  \*
From: https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92...
Re:Twitter open sourced the recommendation engine by gregw134 on Friday March 31, 2023 @03:33PM (#35392268)
So now engineers working on the algo can track whether their launches will lower Elon's tweet visibility. Looks like those remaining at Twitter have a knack for corporate survival.
Re:Twitter open sourced the recommendation engine by 908B64B197 on Friday March 31, 2023 @03:43PM (#35392415)
> Looks like those remaining at Twitter have a knack for corporate survival.

If Green Cards quotas suddenly became available how many would stay?

Re:Twitter open sourced the recommendation engine by capableweb on Friday March 31, 2023 @03:35PM (#35392302)
Yeah, surely the fan-boys who remain at Twitter are interested in lowering the visibility of Elon, not the opposite.
Re:Twitter open sourced the recommendation engine by SauciestGNU on Friday March 31, 2023 @03:51PM (#35392565)
I read that as being able to make sure they don't lower his engagement with a release
Re:Twitter open sourced the recommendation engine by jacquesm on Friday March 31, 2023 @04:21PM (#35393041)
Makes you wonder how they would deal with a reduction in Twitter users.
Re:Twitter open sourced the recommendation engine by japhyr on Friday March 31, 2023 @03:52PM (#35392574)
I think they meant that Twitter developers can make sure their most recent changes won't get them fired by lowering his visibility.
Re:Twitter open sourced the recommendation engine by cvhashim04 on Friday March 31, 2023 @03:45PM (#35392448)
When your visa is on the line, you’ll do anything
Re:Twitter open sourced the recommendation engine by sabellito on Friday March 31, 2023 @03:52PM (#35392566)
Engineers who work at twitter can easily find another job in the US.
Re:Twitter open sourced the recommendation engine by JohnFen on Friday March 31, 2023 @04:06PM (#35392794)
Can they? I don't know, but I imagine that at this point, everyone still working for Twitter is there because they don't have any other realistic option.
Re:Twitter open sourced the recommendation engine by darth_avocado on Friday March 31, 2023 @04:33PM (#35393234)
Most people working there are looking for other jobs. It is not hard to find another job, but in this market it is hard to find one that pays the same. A lot of people have 4 year stock grants and annual refreshers, pushing their compensation very high which can only be matched at other tech companies, which currently are not hiring much.
Re:Twitter open sourced the recommendation engine by kortilla on Friday March 31, 2023 @04:32PM (#35393206)
Only because you are blinded by your own biases. There are people there that think it will be the next spacex or Tesla
Re:Twitter open sourced the recommendation engine by DiggyJohnson on Friday March 31, 2023 @04:10PM (#35392854)
That's assuming too much in my opinion. Not everyone has the same or similar opinions regarding their work or Elon, even if it's hard for you to believe.
Re:Twitter open sourced the recommendation engine by JohnFen on Friday March 31, 2023 @04:13PM (#35392918)
I was basing my speculation purely on the working conditions there, not on any supposition about people's attitudes about their work or Musk.

> even if it's hard for you to believe.

It's not hard for me to believe at all.

Re:Twitter open sourced the recommendation engine by PuppyTailWags on Friday March 31, 2023 @04:28PM (#35393148)
It's harder with visas, because you're not gambling if you can find another job, you're gambling if your employer can acquire a visa in time for you to not be deported.
Re:Twitter open sourced the recommendation engine by sabellito on Friday March 31, 2023 @05:19PM (#35393817)
Posted on another reply, but according to this one link [0] you can start the visa process at a new company while still employed at your current job.

0: https://usvisagroup.com/changing-jobs-h-1b-visa/

Re:Twitter open sourced the recommendation engine by PuppyTailWags on Friday March 31, 2023 @06:06PM (#35394327)
Right, so it's still justified to feel bad for visa workers in this case, because they are stuck at an abusive workplace because of circumstances of their visa.
Re:Twitter open sourced the recommendation engine by FalconSensei on Friday March 31, 2023 @04:05PM (#35392779)
even considering all the layoffs other companies are doing?
Re:Twitter open sourced the recommendation engine by sabellito on Friday March 31, 2023 @05:17PM (#35393788)
What do you think is the percentage of companies who did layoffs or have hiring freezes vs companies who are hiring high caliber engineers?
Re:Twitter open sourced the recommendation engine by shortrounddev on Friday March 31, 2023 @04:45PM (#35393387)
H1-Bs are harder to get approved these days and a lot of companies don't want to go through the effort/cost to do so
Re:Twitter open sourced the recommendation engine by sabellito on Friday March 31, 2023 @05:18PM (#35393807)
According to this one link [0], H1B "tranfers" are not subject to visa caps. Plus you can search for new jobs and start the process while still employed.

0: https://usvisagroup.com/changing-jobs-h-1b-visa

Re:Twitter open sourced the recommendation engine by aetimmes on Friday March 31, 2023 @05:52PM (#35394159)
With forced RTO and "hardcore" mandates, it's difficult to find 6+ hours of time to interview at other companies (assuming there are any open visa sponsorships available).
Re:Twitter open sourced the recommendation engine by mlindner on Saturday April 01, 2023 @02:51AM (#35397845)
Companies can't revoke visas of employees... That's just not how H1B Visas work. Yes they can be fired, but they can go find another job and keep the Visa.
Re:Twitter open sourced the recommendation engine by narrator on Friday March 31, 2023 @04:12PM (#35392890)
He is the full owner of Twitter. It's his company, so nobody is going to fire him as CEO for over-promoting his tweets.
Re:Twitter open sourced the recommendation engine by quadcore on Friday March 31, 2023 @04:45PM (#35393379)
The users can and often do fire the CEO.
Re:Twitter open sourced the recommendation engine by tech234a on Friday March 31, 2023 @03:32PM (#35392247)
That makes sense; I guess that means Elon is considered a "group" now.
Re:Twitter open sourced the recommendation engine by lhnz on Friday March 31, 2023 @03:36PM (#35392321)
I know there's a joke about this regarding his ego and there's certainly some truth in that, however it's also quite believable that after a deployment he might have noticed the popularity of his tweets going down (since he no doubt checks his reach), so I can kind of understand how he might see "republicans", "democrats" and "celebrities_it_makes_sense_to_check_this_with_my_account_as_i_am_a_very_active_user" as core categories that need to have their reach balanced.
Re:Twitter open sourced the recommendation engine by NERD_ALERT on Friday March 31, 2023 @03:43PM (#35392400)
We don't need to speculate on this. It sounds like he did actually fire engineers over his tweets getting less engagement than he wanted.

https://www.platformer.news/p/elon-musk-fires-a-top-twitter-...

Re:Twitter open sourced the recommendation engine by lhnz on Friday March 31, 2023 @03:46PM (#35392461)
Honestly, if you read behind the lines, it sounds like the employee was intentionally making a joke about it at his expense in front of a bunch of people, and I think a lot of CEOs would take that badly as this is effectively the same thing as calling your boss egocentric.

But, we do have a bit of code that measures metrics on his account, so can we find the bit of code that increases the engagement on his account?

Re:Twitter open sourced the recommendation engine by bcrosby95 on Friday March 31, 2023 @04:02PM (#35392736)
> “When you’re asked a question, you run it through your head and say ‘what is the least fireable response I can have to this right now?’” one employee explained.

Reading between the lines, Musk sounds like a giant baby.

Re:Twitter open sourced the recommendation engine by mochomocha on Friday March 31, 2023 @03:52PM (#35392578)
> But, we do have a bit of code that measures metrics on his account, so can we find the bit of code that increases the engagement on his account?

There doesn't need to be. When they run AB tests, it's possible that they'd pick the winning cell if it makes the Elon metrics look better.

Even if the algorithm doesn't do anything explicit about boosting him, it can be tweaked through AB testing to favor him.

Re:Twitter open sourced the recommendation engine by lhnz on Friday March 31, 2023 @03:54PM (#35392606)
You mean A/B testing of weights/biases?
Re:Twitter open sourced the recommendation engine by mochomocha on Friday March 31, 2023 @04:01PM (#35392713)
No, the "weights" of your model are trained from the input data. What is usually AB tested are hyperparameters of the model, or different "flavors" of (model+input data).
Re:Twitter open sourced the recommendation engine by lhnz on Friday March 31, 2023 @04:13PM (#35392902)
What people are implying is still unsubstantiated though. The engineers on the Twitter Space say that this is to ensure that changes they make do not bias one category over another, they don't say that it's in order that they can make discretionary updates to bias towards Elon Musk.

Maybe after every update to the model, they check these stats to ensure that they haven't biased towards Elon Musk, and if so roll the change back.

Re:Twitter open sourced the recommendation engine by mochomocha on Friday March 31, 2023 @04:18PM (#35392988)
? Considering Elon as its own category is a bias.
Re:Twitter open sourced the recommendation engine by sangnoir on Friday March 31, 2023 @03:52PM (#35392577)
> it's also quite believable that after a deployment he might have noticed the popularity of his tweets going down

He did notice it and it was treated as a 5 alarm fire, with a Musk cousin sending 2 am slack messages (on a Monday!) to Twitter engineers to urgently fix Elon's reach[1].

1. https://www.theverge.com/2023/2/14/23600358/elon-musk-tweets...

Re:Twitter open sourced the recommendation engine by bcrosby95 on Friday March 31, 2023 @04:28PM (#35393143)
The proper way to do that is create a pool of celebrities and monitor them. Not just the CEO's account.

For very active accounts, I assume that's what the "vits" or "power user" one is for. Or, heck, "vits" might actually be what you said.

Re:Twitter open sourced the recommendation engine by leye0 on Friday March 31, 2023 @05:13PM (#35393744)
ChatGPT suggests: Vitriolic accounts.
Re:Twitter open sourced the recommendation engine by afavour on Friday March 31, 2023 @03:45PM (#35392449)
Still smells to high heaven to me. Not the Elon part, I don't really care about that. But collecting metrics about "republican" vs "democrat" sounds like a particularly bad set of priorities at work.
Re:Twitter open sourced the recommendation engine by bilekas on Friday March 31, 2023 @03:52PM (#35392580)
This exactly.. But without the models or policies we can only infer, which give plausible deniability.

Can't say I'm shocked overall, but it's strange to see it so 'on the nose'

Re:Twitter open sourced the recommendation engine by jcalder on Friday March 31, 2023 @04:36PM (#35393272)
I suspect it plays into this stuff: https://www.theguardian.com/technology/2021/oct/22/twitter-a...

They wanted to answer the questions of "is twitter biased against Republicans" so they measured it, turns out they favored republicans.

Re:Twitter open sourced the recommendation engine by andsoitis on Friday March 31, 2023 @03:50PM (#35392552)
> sounds pretty suspicious.

Sounds toxic to me

Re:Twitter open sourced the recommendation engine by JohnFen on Friday March 31, 2023 @04:09PM (#35392845)
About 40% of US voters are not registered with any political party, so at least they will avoid whatever this triggers.
Re:Twitter open sourced the recommendation engine by kuhewa on Friday March 31, 2023 @04:19PM (#35393012)
So you imagine these tags are set by looking account names up on state voter registration lists?
Re:Twitter open sourced the recommendation engine by JohnFen on Friday March 31, 2023 @04:24PM (#35393088)
Well, if not, then the tags have such a large error bar as to be meaningless.
Re:Twitter open sourced the recommendation engine by emmo on Friday March 31, 2023 @04:32PM (#35393204)
Or the data is assumed good and used dangerously.
Re:Twitter open sourced the recommendation engine by jacquesm on Friday March 31, 2023 @04:21PM (#35393055)
And then there is the rest of the world.
Re:Twitter open sourced the recommendation engine by seydor on Friday March 31, 2023 @04:00PM (#35392690)
but the people who care about stats are usually american politicians. they can present them with this data. (and use Elon as a control LOL)
Re:Twitter open sourced the recommendation engine by jonathankoren on Friday March 31, 2023 @04:26PM (#35393123)
Anyone that has worked in social network recommendations (raises hand) knows that they'll be accused of being politically biased, particularly if the recommendations aren't explicitly promoting biased news sites on the Right. (e.g. The Associated Press[0] is leftist propaganda! Where's unbiased news like Gateway Pundit[1] or InfoWars[5]?!) So data scientists and engineers will get pulled in to investigate the latest ref working[2][4], and this will let them easily determine that no, there is no bias.

None of this will matter though, because the complaints are made in bad faith.[2][3]

You may say this is biased comment, but I’m not going to engage in false equivalences, when the outrage and results of the outrage aren’t symmetrical, especially when the most popular and influential right wing television channel, Fox News, has been caught red handed knowingly spreading conspiracy theories for ratings.[6]

[0] "Associated Press is the least biased according to both Democrats and Republicans." https://www.businessinsider.com/most-biased-news-outlets-in-...

[1] "The Gateway Pundit (TGP) is an American far-right fake news website. The website is known for publishing falsehoods, hoaxes, and conspiracy theories." https://en.wikipedia.org/wiki/The_Gateway_Pundit

[2] https://www.latimes.com/archives/la-xpm-1996-07-22-mn-26779-...

[3] "Internal report finds ‘virtually identical’ rates of conservative and liberal topics, but guidelines updated to ‘exclude possibility of improper actions’" https://www.theguardian.com/technology/2016/may/24/facebook-...

[4] "There is some strategy to it [bashing the ‘liberal’ media]. If you watch any great coach, what they try to do is ‘work the refs.’ Maybe the ref will cut you a little slack on the next one." -- Rich Bond, 1992 Republican Party Chairman https://www.americanprogress.org/article/think-again-working...

[5] “InfoWars is an American far-right conspiracy theory and fake news website owned by Alex Jones. https://en.wikipedia.org/wiki/InfoWars

[6] https://nymag.com/intelligencer/2023/03/all-the-texts-fox-ne...

Re:Twitter open sourced the recommendation engine by kevviiinn on Friday March 31, 2023 @04:35PM (#35393260)
Re:Twitter open sourced the recommendation engine by jonathankoren on Friday March 31, 2023 @05:14PM (#35393754)
That doesn't say they did anything about it. Just that right wing complaints had no substance.

In fact, in just over a year from the publication of that blog post, Twitter -- as a matter of official company policy -- would be promoting the unfounded belief that Twitter engineers and scientists were actively engaging in a propaganda campaign against conservatives.

The exact opposite reaction of what I'm looking for.

https://www.npr.org/2022/12/14/1142666067/elon-musk-is-using...

Re:Twitter open sourced the recommendation engine by kevviiinn on Friday March 31, 2023 @06:11PM (#35394394)
I think it says a lot about the complaints. Some people just can't stop crying wolf to get attention
Re:Twitter open sourced the recommendation engine by jonathankoren on Sunday April 02, 2023 @12:59AM (#35407332)
It’s not just to complain. It’s an actual political strategy.