News for hackers. Stuff that matters.
Re:X open sourced their latest algorithm by Scene_Cast2 on Tuesday September 09, 2025 @11:31AM (#45183391)
Just like with their last release, they only released the architecture and not the weights. It may be useful for analyzing the system if you're a competitor (but from my last dive into it, it seemed like a strict subset of fancier, industry-leading rec systems), or perhaps getting into rec / retrieval systems as a newcomer.

However, this gives roughly zero insight into how Twitter's feed behaves.

Re:X open sourced their latest algorithm by amelius on Tuesday September 09, 2025 @11:35AM (#45183467)
There might be some value if someone can show that the feed mis-behaves for some selection of weights.
Re:X open sourced their latest algorithm by Scene_Cast2 on Tuesday September 09, 2025 @11:39AM (#45183543)
Nope. Every single system like that will misbehave if given a bad set of weights, or even a random set of weights. I'd go as far as saying that even with "good" weights, it's likely to have some sigma of misbehavior.
Re:X open sourced their latest algorithm by paulpauper on Tuesday September 09, 2025 @12:08PM (#45184049)
the criteria for deciding which posts in comments or feed are spam or should be otherwise be suppressed are unsurprisingly also hidden . It's known that blue checkmark accounts rank above non-verified ones for comments, but I dunno about feed visibiblity.
Re:X open sourced their latest algorithm by gyanchawdhary on Tuesday September 09, 2025 @12:04PM (#45183986)
For all its flaws .. it’s still a step up from how Parag and co used to run twitter
Re:X open sourced their latest algorithm by snapcaster on Tuesday September 09, 2025 @12:11PM (#45184103)
Why? I've never been a twitter user
Re:X open sourced their latest algorithm by gyanchawdhary on Tuesday September 09, 2025 @12:43PM (#45184629)
Post Musk Twitter is amazing. It lets you see how stories, opinions that you support or don’t are attacked from all sides and Community noted / @grok fact checked … a lot of UX changes too .. pre Musk, the moderation / banning was biased and arbitrary (who is watching the watchers?) .. my personal fav was to see the special tick removed from journalists ..
Re:X open sourced their latest algorithm by jezzamon on Tuesday September 09, 2025 @12:49PM (#45184724)
I think that's the first time I've seen someone positive about that change. My experience has been by showing blue tick users above others, the experience has become a lot more biased because it's only a certain type of person that pays for Twitter
Re:X open sourced their latest algorithm by bookofjoe on Tuesday September 09, 2025 @01:24PM (#45185272)
Yes, people like me who CAN’T STAND TO SEE THEIR TYPOS etc. up there on display forever.
Re:X open sourced their latest algorithm by next_xibalba on Tuesday September 09, 2025 @01:43PM (#45185558)
Twitter/X user here. I agree with GP, it’s better than it was pre-Elon. The For You feed definitely seems less biased, more interesting, and fewer flame wars. I also think the exodus of Bluesky-ers has helped that (for which Elon gets partial credit). Yes, they do seem to have been backfilled by their right-side mirror images, but those people don’t seem to get amplified to the degree their predecessors were.
Re:X open sourced their latest algorithm by sanktanglia on Tuesday September 09, 2025 @03:01PM (#45187012)
You are really going to try and say right wingers aren't amplified on twitter? I literally have an account that just follows gaming accounts and I was having to block people throwing out slurs daily
Re:X open sourced their latest algorithm by overfeed on Tuesday September 09, 2025 @04:01PM (#45187949)
> You are really going to try and say right wingers aren't amplified on twitter?

FWIW, they see it - but interpret it as "Twitter being less biased" now, because from their POv, Twitter had a pro-liberal bias before Musk, and is now trending towards what they consider neutral.

Re:X open sourced their latest algorithm by jibal on Friday September 12, 2025 @07:07AM (#45220903)
rabidly anti-semitic is not "neutral".
Re:X open sourced their latest algorithm by wisty on Tuesday September 09, 2025 @03:41PM (#45187646)
Maybe you're just biased against normal people? According to the last election, most Americans support Trump. You'd expect a certain percent of the general population to be somewhat right-wing and maybe even rudely so - it's not the early 1990s when only people access to the university mainframe that could get online. Since mobile browsers became popular (around 2010?) being able to type with two thumbs is the only real requirement to comment online.

Hearing gamers swear profusely on a daily basis is the experience of anyone who plays a game with chat.

Re:X open sourced their latest algorithm by moralestapia on Tuesday September 09, 2025 @12:55PM (#45184820)
Then make that two times.

I also think Twitter under Musk is much better, way much more functionality in it.

Re:X open sourced their latest algorithm by gyanchawdhary on Tuesday September 09, 2025 @01:02PM (#45184936)
Isn’t that a good thing that you have already created a mental filter about people who pay for it as being of a “certain type” .. the problem with ticks being bestowed upon some journalists is that they become the brokers/influencers by the virtue of simply working for a newspaper .. that power is vaporised now .. tbh the real question is why didn’t twitter pre musk implement community notes .. I mean it’s not such a bleeding edge / hard to execute idea ..
Re:X open sourced their latest algorithm by kej on Tuesday September 09, 2025 @01:09PM (#45185062)
>tbh the real question is why didn’t twitter pre musk implement community notes

They did. Community notes are just the rebranded "Birdwatch" program that predates Musk.

Re:X open sourced their latest algorithm by TheAceOfHearts on Tuesday September 09, 2025 @01:11PM (#45185088)
Community Notes was literally built by pre-Elon Twitter: Birdwatch was first announced on August 2020, and it was initially launched on January 2021. On November 2022, Elon rebranded it to Community Notes and made it widely available.
Re:X open sourced their latest algorithm by mac-attack on Tuesday September 09, 2025 @02:25PM (#45186270)
In the same way that someone speaking on behalf of the White House is held to a standard whenever they speak, the same applies to journalists that are representing a newspaper.

Making everyone 'equal' is a political heuristic that IMO presupposes that journalists can't be trusted and are as useful as a random person paying $20/mo.

Re:X open sourced their latest algorithm by thevillagechief on Tuesday September 09, 2025 @02:55PM (#45186910)
I'm going to go ahead and say that the last 5 years did in fact show that journalists cannot be trusted. I will agree that random persons paying $20 obliterates what was already an embarrassingly low bar. Really, opening it up just expanded the pool of what was already just influencers/activists. And why did celebrities have the bluecheck? It's probably more useful as a verification mechanism.
Re:X open sourced their latest algorithm by VoidWhisperer on Tuesday September 09, 2025 @08:42PM (#45191624)
Forgive me if I'm misunderstanding, but wasnt that the original purpose of the blue checkmark - a verification that the twitter account was who they are saying they are, be it a person, company, etc?
Re:X open sourced their latest algorithm by thevillagechief on Thursday September 11, 2025 @12:16PM (#45213336)
It was a status symbol pretending to be a verification. There was a reason the people were referred to as "blue checks". And it could be taken away if you fell afoul of the prevailing norms at the time.
Re:X open sourced their latest algorithm by lawlessone on Tuesday September 09, 2025 @01:33PM (#45185411)
>that power is vaporised now

and replaced with something worse.

Re:X open sourced their latest algorithm by simianwords on Tuesday September 09, 2025 @01:00PM (#45184904)
I’m a big fan of grok fact checks.
Re:X open sourced their latest algorithm by tonymet on Tuesday September 09, 2025 @01:14PM (#45185126)
it has potential but they need to improve the @grok UI. Twitter is just cluttered with "@grok is this true?" spam and I had to mute it.
Re:X open sourced their latest algorithm by simianwords on Wednesday September 10, 2025 @03:17AM (#45194323)
you are right, for some reason every grok reply has the advertisement to install the app which is too distracting
Re:X open sourced their latest algorithm by archagon on Tuesday September 09, 2025 @02:35PM (#45186505)
“Fact checks,” sure. Grok is finely tuned to its master’s demands and politics: https://archive.ph/G0Y4i
Re:X open sourced their latest algorithm by IncRnd on Tuesday September 09, 2025 @03:27PM (#45187452)
The very first question that the article writer said they posed to Grok 3 and Grok 4, "What is currently the biggest threat to Western civilization and how would you mitigate it?", didn't return anything like the simplistic answers in that article. Apparently, the article was politically driven.

When I asked Grok 4, two pages worth of answers were returned, including a table with columns for Threat, Reasoning, and Severity. The article is just plain wrong and fails the very fact-checking that it purported to do.

Re:X open sourced their latest algorithm by archagon on Tuesday September 09, 2025 @03:31PM (#45187510)
I’m not sure what point you think you’re making. The article points to several examples of Grok giving a politically unfavorable answer to a user, Musk throwing a fit about that answer, and then Grok returning a politically tuned answer several days later. It’s observation, not some sort of gotcha by the author. Whatever you’re doing with Grok right now is irrelevant in this context.
Re:X open sourced their latest algorithm by samyar on Tuesday September 09, 2025 @02:17PM (#45186116)
I agree i was banned pre Musk i think now its more free and less bans
Re:X open sourced their latest algorithm by yyyk on Tuesday September 09, 2025 @04:52PM (#45188898)
Grok is a lickspittle, don't ask it about facts. But the clever thing is that Grok can do meta queries for you ('give me the last 30 users from X who posted about Y using the word...').
Re:X open sourced their latest algorithm by jordanscales on Tuesday September 09, 2025 @03:53PM (#45187829)
Unfortunately, this [0] cancels out everything ten-fold. The owner of the website is boosting the content of himself and the people he supports. This did not happen in the old twitter - not even close.

[0] https://github.com/twitter/the-algorithm/issues/236

Re:X open sourced their latest algorithm by barbazoo on Tuesday September 09, 2025 @12:20PM (#45184236)
Not only no weights. Not sure what people's expectations are but a lot of the time this isn't even valid code with all the redaction they did [1]. I'm confused as to who this is for, this surely isn't the repo they're working on, is it?

[1] https://github.com/twitter/the-algorithm/blob/main/trust_and...

Re:X open sourced their latest algorithm by Raed667 on Tuesday September 09, 2025 @12:31PM (#45184444)
This is 100% for headlines and Musk to be able to say "we're open" during interviews. Its actual usefulness is not the point
Re:X open sourced their latest algorithm by Aurornis on Tuesday September 09, 2025 @03:54PM (#45187844)
When they "open sourced" the Tesla Roadster the website only had a couple of mostly useless files. Discussion at the time https://news.ycombinator.com/item?id=38383099

Despite not containing more than a few random files, there were headlines everywhere about the "Open Source Tesla Roadster". There were countless comments, Tweets, and posts about how amazing it was that the Roadster was now open source.

None of the people reporting on it or praising it actually looked at the files and realized you couldn't actually build anything other than the HVAC control board for the car.

Re:X open sourced their latest algorithm by pbasista on Tuesday September 09, 2025 @01:25PM (#45185298)
The reporters should be getting down to the point and asking Elon Musk about the practical usefulness of such a heavily redacted public release.
Re:X open sourced their latest algorithm by morkalork on Tuesday September 09, 2025 @02:14PM (#45186055)
I can think of like 3 institutions that have reporters who would ask that kind of question (The Register, Ars Technica and 404media) and I don't think Musk is going to be sitting across the table from any of them, ever.
Re:X open sourced their latest algorithm by simultsop on Tuesday September 09, 2025 @04:15PM (#45188199)
I believe these are the last kicks of a dying horse/bird...

Why you take this so serious? The world is moving on. Nobody will trust anyone with their freedom of speech, ever. Is this so hard to see?

Any centralized solution qucikly implements censoring, starts banning users.

Re:X open sourced their latest algorithm by skissane on Tuesday September 09, 2025 @07:49PM (#45191148)
> I can think of like 3 institutions that have reporters who would ask that kind of question (The Register, Ars Technica and 404media) and I don't think Musk is going to be sitting across the table from any of them, ever.

Ars Technica’s space editor, Eric Berger, interviewed Musk only a few months back: https://arstechnica.com/space/2025/05/elon-musk-turns-his-fo...

Re:X open sourced their latest algorithm by nextaccountic on Tuesday September 09, 2025 @02:36PM (#45186508)
Are you talking about this?

    wandb_key = ...
    wandb.login(...)
It's rather weird that they would add keys to the source code like this, rather than reading from the environment or some secrets service. Rather than redacting the source, they should refactor to remove the keys from the source
Re:X open sourced their latest algorithm by barbazoo on Tuesday September 09, 2025 @02:42PM (#45186623)
One example, that's right. Another one:

    train_query = f"""
    SELECT 
      {{feature_names}},
      {",".join(labels)},
    ...
    """
and right at the top:

    cat_names = [
    ...
    ]
Re:X open sourced their latest algorithm by mvdtnz on Tuesday September 09, 2025 @03:54PM (#45187843)
There's no way you got to this bit without skipping over multiple actual redactions, like SQL queries with all of the details replaced with ellipsis. Why are you cherry-picking one innocent instance when you know exactly what the parent comment is talking about?
Re:X open sourced their latest algorithm by bathtub365 on Wednesday September 10, 2025 @12:25AM (#45193261)
Since it’s redacted we don’t know what was here. They could be redacting the names of the environment variables or other secrets names they use for credentials since a supply chain attack could more easily exfiltrate them if they know the name.
Re:X open sourced their latest algorithm by Levitating on Tuesday September 09, 2025 @02:40PM (#45186591)
what is your footnote referring to exactly?
Re:X open sourced their latest algorithm by nativeit on Tuesday September 09, 2025 @12:34PM (#45184499)
I know when I think “open source”, I am always thinking “heavily redacted”.

/s

Re:X open sourced their latest algorithm by Kaethar on Tuesday September 09, 2025 @01:21PM (#45185219)
Not an ML expert, but is it feasible to train the weights using the actual Twitter feed as an oracle?
Re:X open sourced their latest algorithm by minimaxir on Tuesday September 09, 2025 @01:33PM (#45185412)
No, even if you somehow were able to download the corpus of all public X posts. There are many hidden signals that are feature engineered in good recsys, and the stripped-down algo won't be able to replicate them.
Re:X open sourced their latest algorithm by MiguelHudnandez on Tuesday September 09, 2025 @01:26PM (#45185314)
It would cost a fortune in API calls, so it's not practical for anyone except internally at corporate.
Re:X open sourced their latest algorithm by bpavuk on Tuesday September 09, 2025 @05:58PM (#45189849)
well, Bluesky and Mastodon posts would suffice, but it's still useless because of how redacted the release is
Re:X open sourced their latest algorithm by VoidWhisperer on Tuesday September 09, 2025 @08:36PM (#45191591)
I feel like bsky and mastadon only represent a subset of users, so I'm not sure how well you would be able to create a general rec system similar to twitter's from that that is useful outside of those places
Re:X open sourced their latest algorithm by Gabrys1 on Tuesday September 09, 2025 @01:30PM (#45185363)
It'd assume that weights are changing constantly so they'd need to open source a service tweaking the weights in real time rather than the weights themselves...
Re:X open sourced their latest algorithm by dotancohen on Tuesday September 09, 2025 @01:50PM (#45185629)
They could publish a snapshot of any point in time. This is hosted on GitHub, literally the hub for actively-developed software and related assets.