News for hackers. Stuff that matters.
Re:twitter/the-algorithm by krapp on Monday April 25, 2022 @05:21PM (#31160788)
There probably is not "an algorithm" on a site as large and complex as Twitter, no. There are probably dozens if not hundreds of algorithms spread throughout the codebase which affect the timeline for individual users, possibly even code entirely self-generated by ML systems.
Re:twitter/the-algorithm by captainmuon on Monday April 25, 2022 @05:28PM (#31160891)
Well sure there is "ORDER BY" something, and there are batch jobs to calculate this something from different variables. Maybe it is partially a ML black box, but I'm pretty sure they are not flying completely blind. There's got to be an internal Wiki or some PPTs where they list what goes into the mix. Number of likes, retweets. Attached media, hashtags, trending or not. Do they do sentiment analysis and use positivity as a factor? Do they do PageRank so that likes from important people have more weight? Are there manual debuffs for certain topics? Are certain posts removed or added in a second pass? These are all answerable questions in principle.
Re:twitter/the-algorithm by jvanderbot on Monday April 25, 2022 @05:41PM (#31161046)
Maybe not. It could all be event-driven, distributed, and just pulling off various prioritized queues.
Re:twitter/the-algorithm by stjohnswarts on Monday April 25, 2022 @06:58PM (#31161910)
that's still an algorithm
Re:twitter/the-algorithm by jvanderbot on Wednesday April 27, 2022 @04:41PM (#31185517)
We'll, it's ok if you feel that way given this is entirely subjective, but I disagree based on experience.

I disagree b/c: That's a system. An algorithm is designed, a system will emerge from pieces. An algorithm can be defined, a system's behavior has to be characterized post-hoc. You can characterize a system, but only as a black/gray box. An algorithm has invariants and stateful steps, a system has nearly infinite state and nearly zero meaningful invariants.

Re:twitter/the-algorithm by cellis on Monday April 25, 2022 @05:52PM (#31161194)
The trouble is, there could be literally millions of ORDER BY queries. Hell, each user could be given a fine-tuned cnn…
Re:twitter/the-algorithm by onlyrealcuzzo on Monday April 25, 2022 @05:24PM (#31160832)
In the end, it's still code that is being executed, which can be called "an algorithm". Algorithms are under no obligation to be simple or only include "one algorithm".
Re:twitter/the-algorithm by krapp on Monday April 25, 2022 @05:29PM (#31160902)
So then "open sourcing the algorithm" likely means opens sourcing the entire Twitter codebase?
Re:twitter/the-algorithm by baryphonic on Monday April 25, 2022 @05:42PM (#31161068)
At this point, what harm would that do to Twitter? The company's tech has been stagnant for years, and the only real features recently have been attempts to exploit Twitter's network effects to ape Clubhouse & Substack. (Seems successful for the former, kind of a failure for the latter.)
Re:twitter/the-algorithm by stjohnswarts on Monday April 25, 2022 @06:59PM (#31161923)
do we know? has any angy ex-twitter engineer revealed the secret sauce to the world?
Re:twitter/the-algorithm by dragonwriter on Monday April 25, 2022 @05:33PM (#31160951)
The aggregate of a set of systems that maps inputs and state to outputs and state updates is...

still a system that maps inputs and state to outputs and outputs and state updates.

A collection of algorithms is just a bigger algorithm.