News for hackers. Stuff that matters.
Re:Zuckerberg disses closed-source AI competitors as trying ... by fragmede on Friday June 28, 2024 @04:23PM (#40824882)
And I can edit binaries with binedit. Reverse engineering is a lost art, but reversing binaries with Ida pro and patching binaries is a time honored skill. It's a shame it's usually used to patch out license checks but there have been some truely impressive reverse engineering on video game ROMs for which the source is not available so we're left with modifying the binary. or as we're looking at it, the model.
Re:Zuckerberg disses closed-source AI competitors as trying ... by fragmede on Saturday June 29, 2024 @08:34AM (#40829995)
https://github.com/WerWolv/ImHex (https://news.ycombinator.com/item?id=40828493) is a hex editor specially made for people that do exactly that kind of binary editing.
Re:Zuckerberg disses closed-source AI competitors as trying ... by throwthrowuknow on Saturday June 29, 2024 @07:48PM (#40834130)
But you’re not reversing anything with weights. They aren’t altered at all. There’s no secret human readable code, just training/test data and hyperparameters. Even if they did give you access to the exact data set they used there’s not much chance you could do anything with it without millions of dollars worth of compute time and even then they’ve already trained the model on that data so the best you could do is start from scratch and see if you could get a better result in which case your time is better spent on building your own data set and RLHF process. Like what value do you think you’re going to get anyways?