Re:I'm an Old Fart and AI Makes Me Sad
by orangecat on Friday February 16, 2024 @01:15PM
(#39400826)
I can see that, although to me there's a difference between weights and something like bytecode. The weights don't encode any sort of logical operations, they're just numbers that get multiplied and added according to relatively simple algorithms.
Totally agreed that the process of generating and evaluating weights is opaque and not very accessible.
Aside from annoying people who want to understand how things work, it also means you can't ever know if you have a fully optimal or correct solution, all you can do is keep throwing money into the training furnace and hope a better solution falls out next time. The whole nature of it gatekeeps out anyone who doesn't have enormous amounts of money to burn.