Re:Ask HN: Is Anyone Else Tired of the Self Enforced Limits ...
by ben_w on Sunday October 23, 2022 @11:56AM
(#33307884)
The actual quality of the currently public models is why they decided to release them.
The worst case scenario of the currently public models is why they want to take it slow.
It's like the lottery in one of the episodes of the TV show Sliders: you probably won't win, but if you do win, you die.
Unfortunately, most people are really bad at grokking probably, and, by extension, risk, especially in scenarios like this.
> Bad actors will have enough money/lack scruples to train their own models or to steal your best ones regardless how "impact conscious" your company it.
Indeed, totally correct.
But this is also on the list titled "why AI alignment is hard and why we need to go slow because we have not solved these things yet".
Saying "it doesn't matter if we keep this secret, someone else will publish anyway" is exactly the same failure mode as "it doesn't matter if we keep polluting, someone else will pollute anyway".
The worst case scenario of the currently public models is why they want to take it slow.
It's like the lottery in one of the episodes of the TV show Sliders: you probably won't win, but if you do win, you die.
Unfortunately, most people are really bad at grokking probably, and, by extension, risk, especially in scenarios like this.
> Bad actors will have enough money/lack scruples to train their own models or to steal your best ones regardless how "impact conscious" your company it.
Indeed, totally correct.
But this is also on the list titled "why AI alignment is hard and why we need to go slow because we have not solved these things yet".
Saying "it doesn't matter if we keep this secret, someone else will publish anyway" is exactly the same failure mode as "it doesn't matter if we keep polluting, someone else will pollute anyway".