I hate to give a smarmy result, but are you sure you know what RLHF is? Because this is one way to correct said data.
There’s a great deal of lesions to be learned from X PB of training data that wouldn’t be covered.
Is that your stance? Or do you have some more limited rejection of IP in mind.
Myself I don't see those as being related at all. Keeping something secret is allowed. What is not allowed is something being 'not-secret' yet special. Once you share the source code to the world there would be no closing the barn door.
What and how you can keep a secret is very much under the term IP, if you want to describe something more specific don’t use terms meant to describe something else. If you’re full on “information wants to be free” then the line doesn’t stop at a companies firewall.
Intellectual property is about someone having ownership over an idea. It does not mean that you have a right someone gives his idea to you. These are totally separate things.
I am free to write, paint, code or film whatever I want. I have zero obligation to share that with anyone.
Remove it and you can’t retaliate against anyone buying or selling access to your company’s source code thus making it impossible to keep private. So all such source code ends up public at any reasonably large company effectively killing all AI startups etc. The same is true of any proprietary information thus quickly killing nvidia, AMD, etc. Medical R&D also dies outside of governments and non profits. It’s shocking just how many industries get gutted as there’s far less incentive to make accurate maps when anyone can copy them.
But hey, I respect your stance here.
PS: If you think contracts/DRM/whatever that’s the solution! Now you do have protection for info and thus IP again.
Leaning from music doesn’t mean imitating that music. People can for example learn from mistakes without imitating those mistakes.