News for hackers. Stuff that matters.

A comment on Is Copyright Eating AI?. Parent comment

Re:Is Copyright Eating AI? by ben_w on Sunday January 22, 2023 @04:26AM (#34475732)
The training set for GPT-3 is about 500e9 tokens; any given synapse in a human in their lifetime is going to fire about 2e9s * (10% * {100Hz to 1000Hz}) = 20e9 to 200e9 times.
[ Parent | on HN ]
Re:Is Copyright Eating AI? by sillysaurusx on Sunday January 22, 2023 @04:50AM (#34475849)
It sounds like you agree with them, since there are a lot of synapses.
[ Parent | on HN ]
Re:Is Copyright Eating AI? by ben_w on Sunday January 22, 2023 @06:02AM (#34476195)
Au contraire.

While our brains are more complex than the networks, this has never been in dispute.

The quantity of experiences needed to train GPT-3, however, is many more than we are capable of experiencing in a lifetime.

[ Parent | on HN ]