Re:There Are No New Ideas in AI Only New Datasets
by specialist on Monday June 30, 2025 @06:37PM
(#44428673)
Yes and: and forget.
[ Parent
| on HN ]
Re:There Are No New Ideas in AI Only New Datasets
by 8n4vidtmkvmk on Tuesday July 01, 2025 @02:28AM
(#44431166)
Why is forgetting important? Things can either have an end time where they are no longer applicable or things we thought were true turn out to be false but it's still useful to see where we went wrong.
I imagine humans are limited by the # of synapses we have so it's useful to forget but maybe machines can move the useless stuff to deep storage until it's dug out, in the same way certain things can trigger a deep memory in humans.
Re:There Are No New Ideas in AI Only New Datasets
by lupire on Tuesday July 01, 2025 @08:14AM
(#44433105)
Which is cheaper, among these two logically equivalent things: reducing one weight, or increasing every other weight?
Re:There Are No New Ideas in AI Only New Datasets
by specialist on Thursday July 03, 2025 @11:01AM
(#44455766)
Do you remove dead code? Get rid of clutter? Ever try to change a habit?
Re:There Are No New Ideas in AI Only New Datasets
by 8n4vidtmkvmk on Friday July 04, 2025 @03:36AM
(#44462095)
Yeah, I delete dead code but it's important to remember why I wrote it that way in the first place and why I'm deleting it now. Doomed to repeat past mistakes and all that.