News for hackers. Stuff that matters.
Re:Does GPT-2 Know Your Phone Number? by antipaul on Sunday December 27, 2020 @02:41PM (#25553651)
Thanks for the reference. Here it is:

“We show, however, that deep networks learned by the standard gradient descent algorithm are in fact mathematically approximately equivalent to kernel machines, a learning method that simply memorizes the data and uses it directly for prediction via a similarity function (the kernel)“

https://arxiv.org/abs/2012.00152

There are no comments on this comment yet.