Ask HN: What is the weirdest or most surreal (recent) technology you have seen?

Re:Ask HN: What is the weirdest or most surreal (recent) tec... by ozim on Tuesday January 24, 2023 @03:32PM (#34509872)

Many are dismissing it because it is just neural network. Which were basically at academic works since 80’s or earlier. It is only that now we have enough hardware and material for training neural nets that they start to be useful.

[ Parent | on HN ]

Re:Ask HN: What is the weirdest or most surreal (recent) tec... by btilly on Tuesday January 24, 2023 @04:33PM (#34510754)

There is a lot more than that.

1. We've learned that relu is a really good function to use for neural networks.

2. We've learned that regularization is essential to having large networks without overfitting.

3. We've learned how to scale models up and down so that you can train something on a giant cluster then run it on your phone.

4. We've learned how to apply this to lots of specific kinds of problems.

etc, etc, etc.

We do NOT simply do what we did in the 80s then throw more hardware at it. Instead we are getting better at making the hardware do something useful.

[ Parent | on HN ]