News for hackers. Stuff that matters.
Re:Accelerated PyTorch Training on M1 Mac by ekelsen on Wednesday May 18, 2022 @12:05PM (#31424438)
Nice results! But why are people still reporting benchmark results on VGG? Does anybody actually use this network anymore?

Better would be mobilenets or efficientNets or NFNets or vision transformers or almost anything that's come out in the 8 years since VGG was published (great work it was at the time!).

Re:Accelerated PyTorch Training on M1 Mac by plonk on Wednesday May 18, 2022 @12:29PM (#31424723)
> Does anybody actually use this network anymore?

Why not? It's still good for simple classification tasks. We use it as an encoder for a segmentation model in some cases. Most ResNet variants are much heavier.

Re:Accelerated PyTorch Training on M1 Mac by jph00 on Wednesday May 18, 2022 @04:15PM (#31427104)
I don't think that's true - have a look at this analysis here:

https://www.kaggle.com/code/jhoward/which-image-models-are-b...

Those slow and inaccurate models at the bottom of the graph are the VGG models. A resnet34 is faster and more accurate than any VGG model. And there are better options now -- for example resnet34d is as fast as resnet34, and more accurate. And then convnext is dramatically better still.

Re:Accelerated PyTorch Training on M1 Mac by YetAnotherNick on Wednesday May 18, 2022 @04:18PM (#31427133)
> ResNet > VGG: ResNet-50 is faster than VGG-16 and more accurate than VGG-19 (7.02 vs 9.0); ResNet-101 is about the same speed as VGG-19 but much more accurate than VGG-16 (6.21 vs 9.0).

https://github.com/jcjohnson/cnn-benchmarks#:~:text=ResNet%2....

Re:Accelerated PyTorch Training on M1 Mac by p1esk on Wednesday May 18, 2022 @12:35PM (#31424793)
why are people still reporting benchmark results on VGG?

Probably because it makes the hardware look good.

Re:Accelerated PyTorch Training on M1 Mac by 0-_-0 on Wednesday May 18, 2022 @01:34PM (#31425434)
This is the right answer. Efficient networks like EfficientNet are much harder to accelerate in HW.
Re:Accelerated PyTorch Training on M1 Mac by DSingularity on Wednesday May 18, 2022 @05:12PM (#31427734)
No. Because it is a way to compare performance. That’s all. Just convenience.
Re:Accelerated PyTorch Training on M1 Mac by jorgemf on Wednesday May 18, 2022 @12:37PM (#31424811)
Probably because it will be impossible to compare with old results. If every year the community chooses a different model, how are you going to compare results year over year?
Re:Accelerated PyTorch Training on M1 Mac by ekelsen on Wednesday May 18, 2022 @08:40PM (#31429331)
The numbers are relative speedups, not absolute numbers that can be compared with any prior results, so I don't really see how this matters.
Re:Accelerated PyTorch Training on M1 Mac by jorgemf on Wednesday May 18, 2022 @09:12PM (#31429560)
You need something constant, either the model or the hardware, otherwise you cannot have those relative numbers. And you usually want to have a trend. See my other reply
Re:Accelerated PyTorch Training on M1 Mac by learndeeply on Wednesday May 18, 2022 @02:46PM (#31426237)
ResNets have been around for 7 years...
Re:Accelerated PyTorch Training on M1 Mac by jorgemf on Wednesday May 18, 2022 @05:54PM (#31428136)
It doesn't matter. Deep learning have been mainstream for only 10 years. MNIST is a dataset from 1998 and it is still being used in research papers. The most important thing is to have a constant baseline, and ResNets are a baseline.

Think about changing the model every other year: - 2015: ResNet trained in Nvidia k80 - 2017: Inception trained in Nvidia 1080 ti - 2019: Transformer trained in Nvidia V100 - 2021: GTP-3 trained in a cluster

Now you have your new fancy algorithm X and an Nvidia 4090. How much better is your algorithm compared to the state of the art, and how much have you improved compared to the algorithms 5 years ago? Now you are in a nightmare and you have to run all the past algorithms in order to compare it. Or how fast is the new Nvidia card? which noone still have and nvidia has decided to give numbers based on a their own model?

Re:Accelerated PyTorch Training on M1 Mac by 6gvONxR4sf7o on Wednesday May 18, 2022 @12:25PM (#31424671)
> But why are people still reporting benchmark results on VGG?

It makes me feel like i’m missing something! Is is still used as a backbone in the same way as legacy code is everywhere, or is it something else entirely??

Re:Accelerated PyTorch Training on M1 Mac by sanxiyn on Wednesday May 18, 2022 @09:33PM (#31429682)
VGG works better for style transfer than ResNet (this is a surprising result, but empirically true), but that's the only case I am aware of.

https://arxiv.org/abs/2104.05623

Re:Accelerated PyTorch Training on M1 Mac by eoerl on Thursday May 19, 2022 @01:00AM (#31430971)
actually it seems that it was because a lot of other well known models are not yet supported, missing ops in the Metal backend