News for hackers. Stuff that matters.
[dead]
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by manuelabeledo on Thursday December 09, 2021 @12:05PM (#29499960)
The M1 Max runs also at a fraction of the 3080 TDP.

Performance in gaming is a non issue. Apple didn’t advertise it as a gaming machine, and quite honestly, nobody buys a $3000+ MacBook to play games.

Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by treesknees on Thursday December 09, 2021 @01:30PM (#29501069)
I bought my M1 Pro not for the sole purpose of being a gaming rig, but I did certainly buy it with the hopes that it could play games at least better than my old Intel integrated graphics laptop did.

And it does - I can run the PCSX2 PS2 emulator with a controller and my fans don't even spin up. And with Rosetta II there are plenty of Mac games I can play without any issues.

Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by photojosh on Thursday December 09, 2021 @09:40PM (#29505853)
Yep. I'm running the Dolphin emulator which runs perfectly, even rendering at a much higher resolution. Except Apple broke Wiimote connecting via the native Bluetooth with Monterey. :(
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by smoldesu on Thursday December 09, 2021 @02:42PM (#29501957)
What do you intend to do when they remove Rosetta?
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by officeplant on Thursday December 09, 2021 @05:07PM (#29503634)
Pray that there are more natively ported games by then, and just not updating and holding onto Rosetta for much longer than I should. Win11ARM in Parallels doing x86 emulation works pretty well for older games and its how I play old shooters and Everquest at the moment.
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by Raymonf on Thursday December 09, 2021 @03:52PM (#29502777)
Use a Windows VM? x86(_64)->ARM64 is not going away on Windows anytime soon.
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by sudosysgen on Thursday December 09, 2021 @07:25PM (#29504999)
Performance is worse than a 3060 with basically the same tdp.

Let's not pretend it's about games. Most workloads see 3060 level performance, basically anything except editing video in prores and ML workloads that require a lot of memory.

Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by manuelabeledo on Friday December 10, 2021 @10:27AM (#29510969)
How so? The M1 Max TDP tops at 90W, and runs at around 40W during benchmarking. The minimum configuration for the RTX 3060 Mobile runs at 60W, and the maximum, at 115W, both for the GPU alone. You would need to pair it with a CPU with a max TDP of 30W.
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by sudosysgen on Friday December 10, 2021 @12:11PM (#29512391)
The M1 Max uses 120W when stressing GPU and CPU. The GPU by itself uses around 60W.

These are sustained, not peak, figures. The M1 Max GPU does use 60W and so do many 3060 Mobiles with worse overall performance, at almost three times the price.

https://www.anandtech.com/show/17024/apple-m1-max-performanc...

Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by manuelabeledo on Friday December 10, 2021 @03:13PM (#29514929)
> The M1 Max uses 120W when stressing GPU and CPU. The GPU by itself uses around 60W.

The article clearly states that it is 120W on the wall. The SoC goes up to 92W. Nowhere it says that the GPU itself uses 60W.

You have also glossed over the fact that the article asserts that the MacBook runs at half of the wattage of an Intel system with a RTX 3080, 120W v. 256W.

> The M1 Max GPU does use 60W and so do many 3060 Mobiles with worse overall performance

A 3060 runs on 60W at the very low end. Usual configurations are 80W and 115W, and the differences in performance between those two are quite noticeable [1].

And again, you seem to focus on gaming, which is fine, but not the target market of a MacBook Pro. Notice that all the games tested are not native, but running on top of Rosetta 2. The M1 Max does great when it comes to video [2], and I would say the same for other workloads [3] [4] that have been, at least historically, where Apple has mostly focused on.

> at almost three times the price

Citation needed. Three times the price of what? The Intel system used in the Anandtech article is $3,149.00 [5], is the MacBook Pro $9,000?

By the way, Nvidia also has pro versions of their GPUs, they don't perform as well in gaming as they do in other tasks, and they really are way more expensive than their consumer counterparts. Are we now going to dismiss a Quadro RTX because it does not do too well running Tomb Raider?

[1] https://www.tomshardware.com/news/rtx3060mobile-multiple-tdp...

[2] https://www.anandtech.com/show/17024/apple-m1-max-performanc...

[3] https://blog.yiningkarlli.com/2021/10/takua-on-m1-max.html

[4] https://austinmann.com/trek/macbook-pro-m1-max-for-photograp...

[5] https://www.adorama.com/msige7611054.html

Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by sudosysgen on Friday December 10, 2021 @04:19PM (#29515569)
No, it doesn't use 120W at the wall. 120W is the difference between wall consumption in the test and at idle, which is around 1.1x more than the actual consumption. Apple under-reports power usage for some reason.

Sure, Apple runs at half the wattage of the 3080, with less than half of the performance.

All of the video workloads are specifically using ProRes, which is the Apple accelerated codec. If you do not use ProRes, you will get a fraction of the performance. The Macbook only gets that performance in a fraction of video editing workloads.

Yes, all games are running on Rosetta 2, except for Dolphin which shows a similar performance ratio. This doesn't matter because GPUs don't have to deal with Rosetta, and the tests are done in GPU-limited circumstances. The performance impact is going to be negligible in a CPU-limited scenario where the CPU is not even running at 100% to be able to slow down the GPU.

The M1 Max is around the speed of the slowest 3060 in all compute workloads that aren't bottlenecked by CPU-GPU communication.

The fact remains, Apple straight up lied by saying that their GPU is comparable to a 3080. It is comparable to a 3060 in TDP and slower in all except specific, hardware-optimized workloads. There are other workloads that are accelerated in the 3060 where the inverse is true.

Also, a Quadro RTX does very well at Tomb Raider. Which isn't surprising because it has a lot of compute power, unlike the M1 Max's GPU, and games nowadays care a lot about compute power.

The benchmark between a 3060 and the M1 Max was not by Anandtech. It was by LTT, and was with a laptop whose processor and GPU are in the 1000$ class. And unlike Anandtech, they did all of their GPU benchmarks in GPU-limited conditions whereas the Anandtech benchmarks are CPU-limited too, artificially boosting the performance of the M1 Max by measuring it's CPU as much as it's GPU.

I don't understand why Apple gets to call their GPU as fast as a 3080 when it's slower than a 3060 unless you are running very specific hardare-optimized software that require a hardware-specific worfklow.

All of the benchmarks you linked are CPU bechmarks, and the Takua render benchmark is ridiculous because in the real world, artists use GPU rendering on their laptops, where the M1 Max gets absolutely destroyed by an RTX 3060 because of hardware-accelerated ray tracing.

Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by manuelabeledo on Friday December 10, 2021 @05:09PM (#29516059)
> No, it doesn't use 120W at the wall.

It literally says so in the Anandtech article.

> Apple under-reports power usage for some reason.

Again, citation needed. Mostly because these numbers aren't coming from Apple, but Anandtech.

> Sure, Apple runs at half the wattage of the 3080, with less than half of the performance.

But it is not half of the performance, that is a lie and the numbers are out there. Again, in the same article, the only downside is gaming, which runs under Rosetta 2.

> It is comparable to a 3060 in TDP and slower in all except specific, hardware-optimized workloads. There are other workloads that are accelerated in the 3060 where the inverse is true.

This is straight up false. Again, read the article you yourself linked.

> All of the benchmarks you linked are CPU bechmarks

Wow. So, rendering and manipulating video and photo are purely CPU benchmarks. Ridiculous.

I'm not going to continue with this. I find insane that you would willingly ignore simple arithmetics just to, I guess, bash Apple. I'm not the greatest Apple fan myself, but for sure I am open to reckon that they did extremely well with the M1 family, and that they have created a very good laptop for professionals.

Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by sudosysgen on Friday December 10, 2021 @05:17PM (#29516116)
The Anandtech article shows the difference between idle wall power and current wall power, not wall power. Read the article, please.

>Again, citation needed. Mostly because these numbers aren't coming from Apple, but Anandtech.

The grey numbers are reported by the CPU using Apple code, but do not reflect actual power consumption

>This is straight up false. Again, read the article you yourself linked.

Incorrect. The workflows are the specific Apple-approved ProRes workflows as well as games, in CPU-limited fashion by the author's own admission. I linked the article for it's power consumption figures, you can watch the video linked above for proper GPU performance testing, where Rosetta 2 has negligible impact because of low CPU usage.

>Wow. So, rendering and manipulating video and photo are purely CPU benchmarks. Ridiculous.

Yes. CPU-rendering is a CPU benchmark. Lightroom is a CPU benchmark for all but a few very specific tasks (AI upscaling for example), and cannot properly utilize a high-performance GPU for anything else.

They created a good laptop GPU-wise for editing ProRes footage and using very large datasets, nothing else. If you need to do rendering, or game design, or have to work with complex CAD files, or have to do 90% of GPU compute workloads, or have to do 3D modelling/sculpting, or literally anything else a professional (or not) would want to do, it's embarrassingly deficient.

Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by smoldesu on Thursday December 09, 2021 @12:12PM (#29500066)
Very few people buy gaming laptops to edit video on, but that's not a reason for them to perform poorly at the task. The most frustrating part about the M1-series is that it's gaming performance is limited by arbitrary software decisions.
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by quenix on Thursday December 09, 2021 @11:32AM (#29499443)
How is this relevant to the Apple Neural Engine and this BlackHat talk?
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by deep-root on Thursday December 09, 2021 @12:01PM (#29499887)
If you're shopping for a Macbook Pro, gaming is the extremely narrow use-case, no?

Edit: various benchmarks seem to show the M1 Max games at about the FPS of a RTX 3060L (though with lower power). It's around the same price as a similarly spec'd 3060L gaming laptop.

Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by kitsunesoba on Thursday December 09, 2021 @01:31PM (#29501080)
It's going to get a lot less hot and noisy than a similarly specced 3060 laptop while also having vastly better battery life, which is worth something (varies depending on one's personal priorities). I would imagine a lot of people looking for portable power might value those qualities enough to trade away some raw graphical muscle.
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by mhh__ on Thursday December 09, 2021 @01:05PM (#29500785)
Well it's narrow historically but apple did seem to be implying it could game competitively with the latest from Nvidia. Which it apparently can (although there are practically no games), just bump the model down a step from what apple are saying.

Also M1 Max seems to be on the order of a £1000 more than a 3080 equipped laptop, where are you getting that figure from?

Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by olliej on Thursday December 09, 2021 @07:17PM (#29504948)
The problem with “latest from X” is that there’s such a wide perf gap between the latest budget device and the latest high perf one.

I also got irked by their comparison to old baseline gpu perf. Everyone knows intels integrated gpu is terrible, so comparing to that is pointless.

Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by LegitShady on Thursday December 09, 2021 @12:57PM (#29500680)
It's signiticantly more expensive than a 3060 equipped Zephyrus and that doesn't change apples marketing pretending it was a 3080.
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by vesrah on Thursday December 09, 2021 @02:16PM (#29501636)
Having owned one of those Zephyrus and owning a M1X there is no comparison on terms of quality or usability. Zephyrus is hot, loud, has a poor screen in comparison, and poor battery life.
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by LegitShady on Thursday December 09, 2021 @02:42PM (#29501953)
You're right about the battery life, but in exchange an AMD zephyrus is significantly more performant at a lower price. That's a fair trade off.

It's also not a ticking time bomb, since the SSD can be changed without sending the device into apple to change the entire CPU/SSD/GPU combo. Every one of these apple devices basically has planned obsolescence built in.

Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by katbyte on Thursday December 09, 2021 @07:31PM (#29505031)
The person your responding to listed 5 things the m1 max was better at. You responded by saying “but it’s faster!!!” While addressing none of them.
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by LegitShady on Thursday December 09, 2021 @08:07PM (#29505272)
some of those things are just subjective ('usability'), and some are part of the trade-off I was talking about. The zephyrus isn't as hot or loud when its limiting itself to the mac pros performance.
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by kaba0 on Friday December 10, 2021 @05:37AM (#29508410)
It’s only faster at GPU, no? CPU-wise it is really hard to beat even the regular M1.
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by LegitShady on Friday December 10, 2021 @06:09PM (#29516588)
A ryzen 9 is slower single core but faster multi core performance than an m1, but of course its TDP is higher so battery life will be significantly different.

If you care about having 20 hours of battery life instead of 8-10, the m1 is definitely going to win that. But from a pure performance perspective there are chips on the market faster than the m1 in the laptop sphere from AMD already.

If you get an zephyrus with an AMD cpu and a dedicated GPU you will pay less than the macbook pro and be more performant, in exchange for a hotter laptop with lower battery life. But that's just a tradeoff, not necessarily a win one way or another. I've never needed 20 hours of battery life and I don't prioritize it. 8-10 is enough for me. I'd rather have the faster machine.

And I can change the SSD or RAM myself without expecting it to make itself implode later in its lifespan because its all in one package as the apple silicon is.

Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by RealityVoid on Thursday December 09, 2021 @12:14PM (#29500090)
The M1 is an impressive chip... for what it is. I bought an Air just to mess with it, while in the past I would not have touched Apple with a 10 foot pole. But, the whole framing around M1 being better than _everything_ in the x86 world was just weird and not true. Yes, perf/watt it was unbeatable, but the rest...if you just care about raw processing power, you'd still buy a desktop x86. I think Apple framed it this way and most media ran with it, but I don't see this a sue apple kind of deal.
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by tambourine_man on Thursday December 09, 2021 @06:10PM (#29504364)
M1 tops SPEC2017 while giving you 15-20h of battery life. I'm not mentioning hardware specific accelerated tasks like Final Cut, if you throw that in it beats Xeons at a fraction of the price and power. It's just the best portable chip for regular, boring, standard Floats and Ints computation. There's really no competition yet.

Oh, and it's got crazy fast IO. And it's last year's architecture and process node. M2 with 4nm and A15 derived architecture should be another 20-30% faster at the same wattage.

The real question is the Mac Pro. What can and will Apple do when performance is the main focus? Will they just stick a bunch of M1s together (which wouldn't be bad) or are they able to crank single threaded performance a lot higher with more fans and watts to spare?

Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by Jcowell on Thursday December 09, 2021 @02:25PM (#29501761)
If raw performance is the only thing you care about then you would get a desktop. If you care about mobility as well or changes a lot.
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by marderfarker2 on Thursday December 09, 2021 @03:05PM (#29502232)
It’s funny that you mention mobility. I usually see people stuck an extra slab of USB C to HDMI/USB hub beside their thinnest and lightest Apple laptops so that they can use peripherals.
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by Toutouxc on Thursday December 09, 2021 @04:53PM (#29503456)
Usually, except for the overwhelming majority of people who don't use a hub.

(e.g. my Air has two cables running into it, power and display)

Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by caconym_ on Thursday December 09, 2021 @08:04PM (#29505251)
Not sure I understand what point you're trying to make, but when I "go mobile" I am typically leaving behind my monitor, my wired keyboard and mouse/trackpad, my backup drive, and most of the other shit I might have daisychained off a USB hub. So I actually see it as an incredible convenience that I can run all of that, plus charging, plus wired networking, off a single USB-C port.

It feels far more "mobile" than a setup where I need to plug/unplug all that stuff into the body of the laptop whenever I want to use my laptop away from my desk.

Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by photojosh on Thursday December 09, 2021 @09:44PM (#29505873)
And those USB-C hubs are like $20, so I can just get one for each spot I move between. Remember the old days of $200 hubs?
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by vmchale on Thursday December 09, 2021 @12:19PM (#29500158)
I've actually found it slightly better in single-threaded performance. Only slower with rosetta.
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by perardi on Thursday December 09, 2021 @12:16PM (#29500126)
1. Cite exactly what they said in the presentation, and in particular did they compare actual games, or synthetic benchmarks?

2. It is insanely competitive, especially given power consumption, with the NVidia card in both synthetic benchmarks and video editing. Not so much with games…but that's complicated by most games still running in Rosetta. https://www.anandtech.com/show/17024/apple-m1-max-performanc...

3. Video is not an edge case. And how can I claim that? Because you are here citing…a video.

4. What does this have to do with the linked article?

Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by dhruvdh on Thursday December 09, 2021 @01:11PM (#29500860)
For 3: you cannot compare consuming media with creating media.
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by ctdonath on Thursday December 09, 2021 @01:44PM (#29501236)
Generating media in real-time on the user's computer rather blurs the line between who is creating vs consuming media.
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by CrazyCatDog on Thursday December 09, 2021 @09:22PM (#29505736)
Well played! I had to reread what your wrote—and it was worth it!
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by mhh__ on Thursday December 09, 2021 @01:08PM (#29500818)
Surely bigger issue is most games having given up supporting MacOS?
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by pjmlp on Thursday December 09, 2021 @01:28PM (#29501054)
All game engines that matter in the market support Metal.
Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by mhh__ on Friday December 10, 2021 @05:30AM (#29508385)
Do frostbite and the call of duty engine/s support it?

Also engine support means nothing if you can't actually buy any games for a few years.

Re:Apple Neural Engine Internal: From ML Algorithm to HW Reg... by pjmlp on Friday December 10, 2021 @05:48AM (#29508470)
Apparently not.

On the other hand I guess there might be possible to buy some games written in Unreal, Unity Ogre3D, Defold, Xenko/Stride,....