News for hackers. Stuff that matters.
Re:New iMac with M4 by simonw on Monday October 28, 2024 @12:07PM (#41972668)
As someone who mucks around with running LLMs and other large models on my computer the 32GB maximum RAM is a show-stopper for me. I'm on a M2 with 64GB at the moment and I'm already regretting not going for 96 or even 128.

I want to be able to run a large model AND other apps at the same time.

Re:New iMac with M4 by 015a on Monday October 28, 2024 @12:21PM (#41972880)
We should do a "Most HackerNews HackerNews Comment Of The Year" award each year; in homage to the O.G. [1]. I'd like to nominate this comment.

[1] https://news.ycombinator.com/item?id=9224

Re:New iMac with M4 by latexr on Monday October 28, 2024 @01:10PM (#41973524)
> in homage to the O.G.

That is a poor example of the thing you’re trying to mock. That exchange is an example of what one should do, it does not deserve derision. dang explained it well:

https://news.ycombinator.com/item?id=27067281

Re:New iMac with M4 by 015a on Monday October 28, 2024 @05:03PM (#41976260)
I proposed the nomination of an award to this commentator! That's hardly derision.

I'm actually a little hurt that you would treat my comment with such derision :(

Re:New iMac with M4 by latexr on Monday October 28, 2024 @07:01PM (#41977472)
> I proposed the nomination of an award to this commentator! That's hardly derision.

Awards can definitely be derisive.

https://en.wikipedia.org/wiki/Golden_Raspberry_Awards

Re:New iMac with M4 by skeaker on Monday October 28, 2024 @12:26PM (#41972974)
I agree with the premise but this isn't a great nomination, I think saying "this device won't appeal to the niche LLM gadgetry crowd" is valid in this case since yeah, it won't.
Re:New iMac with M4 by geodel on Monday October 28, 2024 @12:40PM (#41973156)
Agree. LLMs are really next generation requirements. Previously people would run a dozen docker containers in Kubernetes cluster on Mac or further before a dozen linux VMs etc and predictably but sadly macs never worked well for these requirements.
Re:New iMac with M4 by Apocryphon on Monday October 28, 2024 @12:48PM (#41973264)
It's also not like the comment was claiming the iMac isn't going to sell well. (And to be fair, it probably won't sell spectacularly well compared to than prior iMacs anyway, given how the MacBooks, Mac Minis, the Mac Studio, etc. have eaten that desktop's lunch.)
Re:New iMac with M4 by theWreckluse on Monday October 28, 2024 @12:34PM (#41973092)
While it's not a great one, it certainly checks the tone deaf attitude some HN comments have.
Re:New iMac with M4 by djoldman on Monday October 28, 2024 @12:35PM (#41973095)
Hrm. My OG vote goes to:

https://news.ycombinator.com/item?id=35079

> pg: That has to be the comeback of all time.

Re:New iMac with M4 by philipwhiuk on Monday October 28, 2024 @12:48PM (#41973255)
That's a great piece of HN lore.

Same original article:

https://news.ycombinator.com/item?id=35103

Tarsnap is functionally unchanged as a start-up and Dropbox is $2.5bn in revenue

Re:New iMac with M4 by ahofmann on Monday October 28, 2024 @12:44PM (#41973209)
That was hilarious, thank you for posting this :-)
Re:New iMac with M4 by mescalito on Monday October 28, 2024 @12:58PM (#41973394)
Why can't I see this comment when viewing the original article?
Re:New iMac with M4 by skeaker on Monday October 28, 2024 @01:05PM (#41973474)
Do you have showdead enabled? The chain is flagged so I think it would be hidden by default.
Re:New iMac with M4 by Manfred on Monday October 28, 2024 @01:04PM (#41973463)
Probably because it was flagged.
Re:New iMac with M4 by stogot on Monday October 28, 2024 @01:26PM (#41973703)
This isn’t even a comparable or relevant comparison.
Re:New iMac with M4 by traceroute66 on Monday October 28, 2024 @12:15PM (#41972796)
> As someone who mucks around with running LLMs and other large models on my computer the 32GB maximum RAM is a show-stopper for me.

To be fair, I don't think people mucking around with large LLMs is the primary target market for the iMacs.

The sort of people who muck around with LLMs almost certainly already have a monitor, keyboard and mouse. And so are more likely to pick up a Mac Studio which will no doubt be coming soon with M4 Ultra.

Re:New iMac with M4 by whiplash451 on Monday October 28, 2024 @12:25PM (#41972946)
Or separate concerns and shell out on a Studio display with the-mac-you-like on usb-c
Re:New iMac with M4 by talldayo on Monday October 28, 2024 @12:45PM (#41973224)
Or buy a real computer, plug in an Nvidia GPU, and save your DRAM for compute while using your VRAM for inference.
Re:New iMac with M4 by lynguist on Monday October 28, 2024 @01:02PM (#41973432)
16 GB or 24 GB for inference doesn’t cut it for large models…

Mac hardware offers up to 128 GB shared RAM.

Re:New iMac with M4 by diffeomorphism on Monday October 28, 2024 @03:22PM (#41975023)
It is in a weird middle ground. It is much worse ram and much slower hardware (factor 4 or so IIRC) and only an option if you need more than 24 but less than 200. Also, only if you think that 9000€ is pocket change but 20000€ is cost prohibitive. Also, you need all that power but no server, no ECC,... And you only ever want to do inference but no training or tuning.

If you want a Mac anyway, sure. But if you don't care, this seems like a very, very specific Venn diagram.

Re:New iMac with M4 by int_19h on Monday October 28, 2024 @03:51PM (#41975420)
It's not much worse RAM, though. RTX 4090 has memory bandwidth of 1050 Gb/s. M2 Ultra is 800 Gb/s. And you can get a Mac Studio with Ultra and 128Gb of RAM for $3K or less. It's great for 70-150B models.

You're correct that it's only good for inference, but most people running local LLMs only do inference.

Re:New iMac with M4 by keybits on Monday October 28, 2024 @06:05PM (#41976939)
That config Mac Studio costs 5,800 Euros (minimum). Where do you get it for 3,000 USD?
Re:New iMac with M4 by int_19h on Monday October 28, 2024 @07:08PM (#41977533)
You don't need an M2 for this, an M1 will do just fine. Nor do you need the one with maxed-out SSD, which jacks up the price considerably. Finding a brand new M1 Ultra for $4K or less right now is pretty easy. When I got mine, about a year ago, $3K was the best deal I could find.
Re:New iMac with M4 by nickthegreek on Monday October 28, 2024 @12:53PM (#41973333)
So now you just limited to 24gb unless you are running dual 3090s or leave the consumer market for a gpu.
Re:New iMac with M4 by talldayo on Monday October 28, 2024 @12:55PM (#41973363)
I mean, model layering has been around for several years now: https://huggingface.co/blog/lyogavin/airllm
Re:New iMac with M4 by Philpax on Monday October 28, 2024 @01:12PM (#41973540)
Moving the weights between the CPU and the GPU significantly limits performance. It's not comparable to having the entire model resident within video/unified memory.
Re:New iMac with M4 by sroussey on Monday October 28, 2024 @09:09PM (#41978340)
Yet it gets done for really big models. I can’t find the description for how Cerebras is doing Llama 405b for reference, but they are splitting by layers for that one (and why it’s not available right now).

https://cerebras.ai/blog/introducing-cerebras-inference-ai-a...

Re:New iMac with M4 by Philpax on Tuesday October 29, 2024 @07:07AM (#41982595)
That's not quite the same thing. There are three layers in the memory hierarchy (there are more, but for the purpose of this discussion, three is sufficient)

- CPU RAM

- GPU RAM

- GPU SRAM

The grandposter was talking about moving layers between CPU and GPU RAM, while Cerebras store models entirely in SRAM.

CPU <-> GPU is _much_ slower than GPU RAM <-> GPU SRAM: the former will never be competitive with keeping the weights entirely on accelerator. Comparing the bandwidth numbers given in that article with the bandwidth of PCI-E should demonstrate the problem.

Larger models are split between multiple accelerators, but even then they avoid going through the CPU as much as possible and instead use a direct interconnect (NVLink, etc). The weights are uploaded ahead of time to ensure they don't need to be reloaded during active inference.

The considerations for training are different, but the general principle of avoiding CPU traffic still holds.

Re:New iMac with M4 by diggan on Monday October 28, 2024 @12:47PM (#41973246)
> And so are more likely to pick up a Mac Studio which

Although price-conscious LLM muckers are most likely to pick any Apple-hardware. You can easily build rigs that are twice as powerful for half the price, assuming we compare desktops.

Re:New iMac with M4 by DrPhish on Monday October 28, 2024 @01:03PM (#41973448)
True. eBay dual-socket Epyc systems ala https://rentry.org/miqumaxx are a great case in point.
Re:New iMac with M4 by klodolph on Monday October 28, 2024 @12:10PM (#41972707)
Sure, but to be honest, I don’t think you should be shipping a high-spec computer with a built-in screen. Anything high-spec should be broken into at least a separate screen and computer. The screen is such a major point of failure. I’ve seen so many iMacs and MacBooks with broken screens where the end solution is to replace the entire device, which is a waste. It’s that much more of a waste if you are getting a high-spec version.
Re:New iMac with M4 by seanmcdirmid on Monday October 28, 2024 @12:16PM (#41972806)
> The screen is such a major point of failure.

The screen of an iMac (at least the 5K 27" one) is the part that still has value, so its annoying when you can't use it on new hardware.

Re:New iMac with M4 by squarefoot on Monday October 28, 2024 @12:34PM (#41973091)
I was surprised to find out that along older VGA/HD LCD controllers now there are also 3rd party boards to drive 5K Apple screens. Look for "5k screen controller" on Aliexpress. Price range from ~130€ to 300+€, no idea about the quality.
Re:New iMac with M4 by throw0101d on Monday October 28, 2024 @12:46PM (#41973226)
> The screen of an iMac (at least the 5K 27" one)

I've had a few of these iMacs and would like another. When I buy a new one (every ~5 years) I hand down the old one to a family member (the last one is ~10 years old now, and stuck at macOS 12(?)).

I like the form factor as it is convenient.

I'm typing this on 2019 Retina 5K and am hoping Apple will bring back that form factor (there have been rumours of a 32", but that's a bit too big IMHO).

As it stands, it looks like the Asus PA27JCV has similar specs, and so I may end up with that and an Mac mini.

Re:New iMac with M4 by klodolph on Monday October 28, 2024 @12:21PM (#41972894)
Yes, that is annoying. There’s also such a massive price difference between 4K and 5K monitors. I’ve decided just to accept 4K everywhere because it’s so much cheaper. But I would consider getting a 5K iMac.
Re:New iMac with M4 by seanmcdirmid on Monday October 28, 2024 @02:38PM (#41974553)
I have a 28" 4K from LG and a Samsung 27" 5K. It wasn't that bad, $5-600.
Re:New iMac with M4 by throw0101d on Monday October 28, 2024 @12:48PM (#41973259)
> Yes, that is annoying. There’s also such a massive price difference between 4K and 5K monitors.

Perhaps check out the Asus PA27JCV: 27" at 5120x2880.

Re:New iMac with M4 by vesrah on Monday October 28, 2024 @01:43PM (#41973881)
The unfortunate part is that these aren't for sale yet and we don't know how they actually compare to the existing LG 5k or Apple Studio display. It is nice to see more options coming to market.
Re:New iMac with M4 by throw0101d on Tuesday October 29, 2024 @07:39AM (#41982836)
> The unfortunate part is that these aren't for sale yet […]

They were announced 'all the way' back in June, and I've heard rumours of October 31 being the ship date, so perhaps check back next week.

In the US, B&H is taking pre-orders, so presumably it can't be that far off:

* https://www.bhphotovideo.com/c/product/1850479-REG/asus_pa27...

Re:New iMac with M4 by msisk6 on Monday October 28, 2024 @01:33PM (#41973775)
I have a MacBook Air on my desk plugged into a Apple 27-inch 5k Studio Display next to my work MacBook Pro plugged into a cheap AOC 27-inch 4k display via HDMI and frankly there's not much difference.

The speakers and mic in the Apple display are nice, but if you're just concerned about the display itself save yourself the bucks and stay with the 4k.

Re:New iMac with M4 by ellisv on Monday October 28, 2024 @01:53PM (#41974010)
It's really a shame that Apple discontinued target display mode.
Re:New iMac with M4 by sleepybrett on Monday October 28, 2024 @12:54PM (#41973339)
I know that some of the older imacs could still work as a monitor using 'target display mode'. Would be nice, however, if apple could design an imac where the actual computer is a module you can snap into an older one to upgrade it.

At some point we need to stop putting these things into landfills or even recycling them. I've been using the same PC case for at least 10 years ship of Theseus style and the same monitors for 5.

I appreciate apples recycling stance but even better is a reuse stance. Even just stripping back all the aluminum, melting it all down, re casting it and then remachining it has a significant cost.

For the last 10-20 years apple has been pretty good about reusing case designs for a few generations before doing some kind of redesign. Seems silly that I can't swap out a motherboard for a m2 macbook for an m3 macbook. (maybe this would also stop them from fucking soldering the storage to the motherboard since an upgrade that wipes my whole machine is utter bullshit)

Re:New iMac with M4 by simonw on Monday October 28, 2024 @12:16PM (#41972805)
Yeah, that's my biggest complaint with iMacs: I want to be 100% certain I can repurpose them as monitors later in their lives.

I have a ten year old iMac at the moment that would make an amazing second monitor... but it doesn't quite have the features I need to use it like that. An HDMI input would be great.

Re:New iMac with M4 by lisper on Monday October 28, 2024 @12:24PM (#41972934)
> An HDMI input would be great.

There is a reason that is difficult to do: the licensing terms for HDMI require manufacturers to put DRM in place to make it impossible (or at least not straightforward) to record from an HDMI source. It's nearly impossible to meet that requirement on a computer.

Re:New iMac with M4 by kmeisthax on Monday October 28, 2024 @03:20PM (#41974993)
You're thinking of HDCP, not HDMI. HDMI recorders exist (Elgato built an entire brand off selling them for console game streaming) but they are not allowed to speak HDCP because gestures vaguely at DMCA 1201.

In the specific case of the iMac:

- USB-C video outputs are all either DisplayPort[0]. HDMI Forum was promoting an HDMI USB-C altmode but it was never implemented. USB-C HDMI adapters are all DisplayPort adapters that additionally tunnel DVI traffic (because HDMI 1.x is actually single-link DVI with a funny connector and extra bits).

- Apple used to support Target Display Mode for video input until the Retina iMac a decade ago. They dropped Target Display Mode because their 5K display panels were using eight lanes of DisplayPort, a configuration that doesn't exist[1] outside of Apple's custom display controllers. Every other 5K display (and even some 4K ones) were instead using multiple cables, with some extra (poorly-supported) metadata to tell the graphics card to treat both halves of the display as one.

Why Apple hasn't brought TDM back now that we have enough bandwidth for 4.5K over standard cables is beyond me.

[0] Or MyDP, aka "the funny Nintendo Switch altmode"

[1] Think of it like a "32-lane PCIe port". It's technically possible but no host or device silicon supports a link that wide.

Re:New iMac with M4 by lisper on Monday October 28, 2024 @03:30PM (#41975132)
Yes, that's right. Thanks for pointing that out.

https://www.makeuseof.com/hdcp-vs-hdmi-whats-the-difference/

Re:New iMac with M4 by wtallis on Monday October 28, 2024 @10:12PM (#41978685)
> USB-C HDMI adapters are all DisplayPort adapters that additionally tunnel DVI traffic

Not tunnel, convert: these are active adapters that take in a DisplayPort signal from the computer and re-encode it as a DVI/HDMI output signal. The computer doesn't need to know or care that there's HDMI happening downstream, because it's still just outputting DisplayPort signal. It's not like Thunderbolt where DisplayPort traffic is tunneled inside a different signalling mode that the host machine supports.

This is why USB-C to HDMI adapters are unidirectional (at least, all the mainstream commodity ones). You'd need a different converter chip to do the conversion in the other direction.

Re:New iMac with M4 by buccal on Monday October 28, 2024 @12:33PM (#41973068)
Re:New iMac with M4 by lisper on Monday October 28, 2024 @12:37PM (#41973119)
It's not impossible, but it has to be a completely separate signal chain that bypasses the PC. (Well, OK, it's theoretically possible to do it other ways, but it would be really hard.)
Re:New iMac with M4 by tcoff91 on Monday October 28, 2024 @12:27PM (#41972999)
DisplayPort doesn't have that same restriction, right?
Re:New iMac with M4 by lisper on Monday October 28, 2024 @12:40PM (#41973161)
I don't know, but probably not. It's a legal requirement for HDMI, not a technical one. It's actually not hard to build an HDMI recorder, you just can't legally sell one. But bootleg recorders are easy to find.
Re:New iMac with M4 by sleepybrett on Monday October 28, 2024 @12:58PM (#41973388)
They could design it in such a way that the hdmi input port bypasses the whole 'computer' and goes straight into the display board. If it's plugged in the 'computer' could either not boot or just run headless, i'd prefer the former (just to save on energy costs).
Re:New iMac with M4 by fwip on Monday October 28, 2024 @12:39PM (#41973151)
Couldn't you "just" wire the HDMI port to the panel control logic? That is, the HDMI-in doesn't connect to the computer part of the iMac, just to the display circuitry.

Edit: nevermind, I see you addressed this in another comment.

Re:New iMac with M4 by hultner on Monday October 28, 2024 @12:34PM (#41973084)
You probably know this but it’s possible to buy a controller card for the panel on Ali Express and retro-fit into the case and use as a monitor if you are ready to retire the computer itself.

I’m contemplating doing this myself at some point but my maxed out 2019 iMac upgraded to 128GB ram and extra SSD is still plenty fast for me, actually feels subjectively quicker than my M2 Pro MacBook Pro with significantly less ram feel. I was a bit surprised as I had read all the hype of the responsiveness of the Apple M-machines.

Re:New iMac with M4 by eastbound on Monday October 28, 2024 @02:00PM (#41974110)
If they could be used as monitors, then my iMac 2018 would still be worth 1700€ (the price of the Apple monitor)!

Instead, the 2018 iMac is incredibly slow, and can be thrown away.

Re:New iMac with M4 by cududa on Monday October 28, 2024 @12:27PM (#41972990)
Great. But plenty of consumers disagree with you, which is why this product exists.

Not everything you see is designed to be useful for you specifically

Re:New iMac with M4 by falcor84 on Monday October 28, 2024 @12:39PM (#41973149)
> plenty of consumers disagree with you

What do you mean? This was just announced, no? Are there any sales/pre-order figures already?

Also, how would you even go about analyzing the counterfactual of whether the number of people who would buy this spec are "plenty" compared to the number who would have bought a spec with more RAM had it been available?

Re:New iMac with M4 by cududa on Monday October 28, 2024 @01:45PM (#41973909)
Well by virtue of the fact that they've sold these un-repairable/ un-openable macs for 3 years now, and they're refreshing it instead of killing the product - all these things indicate consumers like the current approach
Re:New iMac with M4 by GeekyBear on Monday October 28, 2024 @12:43PM (#41973192)
Exactly.

Someone who is looking to muck about with LLMs isn't looking to pay for a 4k screen that cannot be separated from a non-upgradeable PC.

If you're in the Apple ecosystem, you're going to want eithet a Mac Mini Pro or a Mac Studio, depending on where the RAM configurations on the Mac Mini Pro tops out. .

Re:New iMac with M4 by vineyardlabs on Monday October 28, 2024 @12:11PM (#41972734)
RAM aside, it would be silly for you to ever buy this model for your use case anyway. This is the base M4 that's also in ipads with no active cooling. If your running large LLMs locally, you aren't the target market for this product.
Re:New iMac with M4 by wtallis on Monday October 28, 2024 @12:12PM (#41972743)
> I'm on a M2 with 64GB at the moment and I'm already regretting not going for 96 or even 128.

You're using a M2 Max, not a M2. Two (big) steps up the chip product stack from what's used in the iMac.

Re:New iMac with M4 by dagmx on Monday October 28, 2024 @12:12PM (#41972749)
You have a higher tier M2. This is the base M4.

The comparison is apples to oranges.

Re:New iMac with M4 by notarealllama on Monday October 28, 2024 @12:19PM (#41972863)
It's literally Apple to Apple
Re:New iMac with M4 by sroussey on Monday October 28, 2024 @01:11PM (#41973531)
Ryzen 3000G vs Instinct 300A — both literally comparing AMD to AMD.

Sheesh

Re:New iMac with M4 by declan_roberts on Monday October 28, 2024 @12:10PM (#41972717)
Which models are you running? I'm on a M2pro w/ 32gb and I can run meta llama 8B on lmstudio pretty decently while coding.
Re:New iMac with M4 by simonw on Monday October 28, 2024 @12:18PM (#41972828)
Yeah 8B is fine but I really want to run 70B (or even 405B but that's way outside my system at the moment).

I can run 70B at the moment... but not if I also want Firefox and VS Code at the same time.

Re:New iMac with M4 by Der_Einzige on Monday October 28, 2024 @12:22PM (#41972909)
I really wish that "elite" LLM folks like yourself or many others in the field would just abandon apple/mac.

Yes, they make better laptops from a hardware perspective. No, M series chips are not actually competitive with Nvidia hardware on anything except cheap (and relatively slow) inference of big models.

The fact that windows laptops are considered DOA despite the insane amount of inertia behind Nvidia GPUs is just sad. I want a world where Dell/Lenovo can actually convince folks like you or other "elites" to use their shit. The XPS should be a better laptop than the macbook pro. Yet, I have to watch as the technical elites fawn over a company which continues to sell a starting level un-upgradable laptop with 8gb of ram and a gimped "SSD" in 2024 (this was criminal to do back in 2018) all because other companies can't make a good keyboard or touchpad.

I have a similar old-man yelling at cloud tier rant about the slow death of X86...

Re:New iMac with M4 by internetter on Monday October 28, 2024 @12:36PM (#41973114)
> The XPS should be a better laptop than the macbook pro.

Except its.. not. I'm a longtime windows/linux user who recently switched to mac, and my mac somehow manages to get better performance out of the same specs while lasting 2x longer on battery. In my price range, there is no competition on price:performance:battery.

Re:New iMac with M4 by maleldil on Monday October 28, 2024 @01:07PM (#41973490)
> all because other companies can't make a good keyboard or touchpad

Or screen, sound, battery life, cooling, weight...

Are MBPs the best possible configuration out there? Of course not. But they're just much better _mobile devices_ than anything else available.

Re:New iMac with M4 by t-3 on Monday October 28, 2024 @12:51PM (#41973302)
XPS are horrible though. Native linux support is almost literally the only redeeming quality.

> all because other companies can't make a good keyboard or touchpad.

The whole point of a laptop is to have integrated input and display. Why wouldn't you expect the laptops with the best displays and input devices to be the most popular?

Re:New iMac with M4 by carstenhag on Monday October 28, 2024 @02:12PM (#41974250)
I don't do LLM so I can't comment there. But in general, devs/pros would use windows/linux laptops if they could. All we get is crappy build quality or bad battery endurance or bad performance (CPU or super basic stuff like the touchpad etc) or bad software.
Re:New iMac with M4 by pram on Monday October 28, 2024 @12:42PM (#41973175)
You pretty casually dismiss the value of being able to run big models, when it's literally impossible on a mobile Geforce in a lot of cases since they max out at 16GB!
Re:New iMac with M4 by risho on Monday October 28, 2024 @01:10PM (#41973525)
macbook pros are by far the best device you can get for running local llms. first of all nvidia gpu's have extremely limited vram relative to the 100+gb afforded to macbook pros. second you cant take an llm server on the subway with you.

until you can show me small nvidia laptop with 128gb of vram and 20 hours of battery life, i'll keep using my macbook.

Re:New iMac with M4 by whywhywhywhy on Monday October 28, 2024 @01:16PM (#41973587)
Nvidia's laptop range isn't all that impressive, really the magic is in the 3090/4090 desktop cards where they're hitting a magic trifecta of power+memory+value.

As absurd as it is I just built a PC with a 3090 at both home and work for training and inference then carry around a MBP for everything else.

Re:New iMac with M4 by slashdave on Monday October 28, 2024 @01:07PM (#41973496)
> No, M series chips are not actually competitive with Nvidia hardware

Integrated memory is important, since CPU <-> GPU bandwidth is often a limiting factor

Re:New iMac with M4 by cherioo on Monday October 28, 2024 @12:35PM (#41973094)
They would run from Mac when nvidia offers a 128gb or 512gb laptop offering.

Until then it’s meaningless to even consider windows (laptop)

Re:New iMac with M4 by leptons on Monday October 28, 2024 @12:41PM (#41973167)
There are a lot of "power users" that refuse to realize that they simply will never be in Apple's target market. They love Apple so much for cosmetic reasons, for wanting to be in the "in-crowd" reasons, or for whatever the fanboy reason, that they can't see the writing on the wall. Apple is not making hardware for their use cases, and likely never will again.
Re:New iMac with M4 by seabird on Monday October 28, 2024 @12:59PM (#41973395)
Most of the world is x86/Windows machines, developers included. I would bet that for every MacBook issued there's at least a hundred Precision/Latitude/ThinkPad/Optiplex machines that went into someone's hands. The Apple hard-on is from a specific region and culture where the technical "elites" have made a bajillion dollars working on shitty phone apps and other such light work where it's possible for your trackpad/keyboard to be the biggest issue. It sounds a bit mean-spirited, but I think it's pretty telling that as the gravity of the work increases, you see less and less Apple products being used to do it.
Re:New iMac with M4 by steve_adams_86 on Monday October 28, 2024 @01:12PM (#41973545)
No, it isn't mean-spirited at all. A lot of lucrative software development has been based around fairly trivial software, all things considered. The barrier to entry was dramatically reduced, the resources required for development were too, and the option to choose your favourite hardware became an option. I think some people might be offended by that, but the variation of required hardware goes in all kinds of directions. Look at working on firmware vs the web, for example. You'll probably encounter a ton of friction on a mac if you get into robotics.
Re:New iMac with M4 by exe34 on Monday October 28, 2024 @01:29PM (#41973745)
> It sounds a bit mean-spirited, but I think it's pretty telling that as the gravity of the work increases, you see less and less Apple products being used to do it.

it does sound like envy. I hate macos post 10.8ish myself, but the hardware is pretty solid. my 12 year old Mac book air would be enough for my work although I have to use a windows laptop issued by work. I don't want to dox myself, but I'd say my work is of international interest even though it's quite niche.

Re:New iMac with M4 by seabird on Monday October 28, 2024 @05:14PM (#41976377)
There's definitely some envy -- the hardware is beyond solid. It's definitely bordering on the best there is if it isn't already there. macOS as a computing environment is just too far off the beaten path in too many ways to realistically deal with, which is why Windows absolutely dominates everything everywhere that isn't Bay Area web-based software companies. Not to say that Windows is particularly good, but for most people that actually need to drop $2500+ on a computer, it's probably better.
Re:New iMac with M4 by fourfour3 on Tuesday October 29, 2024 @10:20AM (#41984101)
There's still an awful lot of Mac around.

It's very common in networking, sysadmin/devops, and web development in the UK, for instance. I go to a reasonable number of industry events and MacBooks are definitely the majority at these.

Re:New iMac with M4 by flemhans on Monday October 28, 2024 @12:13PM (#41972753)
When I first scanned your sentence I assumed you were gonna write that 32 GB is now the minimum, not the maximum.
Re:New iMac with M4 by lynguist on Monday October 28, 2024 @01:03PM (#41973452)
But that means the next Air will be upgrade worthy for those who want an Air and a memory uplift from 24 max to 32 max!
Re:New iMac with M4 by gigatexal on Monday October 28, 2024 @12:10PM (#41972721)
M3 MAX here with 128GB ... and even that's not going to be enough one day.

I bet the M4 Max goes to 256. Oh the envy I will have.

Re:New iMac with M4 by a_wild_dandan on Monday October 28, 2024 @12:29PM (#41973011)
I'm so jazzed to comfortably run Llama 3 405b on my Mac with less quantization.
Re:New iMac with M4 by gigatexal on Wednesday October 30, 2024 @01:37PM (#41997976)
It only goes to 128 :/
Re:New iMac with M4 by turnsout on Monday October 28, 2024 @12:14PM (#41972785)
I'll be curious to see if the Mini has an M4 Pro option, and if so, what the RAM ceiling will be!
Re:New iMac with M4 by sroussey on Monday October 28, 2024 @12:33PM (#41973069)
I guess we find out tomorrow.
Re:New iMac with M4 by andrewmcwatters on Monday October 28, 2024 @12:23PM (#41972921)
I own a MacBook Pro (16-inch, 2021) Apple M1 Max 64 GB. I'm just adding to this that at the time of purchase, this was Apple's top-of-the-line MacBook Pro model, and it's just not that great, in my opinion.

Apple's new hardware pales in comparison to the relative abilities of what features existed on a 27-inch iMac with Retina 5K Display 10 years ago.

All of the power of modern computers come primarily from their GPUs, and Apple's aren't very good, and have been chronically underpowered compared to the competition for years now.

I'm considering relegating Apple devices to being good for just design work.

Edit: I agree with Der_Einzige's sentiments. It's beyond time for us to move past Apple hardware.

Re:New iMac with M4 by _fw on Monday October 28, 2024 @12:59PM (#41973402)
Can you elaborate on this? It’s my understanding that the CPU alone on that machine even blows the iMac Pro out of the water in terms of performance.

Can you share where you’re finding inadequate performance? Genuinely curious to know

Re:New iMac with M4 by wordofx on Monday October 28, 2024 @01:31PM (#41973759)
Unless Op has a very special use case that requires an Nvidia card or something then he doesn’t know what he’s talking about. The M2 Max fully specced 14” is insane. Being able to take the laptop anywhere and not need to plug it in and still get all the same power I normally get if it’s plugged in without the worry of the battery dying in 30m is incredible.
Re:New iMac with M4 by seec on Wednesday October 30, 2024 @11:55PM (#42003341)
Yeah that's pretty much the problem with modern Apple hardware. If you just want a computer to do casual "home" stuff they feel very overpriced for what they will allow you to do, even though the design and build quality are good. And if you start to drop a lot of cash for a very powerful machine, they seem very underwhelming for the amount of cash you will need in comparison to a beastie PC.

The MacBook Pros are in a class of their own but I suspect that most who buy the higher end ones do not actually use the power all that much (they would prefer a real workstation otherwise).

When I used to work at an Apple Premium Service Provider, all the clients who had the high-end MacBook Pro were the executives and people like that who made little use of the power. Every worker, even in media agencies had a desktop workstation (iMac or Mac Pro).

The MacBook Pro craze is mainly a Silicon Valley startup thing.

And yes, Apple computers are mostly useful for design/media work, if you have more use cases you are very likely to hit a roadblock, which is sad for the price.

Re:New iMac with M4 by insane_dreamer on Monday October 28, 2024 @12:29PM (#41973009)
I missed the "also great for mucking around with LLMs!" in the press release
Re:New iMac with M4 by sroussey on Monday October 28, 2024 @12:42PM (#41973183)
I have a M2 with 64GB and find that it’s fine.

Larger models that don’t fit are only moderately better, while much slower. I’d want higher memory bandwidth over more memory.

The next five years will push for better models that are smaller. Smaller is faster and more useful.

I feel like we are in the brute force phase of model development and that it will pass.

Running 405B param model in 16bit on my laptop would be neat, but I’d stop after the novelty wore off.

Re:New iMac with M4 by jollyllama on Monday October 28, 2024 @12:44PM (#41973205)
Huh, is that a step backwards for them? iMacs from over 6 years ago were upgradeable to 64
Re:New iMac with M4 by tiltowait on Monday October 28, 2024 @01:18PM (#41973606)
The M-series is a little more complicated. The M1 was max 16GB, with the Pro and Max going up to ... 64, I think? The latest models can go higher, but we're still a long ways off from the old Mac Pro's 1.5TB max.
Re:New iMac with M4 by jollyllama on Tuesday October 29, 2024 @01:29PM (#41987095)
I'm talking about a regular iMac Retina circa 2016.
Re:New iMac with M4 by sleepybrett on Monday October 28, 2024 @12:44PM (#41973207)
why would you want an imac of all things for that? I suspect we are going to see m4 studios, which, given their current options, will support your rediculous ram requirements.

iMacs are, generally speaking, targeted for home users, normies.

Re:New iMac with M4 by grecy on Monday October 28, 2024 @01:02PM (#41973433)
It sounds like you should buy products in the "pro" line.
Re:New iMac with M4 by vid on Monday October 28, 2024 @01:33PM (#41973777)
I think the OP's point is that Apple is forcing people to pay a lot more for something that doesn't cost Apple that much (extra RAM) and is part of artificial product lines. One could claim the product lines are important for ultimate profitability, but Apple makes so much money it's hardly critical if they wanted to be a truly incredible consumer focused company. Apple has gotten far away from the idea of a home computer someone can hack with, where hacking includes local AI these days. In this period we know more memory is important for many applications of local AI, which they claim is a goal to provide for people, so it's hard not to say Apple's approach is optimized for shareholders, not end users.
Re:New iMac with M4 by grecy on Monday October 28, 2024 @02:49PM (#41974658)
Then it sounds like OP ( and yourself) should spend your money elsewhere.

I mean, I’m livid Ferrari don’t make a cheap commuter for my family and 9 dogs. So I shop elsewhere.

Re:New iMac with M4 by vid on Monday October 28, 2024 @04:36PM (#41975970)
Oh, I do take my money elsewhere. However, your livid-ness is a lot more misplaced compared to expecting a very massive, "user friendly," general computing company that "thinks different" to give the people what they want.
Re:New iMac with M4 by grecy on Tuesday October 29, 2024 @12:34AM (#41979405)
That was sarcasm.
Re:New iMac with M4 by vid on Tuesday October 29, 2024 @09:39AM (#41983732)
Actually your comment was facetious. But that inherently shows how you don't believe Ferrari would make a general consumer offering, in contrast to what people might expect from Apple.
Re:New iMac with M4 by grecy on Wednesday October 30, 2024 @05:27AM (#41993192)
Apple make products for pros, and products for everyday people.

Obviously there will always be use cases at each far end and in the middle they won’t meet unless that have 50,000 SKUs.

It’s fine, just spend your money elsewhere. Complaining about a trillion dollar company is not going to change anything or make you happy, so why do it?

Re:New iMac with M4 by slashdave on Monday October 28, 2024 @01:04PM (#41973464)
But... new colors!
Re:New iMac with M4 by zephyrfalcon on Tuesday October 29, 2024 @06:59AM (#41982496)
So they say, but I'm really not sure what has changed... see https://support.apple.com/en-us/111895 ...?
Re:New iMac with M4 by steve_adams_86 on Monday October 28, 2024 @01:06PM (#41973485)
Similar case here. I'm on a 32GB Mac Studio and constantly wishing I had 128. I didn't expect that when I chose 32... I'd been getting by fine with 16 for a decade. I was "future proofing", haha.
Re:New iMac with M4 by pmarreck on Monday October 28, 2024 @01:07PM (#41973499)
Came here to post this. Although I'm looking for an M4 Macbook Pro with 128GB RAM for the same reason. This going to be announced?

#OneOfUs #OneOfUs

Re:New iMac with M4 by sroussey on Monday October 28, 2024 @01:23PM (#41973655)
My guess is Wednesday.

- iMac today, USB accessories

- Mac Mini on Tuesday, likely debut M4 Pro

- MacBooks on Wednesday, debut M4 Max

Now in the “I wish” category (zero percent chance):

- Thursday would be MacStudio with HBM memory for Max and Ultra

- Friday would be macPro with 1 to 4 Ultra in NUMA configuration.

Now I don’t believe those last two.

But I do want to see the X-ray of the max chip to see if it has the UltraFusion part that allowed for combining two chips. It was missing from the M3 Max (and maybe all future odd numbered max chips). If it returns, then we know an Ultra is on the way for sure.

Re:New iMac with M4 by pmarreck on Wednesday October 30, 2024 @09:21AM (#41994487)
This seems like an excellent educated guess (and you were right about the Mac Mini!)
Re:New iMac with M4 by pmarreck on Friday November 01, 2024 @06:41PM (#42022272)
you were spot-on! Ordered!
Re:New iMac with M4 by beAbU on Monday October 28, 2024 @01:12PM (#41973539)
I'm pretty sure the iMac with no upgradeable RAM nor external GPU support is really targeting the hobbyist big-compute crowd anyway. So you don't have to worry, they are not trying to make you buy one.
Re:New iMac with M4 by znpy on Monday October 28, 2024 @01:19PM (#41973620)
> As someone who mucks around with running LLMs and other large models on my computer the 32GB maximum RAM is a show-stopper for me.

your specific use-case is probably irrelevant to apple.

> I want to be able to run a large model AND other apps at the same time.

you answered yourself... go for a machine with 96 or 128gb ram.

btw for the money you'd be spending (6-7 k$) you might as well rent or buy a dedicated box with 128, 256gb or more ram and all the gpus you need.

Re:New iMac with M4 by xyst on Monday October 28, 2024 @01:24PM (#41973676)
This computer appeals to families that use their computers to browse social media. For grandparents that browse YouTube with reckless abandon. The emphasis on multiple color options is a strong indicator. Even has some “cutesy” appeal for college students to decorate their dorm.

The “Apple Intelligence” branding is nothing more than a selling point. Sure it might run some very small LLM workloads , but don’t expect much especially in the locked down hell known as Apple ecosystem.

This is not meant for heavy workloads.

Re:New iMac with M4 by mark_l_watson on Monday October 28, 2024 @01:25PM (#41973682)
For many use cases you are correct. That said, I bought a 32G M2 Mac mini in January, and mostly using Ollama, I use local LLMs for many useful local apps and many experiments. I augment running local models with Colab Pro, Grok APIs, OpenAI APIs, etc.
Re:New iMac with M4 by neodymiumphish on Monday October 28, 2024 @01:28PM (#41973727)
This is the chief reason I’m closely watching this week’s releases from Apple. I’ll hopefully be switching from UnRAID to a Mac Mini or Mac Studio and a multi-drive enclosure, but the Mac needs to support enough RAM for my various services (Plex and Immich primarily) as well as enough to test some large LLM models as a replacement to constant Claude/OpenAI API utilization.
Re:New iMac with M4 by efficax on Monday October 28, 2024 @01:29PM (#41973736)
It's an iMac, the target market is not running local LLMs or doing machine learning research
Re:New iMac with M4 by anthk on Monday October 28, 2024 @01:32PM (#41973770)
And here I am with 1GB and 512MB as ZRAM on an Atom Netbook. With SBCL.
Re:New iMac with M4 by lanza on Monday October 28, 2024 @01:34PM (#41973791)
When shopping for a new car to take to the race track on the weekends did you stop and point out that the Honda Odyssey's suspension is too soft?
Re:New iMac with M4 by bonestamp2 on Monday October 28, 2024 @02:02PM (#41974132)
Same here, I wish I went for 128. That said, I don't think this use case applies to 99.9999% of iMac buyers.