News for hackers. Stuff that matters.
Re:M4 MacBook Pro by tomrod on Wednesday October 30, 2024 @11:10AM (#41995820)
This is the first compelling Mac to me. I've used Macs for a few clients and muscle memory is very deeply ingrained for linux desktops. But with local LLMs finally on the verge of usability along with sufficient memory... I might need to make the jump!

Wish I could spin up a Linux OS on the hardware though. Not a bright spot for me.

Re:M4 MacBook Pro by aidenfoxivey on Wednesday October 30, 2024 @11:18AM (#41995925)
You totally can after a little bit of time waiting for M4 bringup!

https://asahilinux.org

It won't have all the niceties / hardware support of MacOS, but it seamlessly coexists with MacOS, can handle the GPU/CPU/RAM with no issues, and can provide you a good GNU/Linux environment.

Re:M4 MacBook Pro by umanwizard on Wednesday October 30, 2024 @12:18PM (#41996891)
"a little bit of time" is a bit disingenuous given that they haven't even started working on the M3.

(This isn't a dig on the Asahi project btw, I think it's great).

Re:M4 MacBook Pro by p_j_w on Wednesday October 30, 2024 @11:30AM (#41996146)
Asahi doesn't work on M3 yet after a year. It's gonna be a bit before M4 support is here.
Re:M4 MacBook Pro by quux on Wednesday October 30, 2024 @11:35AM (#41996255)
IIRC one of the major factors holding back M3 support was the lack of a M3 mini for use in their CI environment. Now that there's an M4 mini hopefully there aren't any obstacles to them adding M4 support
Re:M4 MacBook Pro by mmcnl on Wednesday October 30, 2024 @11:38AM (#41996289)
Why would that matter? You can use a MacBook in CI too?
Re:M4 MacBook Pro by umanwizard on Wednesday October 30, 2024 @12:42PM (#41997230)
How? What cloud providers offer it? MacStadium and AWS don't.

I guess you could have a physical MBP in your house and connect it to some bring-your-own-infrastructure CI setup, but most people wouldn't want to do that.

Re:M4 MacBook Pro by mmcnl on Wednesday October 30, 2024 @04:10PM (#41999658)
I meant using a physical device indeed.
Re:M4 MacBook Pro by wtallis on Wednesday October 30, 2024 @05:42PM (#42000726)
Cloud providers don't seem too relevant to a discussion of CI for kernel and driver development.
Re:M4 MacBook Pro by umanwizard on Wednesday October 30, 2024 @06:03PM (#42000949)
Why not?
Re:M4 MacBook Pro by wtallis on Wednesday October 30, 2024 @06:43PM (#42001335)
How do you imagine that a cloud computing platform designed around running Macs with macOS would work for testing an entirely different OS running on bare metal on hardware that doesn't have a BMC, and usefully catching and logging frequent kernel panics and failed boots?

It's a pretty hard problem to partially automate for setups with an engineer in the room. It doesn't sound at all feasible for an unattended data center setup that's designed to host Xcode for compiling apps under macOS.

Re:M4 MacBook Pro by manmal on Wednesday October 30, 2024 @05:52PM (#42000827)
GitHub’s self hosted runners are as painless as they can get, and the Mac Mini in my basement is way faster than their hosted offering.
Re:M4 MacBook Pro by chippiewill on Thursday October 31, 2024 @08:20AM (#42006111)
Getting M4 Mac Mini CI might be a while considering the amount they've changed the package. Too tall to go into a 1U, smaller so the rack frames need to be redesigned. Power button now on the bottom so switch actuation need finagling.
Re:M4 MacBook Pro by d1str0 on Wednesday October 30, 2024 @11:16AM (#41995905)
Check out Asahi linux
Re:M4 MacBook Pro by BenFranklin100 on Wednesday October 30, 2024 @11:24AM (#41996024)
Off topic, but I’m very interested in local LLMs. Could you point me in the right direction, both hardware specs and models?
Re:M4 MacBook Pro by doctoboggan on Wednesday October 30, 2024 @11:42AM (#41996363)
In general for local LLMs, the more memory the better. You will be able to fit larger models in RAM. The faster CPU will give you more tokens/second, but if you are just chatting with a human in the loop, most recent M series macs will be able to generate tokens faster than you can read them.
Re:M4 MacBook Pro by int_19h on Wednesday October 30, 2024 @02:07PM (#41998347)
That also very much depends on model size. For 70B+ models, while the tok/s are still fast enough for realtime chat, it's not going to be generating faster than you can read it, even on Ultra with its insane memory bandwidth.
Re:M4 MacBook Pro by thrownblown on Wednesday October 30, 2024 @11:37AM (#41996277)
Re:M4 MacBook Pro by BenFranklin100 on Wednesday October 30, 2024 @12:02PM (#41996675)
Thanks to both of you!
Re:M4 MacBook Pro by noman-land on Wednesday October 30, 2024 @01:16PM (#41997724)
Get as much RAM as you can stomach paying for.
Re:M4 MacBook Pro by touristtam on Wednesday October 30, 2024 @03:58PM (#41999526)
Have a look at ollama? I think there is a vscode extension to hook into local LLM if you are so inclined: https://ollama.com/blog/continue-code-assistant
Re:M4 MacBook Pro by lowbloodsugar on Wednesday October 30, 2024 @11:36AM (#41996270)
You can spin up a Unix OS. =) It’s even older than Linux.
Re:M4 MacBook Pro by umanwizard on Wednesday October 30, 2024 @12:20PM (#41996923)
NextSTEP which macOS is ultimately based on is indeed older than Linux (first release was 1989). But why does that matter? The commenter presumably said "Linux" for a reason, i.e. they want to use Linux specifically, not any UNIX-like OS.
Re:M4 MacBook Pro by lowbloodsugar on Wednesday October 30, 2024 @05:17PM (#42000436)
Sure. But not everybody. That’s how I ended up on a Mac. I needed to develop for Linux servers and that just sucked on my windows laptop (I hear it’s better now?). So after dual booting fedora on my laptop for several months I got a MacBook and I’ve never looked back.
Re:M4 MacBook Pro by tomrod on Wednesday October 30, 2024 @02:06PM (#41998340)
BSD is fun (not counting MacOS in the set there), but no, my Unix experiences have been universally legacy hardware oversubscribed and undermaintained. Not my favorite place to spend any time.
Re:M4 MacBook Pro by __MatrixMan__ on Wednesday October 30, 2024 @01:13PM (#41997675)
I miss Linux, it respected me in ways that MacOS doesn't. But maintaining a sane dev environment on linux when my co-workers on MacOS are committing bash scripts that call brew... I am glad that I gave up that fight. And yeah, the hardware sure is nice.
Re:M4 MacBook Pro by tomrod on Wednesday October 30, 2024 @02:05PM (#41998318)
IIRC brew supports linux, but it isn't a package manager I pay attention to outside of some very basic needs. Way too much supply chain security domain to cover for it!
Re:M4 MacBook Pro by __MatrixMan__ on Wednesday October 30, 2024 @08:15PM (#42002098)
It does, but I prefer to keep project dependencies bound to that project rather than installing them at wider scope. So I guess it's not that I can't use Linux for work, but that I can't use Linux for work and have it my way.

I could use a VM or something, but if I must tolerate some kind of enclosing boundary, it might as well just be a MacBook.

Re:M4 MacBook Pro by darylteo on Wednesday October 30, 2024 @10:14PM (#42002775)
I've been lightly using ollama on the m1 max and 64gb RAM. Not a power user but enough for code completions.
Re:M4 MacBook Pro by w10-1 on Thursday October 31, 2024 @02:20AM (#42003978)
macOS virtualization of Linux is very fast and flexible. Their sample code shows it's easy without any kind of service/application: https://developer.apple.com/documentation/virtualization/run...

However, it doesn't support snapshots for Linux, so you need to power down each session.