News for hackers. Stuff that matters.

A comment on Why Ruby on Rails still matters. Parent comment

Re:Why Ruby on Rails still matters by philip1209 on Friday February 21, 2025 @10:18PM (#43135760)
Yeah, the mac minis can have up to 64GB of ram which would support some usable models. However, I accidentally got one with 24gb of ram, and my apps already use 12gbs. So, perhaps I'll get a second box just for LLMs!
[ Parent | on HN ]
Re:Why Ruby on Rails still matters by aurareturn on Friday February 21, 2025 @10:24PM (#43135793)
A small model like 1B or 3B should be ok with 16GB. I was thinking in the name of savings, you can just use the same machine.

It's a cool project. I might do it too. I have an M4 Mini sitting on my desk that I got for $550.

[ Parent | on HN ]