cibernox

24gb is the minimum ram in the Pro lineup, the max is 128gb and can run 200B models.

The mac ultra has up 512gb and while expensive has more than twice the memory than any GPU alternative on a similar price point.

What was dragging it behind was the lack of Matmul acceleration, which seems that will change soon. Likely nvidia cards will still be faster and have better support, but paying a very big premium for it (ironic that apple is the cheaper option for once)

There is none. We develop ember because we need a tool to solve our problems and the existing solutions weren't good enough in at least some aspect that mattered.

The idea is that opensourcing software makes people you don't know can use it, improve it and ultimately you get those improvements yourself.

It has it already. It had it for a while