News for hackers. Stuff that matters.

A comment on Introducing DBRX: A New State-of-the-Art Open LLM by Databricks. Parent comment

Re:Introducing DBRX: A New State-of-the-Art Open LLM by Data... by Jedd on Wednesday March 27, 2024 @11:12PM (#39847376)
Are you aware how Macs present memory? Their 'unified' memory approach means you could run an 80GB model on a 128GB machine.

There's no concept of 'dedicated GPU memory' as per conventional amd64 arch machines.

[ Parent | on HN ]

There are no comments on this comment yet.