News for hackers. Stuff that matters.
Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by piperswe on Thursday May 11, 2023 @03:58PM (#35907614)
Apple Silicon has unified memory - all memory is accessible to both the CPU and GPU parts of the SoC.
Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by karmasimida on Thursday May 11, 2023 @04:36PM (#35908041)
But they comes at max 32GB model?
Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by mkl on Thursday May 11, 2023 @05:48PM (#35908849)
Mac Studio (desktop) is up to 128GB, and Macbook Pro is up to 96GB.