News for hackers. Stuff that matters.
Re:Apple: Transformer architecture optimized for Apple Silicon by pornel on Thursday March 23, 2023 @09:11PM (#35283792)
Hundreds of GBs of RAM in a phone is just ~6 years away if Moore's law holds. It's also likely that memory requirements will be shrunk through software and ML improvements.
Re:Apple: Transformer architecture optimized for Apple Silicon by AgentOrange1234 on Thursday March 23, 2023 @09:17PM (#35283849)
I don’t think RAM on phones has been increasing exponentially? For good reason — it uses a lot of power.
Re:Apple: Transformer architecture optimized for Apple Silicon by pornel on Thursday March 23, 2023 @09:32PM (#35283943)
It has been increasing. In iPhones went from 128MB to 6GB, and there are Android phones with 18GB now.

RAM hasn't been increasing as steeply as it could, but if there's a strong use-case for it, it may happen. Also consider that Apple is in control of the whole chipset and software, so they could implement things like turning the extra RAM on only during ML computation.

Re:Apple: Transformer architecture optimized for Apple Silicon by datpiff on Friday March 24, 2023 @07:33AM (#35287683)
> Hundreds of GBs of RAM in a phone is just ~6 years away if Moore's law holds.

It's not expected to. The consensus seems to be ~2025 https://arxiv.org/abs/1511.05956