What would be good for DRAM read speeds, and not care too much write speeds?
I’m thinking of keeping an LLM’s weights in a storage RAM, where it would be updated only every few months.
I’m thinking of keeping an LLM’s weights in a storage RAM, where it would be updated only every few months.
Link: https://bitsavers.org/pdf/dec/semiconductor/arm/EC-QU5KA-TE_...