Hmmm. I instantly discounted this for my 2x DGX Spark cluster, but you're right. In 256Gb I could probably have large context and stream the experts from disk. I imagine it would get me like 10-15tps with a 30 minute prefill though.