Re:Performance of llama.cpp on Apple Silicon A-series
by girvo on Tuesday December 19, 2023 @08:17PM
(#38704344)
> maybe even affordable ASICs on the market
Part of me envisions a Coral-like device, but the kicker/difficulty/cost problem is always going to be fast, big memory. I think that puts a bit of a price floor on some of it. Can't wait to be wrong though!
Part of me envisions a Coral-like device, but the kicker/difficulty/cost problem is always going to be fast, big memory. I think that puts a bit of a price floor on some of it. Can't wait to be wrong though!