Re:M2 Ultra can run 128 streams of Llama 2 7B in parallel
by astrodust on Thursday October 12, 2023 @08:22PM
(#37864909)
I saw it save the ass of a client who had one, as they got robbed and all their desktop computers, mostly iMacs, were stolen. The Mini was as much as lost in the wiring in the network closet and was overlooked, so everything had backups.
[ Parent
| on HN ]
There are no comments on this comment yet.