News for hackers. Stuff that matters.
Re:Llama2.c: inference llama 2 in one file of pure C by summarity on Monday July 24, 2023 @02:52AM (#36843935)
If you're running on Ampere, using llama.cpp is probably not ideal. While it's optimized for ARM, Ampere has native acceleration for workloads like this: https://cloudmarketplace.oracle.com/marketplace/en_US/adf.ta...

There are no comments on this comment yet.