Re:Running Llama.cpp on AWS Instances
by michaelt on Tuesday November 28, 2023 @05:29AM
(#38444341)
The pricing is shown in the first image on the page: $0.526 per hour.
[ Parent
| on HN ]
This is if we follow the recommendation to use a GPU. But if you don't need 200+ tokens per second and are happy with something like 10-15, a CPU-only solution is acceptable and would cost significantly less.