Ask HN: Cheapest hardware to run Llama 2 70B

Re:Ask HN: Cheapest hardware to run Llama 2 70B by phas0ruk on Wednesday August 09, 2023 @04:45PM (#37068131)

SageMaker

[ Parent | on HN ]

Re:Ask HN: Cheapest hardware to run Llama 2 70B by jrflowers on Wednesday August 09, 2023 @05:38PM (#37068800)

How much can I purchase one (1) SageMaker for?

[ Parent | on HN ]

Re:Ask HN: Cheapest hardware to run Llama 2 70B by vasili111 on Wednesday August 09, 2023 @05:10PM (#37068461)

How much approximately will be price per hour?

[ Parent | on HN ]

Re:Ask HN: Cheapest hardware to run Llama 2 70B by astrodust on Wednesday August 09, 2023 @05:35PM (#37068767)

Very yes.

[ Parent | on HN ]

Re:Ask HN: Cheapest hardware to run Llama 2 70B by synaesthesisx on Wednesday August 09, 2023 @05:52PM (#37068950)

Fair warning - tools like SageMaker are good for simple use cases, but SageMaker tends to abstract away a lot of functionality you might find yourself digging through the framework for. Not to mention - it's easy to rack up a hefty AWS bill

[ Parent | on HN ]