News for hackers. Stuff that matters.

A comment on Ask HN: Cheaper way to do model inference?.

Re:Ask HN: Cheaper way to do model inference? by PaulHoule on Friday May 31, 2024 @05:25PM (#40540430)
You are running inference on something like an EC2 instance?
[ Parent | on HN ]
Re:Ask HN: Cheaper way to do model inference? by masterofall2612 on Friday May 31, 2024 @06:20PM (#40540931)
Yea exactly that's what I'm doing right now. I've looked into solutions like RunPod serverless, anyone have any experience with it?
[ Parent | on HN ]