Re:Show HN: I Built an AI Recruiting Toolkit Without Subscri...
by kranzelbart on Sunday September 08, 2024 @10:25AM
(#41480587)
We ran a token model for some time for precisely this reason, but came to the realization that the costs were comparatively low. We use OpenAI in the background.
ML Inference is pretty expensive in my experience - it's not clear to me whether you're running models yourself or paying someone like openai to do so, but either way GPUs aren't cheap