masterofall2612

Re:Ask HN: Cheaper way to do model inference? on Friday May 31, 2024 @06:20PM (#40540931)

Yea exactly that's what I'm doing right now. I've looked into solutions like RunPod serverless, anyone have any experience with it?

Ask HN: Cheaper way to do model inference?

Posted by masterofall2612 on Friday May 31, 2024 @04:56PM
from the ask-hn dept.

Does anyone know of any solutions for saving GPU compute during server downtime? Is there a managed solution to turn off a pod and turn it back on when I need it? I'm currently doing model inference and most of the time I'm just paying for compute without serving any user requests.

( Read More... | 3 comments | 2 points | on HN )

Show HN: Lightweight Tool for Image Segmentation with Text Prompting

Posted by masterofall2612 on Wednesday May 01, 2024 @10:29AM
from the show-hn dept.

https://www.runswitchify.com/

Hi HN, I'd like to share an app called Switchify I built to help ML researchers speed up the annotation process for image training data.Just sign in, upload an image, enter a prompt and start labelling. Check it out at https://runswitchify.com!

( Read More... | 1 comment | 2 points | on HN )

Re:Roast My Winter Project on Tuesday January 02, 2024 @11:28PM (#38850749)

is it weird that I find this website is oddly satisfying to use