News for hackers. Stuff that matters.
Re:How to build a working AI only using synthetic data in ju... by version_five on Monday June 13, 2022 @11:57AM (#31727308)
How big of a model is CLIP? If you're building a phone app that classifies dogs, you may not want to require that it runs some multi-billion parameter monstrosity to perform its comparatively simple task. There is lots of value in building a compact model. "Just" typing in the names ignores the compute you need to have behind the scenes.
Re:How to build a working AI only using synthetic data in ju... by minimaxir on Monday June 13, 2022 @12:15PM (#31727558)
A compact model is a constraint that changes the problem entirely and doesn't discredit the quick-but-effective approach that works for nearly every other use case.
Re:How to build a working AI only using synthetic data in ju... by tehsauce on Monday June 13, 2022 @01:31PM (#31728681)
There are various sizes of CLIP, many are not enormous. For example, one of the base models is just a standard resnet50. So very usable on a mobile device.