Generative AI Is Coming to Phones Soon Posted by ramyaravi19 on Monday August 28, 2023 @05:00PM from the cnet.com dept. https://www.cnet.com/tech/mobile/generative-ai-is-coming-to-phones-next-year-thanks-to-qualcomm-chips/ ( 1 comment | 3 points | on HN )
The page says they shrunk it by quantizing from FP32 to INT8.
What I can't tell... is there a demo app? Can this be run today on a Qualcomm based device?