Gemma locally on iOS, Android, web browsers, and GPUs with a single framework

Posted by CharlieRuan on Friday February 23, 2024 @05:28PM
from the old.reddit.com dept.

( 1 comment | 4 points | on HN )

Re:Gemma locally on iOS, Android, web browsers, and GPUs wit... by crowwork on Friday February 23, 2024 @05:57PM (#39487218)

2b model running at 20tok/sec on iphone, nice potential for future applications

[ Parent | on HN ]