The killer app of Gemini Pro 1.5 is video

Re:The killer app of Gemini Pro 1.5 is video by dav43 on Wednesday February 21, 2024 @07:44PM (#39461663)

I set up two years ago a cron to screenshot every minute.

Just did the second phase of using ocrmac (vision kit cli on GitHub) that extracts text and dumps it in a SQLite with FTS5.

It’s simplistic but does the job for now.

I looked at reducing storage requirements by using image magik to only store the difference between images - some 5 min sequence are essentially the same screen - but let that one go.

[ Parent | on HN ]

Re:The killer app of Gemini Pro 1.5 is video by sdenton4 on Wednesday February 21, 2024 @08:30PM (#39461983)

/using image magik to only store the difference between images/

Well, that's basically how video codecs work... So might as well just find some codec params which work well with screen capture, and use an existing encoder.

[ Parent | on HN ]

Re:The killer app of Gemini Pro 1.5 is video by xhrpost on Wednesday February 21, 2024 @11:19PM (#39463212)

Thanks for sharing. Curious, what main value adds have you gotten out of this data?

[ Parent | on HN ]

Re:The killer app of Gemini Pro 1.5 is video by dav43 on Monday February 26, 2024 @12:48AM (#39508024)

I’m loose with my memory and I’d often recall reading or looking at something and could never find it in safari history etc. with info spread across WhatsApp emails files web history is helped nudge me in the right direction here and there. Saved me once when i made an online purchase, never got an email confirmation as well.

[ Parent | on HN ]