Show HN: I built a tool for mobile and computer use using local and remote LLMs

Re:Show HN: I built a tool for mobile and computer use using... by mkagenius on Wednesday December 18, 2024 @10:31AM (#42451248)

One close to my heart use case is to enable older people use phones easily.

Most of the app UIs built today is so difficult to use, people unfamiliar with technology find it even more challenging.

This tool if enabled with voice and freed from adb shackles can make it so convenient for the older folks or even the blind folks.

Part of my tool(finder) can even be used to create a walkthrough overlay on the screens.

Getting local models to eventually drive all this is the goal. Cost reduction due to that is a nice by-product.

More use cases I can think of will be in the security space, automating logins to test apps, for example. Using app+mitmproxy+llm to do some automations around security.

[ Parent | on HN ]

Re:Show HN: I built a tool for mobile and computer use using... by vkweb on Wednesday December 18, 2024 @10:47AM (#42451411)

I like the walkthrough use case.

For older people, they should find more use with Google assistant / siri doing simple tasks for them like calling, playing music, playing videos and so on.

[ Parent | on HN ]