The next thing we want to do is obtain some glasses with cameras and wi-fi and send images to ollama from them for real-time description. The benefits are obvious, especially for mobility purposes.
If you’d like to briefly post I’m sure a lot of HN denizens would appreciate it however. I’ll just stand at the sidelines, post this and spectate the commentary and try it myself with a small group.
The real magic happens in [ollama](https://ollama.ai/), which lets you run LMMs locally.
Your mistake here is thinking what machine has understanding of anything. It doesn't. But if you know how human learning works, what is a compression and what is a lossy compression then it is quite easy to understand.
Machine is fed with tons of images with word references what is in the image. Then it finds what is similar in the images of a similar objects, ie works just like a compression algo, except it doesn't store the exact matches but relationships of some markers it finds in the images. That's why it doesn't and doesn't need to understand where is sofa and what is a sofa, it just have a relationship between something what has a relationship to the word 'sofa' and relationship with something what we, human describe as 'position'.
Very impressed with the capability here given that transcript, I’ll certainly try it myself. Thank you!
An additional question, if you don’t mind answering (and there’s zero obligation to). How have you found accessibility has changed on the web over the years? We have many tools these days to assist but do you feel there’s been a notable improvement to what used to be in place?
No, there has not been an improvement, and in fact, things have gotten worse in a lot of ways. Most of that is due to SPAs, and people who decide to use JavaScript when HTML widgets would suffice.
I'm also involved with a text mode web browser project, [edbrowse](https://edbrowse.org/). Ten years ago, it was feasible to use edbrowse for a great deal of online activity. For instance, I used it to make purchases from Amazon and other online stores. I could log into Paypal and send money with it.
Then, in the mid 2010s or so, SPAs started becoming a thing and edbrowse broke on more and more sites. At this point, in 2024, I can't even use it to read READMEs on Github.
And yes, I have accessibility trouble when using mainstream browsers too, all the time.
If everyone put their own loved ones in the situation of others, life would be different.
[1] https://community.openai.com/t/how-are-blind-people-using-op...
If there’s anything you need additional support with, check out ‘Be My Eyes’ app and hopefully someone will be useful for you!
What I gather is this is an IRC bot/plugin/add-on that will allow a user to prompt an ‘LMM’ which is essentially an LLM with multiple output capabilities (text, audio, images etc) which on the surface sounds awesome.
How does an LMM benefit blind users over an LLM with voice capability? Is the addition of image/video just for accessibility to none-blind people?
What’s the difference between this and integrating an LLM with voice/image/video capability?
Is there any reason that this has been made over other available uncensored/free/local LLMs (aside from this being an LMM)?
Thanks in advance.