Re:Stealing everything you've ever typed on your Windows Rec...
by usrbinbash on Sunday June 02, 2024 @02:06PM
(#40556084)
> I dream of a system that automatically captures and allows me to interact with and query against everything I do
Well, I don't.
For starters, because not everything I do generates relevant information for me. All those hours spent surfing through random blogs or wikipedia articles, most news I read, or watching some random scifi series just isn't info that I will ever need to refer back to. It's just noise. Best case scenario, it's useless information that just bloats the database.
Alternative scenario: It messes with the results. Intelligence and statistics are not the same thing. So what if I read some scifi novel on my screen, and the content of that pages embedding just so happens to score higher to a future query than an actually useful document?
In my system, I decide what's relevant information and what isn't. Subsequently, when I use RAG on this, I use it on already curated data. That data is already having structure imposed on it, so it is accessible to me with our without the help of AI.
--------
Then there is also the whole issue about information that is simply too sensitive to store in my personal Wiki. For example: I would NEVER store my bank account details, or API keys in there, even though everything is encrypted. All passwords and similar information go into a separate system FOR A REASON; Single points of failure are bad, and this goes double in security.
Now, a system that takes a screenshot and runs OCR on everything? Cool. What if it does so when I am just running a testscript after setting a temporary envvar in preparation? I don't want that info anywhere outside of my password manager. And yes, this does matter, even if everything is stored locally.
--------
And, of course, we haven't even started on the whole issue of privacy, and how people will feel about a system that basically logs and stores everything the user does. It doesn't matter how useful it could be if people don't feel comfortable with it.
Well, I don't.
For starters, because not everything I do generates relevant information for me. All those hours spent surfing through random blogs or wikipedia articles, most news I read, or watching some random scifi series just isn't info that I will ever need to refer back to. It's just noise. Best case scenario, it's useless information that just bloats the database.
Alternative scenario: It messes with the results. Intelligence and statistics are not the same thing. So what if I read some scifi novel on my screen, and the content of that pages embedding just so happens to score higher to a future query than an actually useful document?
In my system, I decide what's relevant information and what isn't. Subsequently, when I use RAG on this, I use it on already curated data. That data is already having structure imposed on it, so it is accessible to me with our without the help of AI.
--------
Then there is also the whole issue about information that is simply too sensitive to store in my personal Wiki. For example: I would NEVER store my bank account details, or API keys in there, even though everything is encrypted. All passwords and similar information go into a separate system FOR A REASON; Single points of failure are bad, and this goes double in security.
Now, a system that takes a screenshot and runs OCR on everything? Cool. What if it does so when I am just running a testscript after setting a temporary envvar in preparation? I don't want that info anywhere outside of my password manager. And yes, this does matter, even if everything is stored locally.
--------
And, of course, we haven't even started on the whole issue of privacy, and how people will feel about a system that basically logs and stores everything the user does. It doesn't matter how useful it could be if people don't feel comfortable with it.