In a vacuum, where you could be personally guaranteed this data remains on device and you the user had complete control and ownership, I can see how this could be useful.
But I would never allow a third party that sort of access, full stop
On linux you could easily do it, by running a script every n minutes that takes a screenshot and pipes it to an ai and then stores it wherever you want (including a local NAS)
With some extra effort you could tie it into the DE/WM and take a screenshot when a new app is opened or on focus switch or virtual desktop change or whatever and then slow down the periodic ones - so you don’t end up making 3000 screenshots of the same long gaming session.
Or just constantly log the currently running processes as well to give the ai additional context.
There are so many cool opportunities with this. I hope somebody makes something cool and useful with it for Linux, that runs completely locally. You could then ask your computer “Hey, what video did I watch about godot a week ago, it had something with tilesets in it and I was coding alongside it”. Or "how many hours have I been working on that project for in the last 2 weeks?’
AIs have been capable of doing this for ages already.
It just falls into the set of useful stuff that LLMs trained as chatbots suck at because they had the useless goal of convincing people they are smart.
It would not work for certain cases, you’re right, like stuff with many differnelty names documents or doing research in the browser.
But for what I had in mind - I’ve checked and on my setup the projects name is in the apps window decoration, in the cli when I do the commits, in the directory view sidebar, in the OS taskbar etc.
It should be pretty straight forward to figure out from a screenshot, even when the app is not in the foreground.
Yes. If it was an opt-in feature and we knew beyond all doubt that it was stored locally-only, and for the user only, it could be a useful feature for some folks. Unfortunately, Microsoft has a long history of doing stupid and/or evil shit ‘for’ the user, with the attitude of ‘Clippy knows best’.
I mean sure but if you get hacked (which will eventually happen to someone if this is rolled out) just having the information stored in the first place becomes a risk. So I think it is better to not have it in the first place.
Devils advocate/utopia hypothetical-
In a vacuum, where you could be personally guaranteed this data remains on device and you the user had complete control and ownership, I can see how this could be useful.
But I would never allow a third party that sort of access, full stop
On linux you could easily do it, by running a script every n minutes that takes a screenshot and pipes it to an ai and then stores it wherever you want (including a local NAS)
With some extra effort you could tie it into the DE/WM and take a screenshot when a new app is opened or on focus switch or virtual desktop change or whatever and then slow down the periodic ones - so you don’t end up making 3000 screenshots of the same long gaming session. Or just constantly log the currently running processes as well to give the ai additional context.
There are so many cool opportunities with this. I hope somebody makes something cool and useful with it for Linux, that runs completely locally. You could then ask your computer “Hey, what video did I watch about godot a week ago, it had something with tilesets in it and I was coding alongside it”. Or "how many hours have I been working on that project for in the last 2 weeks?’
I highly doubt current AI models are capable of figuring out which bit of work you do is related to which project.
AIs have been capable of doing this for ages already.
It just falls into the set of useful stuff that LLMs trained as chatbots suck at because they had the useless goal of convincing people they are smart.
It would not work for certain cases, you’re right, like stuff with many differnelty names documents or doing research in the browser.
But for what I had in mind - I’ve checked and on my setup the projects name is in the apps window decoration, in the cli when I do the commits, in the directory view sidebar, in the OS taskbar etc.
It should be pretty straight forward to figure out from a screenshot, even when the app is not in the foreground.
Yes. If it was an opt-in feature and we knew beyond all doubt that it was stored locally-only, and for the user only, it could be a useful feature for some folks. Unfortunately, Microsoft has a long history of doing stupid and/or evil shit ‘for’ the user, with the attitude of ‘Clippy knows best’.
deleted by creator
I mean sure but if you get hacked (which will eventually happen to someone if this is rolled out) just having the information stored in the first place becomes a risk. So I think it is better to not have it in the first place.
Anti Commercial-AI license (CC BY-NC-SA 4.0)
With this attitude there would be no progress ever.
I guess my question is progress towards what? I mean no one’s gonna stop you its your own computer do what you want.
For me though it just isn’t worth the risk.
Anti Commercial-AI license (CC BY-NC-SA 4.0)