I can no doubt see the value in this, even being a big skeptic of AI the ability for a computer to just pull up details from throughout the day or interject is genuinely a powerful idea (if it works in practice is another question).
However, I find it very frustrating that all of the tools that just record your mic or sell a pin or whatever never think about privacy. They seem to take the Google approach that the person who owns the device is allows to consent for everyone else around them (or any data they share with certain people) when that is not ok.
That is before talking about the major concern of people doing this at work without their company knowing, bringing it into a meeting and potentially leaking sensitive information.
I realize that unfortunately there is nothing that can be done at this point to stop this technology from being used by people, but I just wish the people that were making these tools thought about the fact that you are not asking for the consent of people around you.
>They seem to take the Google approach that the person who owns the device is allows to consent for everyone else around them (or any data they share with certain people) when that is not ok.
This is what's often overlooked (intentionally so?) in discussions about privacy. Too much of privacy is framed as "I am OK with sharing this data." But too often the data you hold is actually about other people: contact lists, conversations, associations. When you let a third party sift through your information, you're also making that decision for everyone else you interact with. I think the right way to think about privacy is: even if I have nothing to hide, I respect the agency of those I communicate with, so I won't make that decision to disclose unilaterally.
I flat out refuse to let an app go through my contacts, there is just no reason for it. Photos is always what I select and never full access. etc.
So when one of the social media sites recommends someone I may know, have no other contacts with this person and I recently shared my number with them. I get angry.
I will never understand how we got to the point that someone else can consent to a company gathering up my data just because it happens to be on their phone.
I don't think it's overlooked, some people talk about it. But a lot of companies try to push it away because they take "privacy" seriously while ignoring the consent problem.
When I lived in a shared house, Facebook learned about my relation to my housemates without my consent. I didn’t use a single Facebook product at the time and used a VPN on my devices. A few years later, when I signed up to Facebook, my ex-housemates were all “people I may know”.
I was wondering for a long time how it knew. I think it was because some of my ex-housemates shared their contacts with FB and it discovered us as a social group.
It is really an eye-opening experience to sign up to Facebook for the first time in recent years. It already knows so much about you and your interests. It’s as if there was already a profile with your name on it that they were building, without even approaching to ask for consent.
Facebook has done this for a long time. They're commonly referred to as shadow profiles. Profiles built up purely on information provided by other people's devices/tracking measures where the person in question doesn't directly have a Facebook account themselves.
what do you think will happen faster? some "social" agreement that technology CANNOT be used to its full extent (ie. I can't use my tech to its fullest extend, like augmenting my own personal recording keeping) or just society to learn how to behave in this new environment - where anyone anywhere can be recording?
Remember when cameras started appearing on phones and supposedly phones had to make noises when photos were taken, or when special phone models were made WITHOUT cameras? what happened to those conservative restrictions?
Obviously, some personal responsibility on how this personally recorded data is handled, stored and shared must be upheld but I'm skeptical of attempts at banning these new capabilities - specially, as you say, organizations have long been able to do this, just not individuals (not easily at least)
I share your skepticism that rules can contain these technologies. But "society to learn how to behave in this new environment" underplays how continuous souveillance [1] limits our individual liberty. So much of our freedom in public (which has declined enormously in my lifetime) comes from our relative anonymity in public spaces. Sure we are being monitored by CCTV and so on, but until very recently we had a basic assurance of freedom to speak and act without being individually identified and monitored.
The normalisation of AI + continual recording from audio or video recording devices (say future smart glasses) would create an entirely different order of self consciousness.
The chilling effect of a subconscious awareness of being continually observed and recorded precludes many kinds of practical freedom. Political protest, 'controversial' speech, spontaneous performance etc. Just as paradoxically, being able to share our thoughts at any time reduces their value and their capacity to amuse entertain or instate change. Have you ever tried to have a conversation with someone who's filming you with their phone? Or tried to completely forget the 'hot' mic in an interview? There's a basic disingenuousness to performance, and if we're all forced to perform all the time - the healthy space for self is diminished to the interior. A place our technology will no doubt force into the light in due course.
Potentially.. I'd say absolutely leaking sensitive information.
> I realize that unfortunately there is nothing that can be done at this point to stop this technology from being used by people
Seems like you answered your own question? Since there's nothing they can do, what would you want them to do?
Acknowledge the problem?
Build in functionality so it only recognizes your voice and everything else is removed?
Don't hide behind "privacy" promises or "your data is secure" when that doesn't fix the issue.
Just because we can admit that the reality is the problem is not going away doesn't mean that we just give up and not talk about it.
Plenty of signs in the 20m radius, something along this:
https://www.thesignshed.co.uk/cdn/shop/products/24-hour-cctv...
Possibly change the usual 'hi' greating to the more appropriate 'sign this release form before coming close or talk!' one.
Maybe not arguing for the acceptance of a bad situation just because it is ubiquitous?! I have a strong dislike against people knowing perfectly well that something is bad but still they raise their voice for the acceptance of that bad thing on the basis of size, of giving up and doing absolutely nothing against it, not even trying.
... or ... if I see it from a different standpoint then doing nothing is not that a bad idea actully. In my case I make it very hard sharing (accessing) pictures of my kids with relatives. Knowing how the big tech hijacking the communication that is used by average folk and how ignorant most are towards privacy implications on others I rather not share pictures except with those few being able to handle secure channel and private thing the way supposed to. Or they can come over in person. So I have to agree now, doing nothing, not using contemporary technology is a great idea! And ban it from (your own) children too.
Come up with a solution, most likely. Since when has this crowd bowed down to a challenge because “there is nothing you can do”?
From the readme: "Open. Secure. You own your data."
That's not what they were saying. What comes across your screen and can be picked up by your device's mic includes other people's data. This is a nightmare for anyone in the EU or two-party consent state. If we are on a Zoom call, this is recording both sides of the conversation without notice or consent. If we are meeting in person, and I leave my device on the table with this installed, same problem.
Correction, you own my (if we are talking near your device) data if you are using this.
That is the problem here.
That's not really an AI problem, it's an analog hole problem and the very nature of communication. If you give someone your thoughts, they now have them.
Well, the difference is that solutions like this automate the hoovering-up of everybody's data.
I know that some things that people share with me are more or less sensitive, and I use my knowledge and empathy to decide what I should and shouldn't repeat. I would tell my friend "Oh yeah, Carl said he can't make it to the party tonight," but I wouldn't tell them "Carl is absent from the party due to an IBS flare-up."
A well-meaning friend or coworker might never consider telling another person these personal details, but not think twice about it when enabling a service like this.
It is inevitable that this is the direction we're headed. It's already been happening, Google, browser plug-ins... can all read both sides of an email conversation. Your phone can (if it wants) listen to you and those around you. Cameras are everywhere... at least this is self-hosted and open source. Since there will never be an option for pre-electronics privacy again, it seems like this is the direction we should push to balance out the power of corporations and governments.
Neither I nor you would tell people about Carl's IBS if he told us.
How would writing down what we are told change things, versus remembering it, considering what we write down wouldn't be shared with anyone but ourselves?
How about recording, considering what we record wouldn't be shared with anyone but ourselves?
How would somebody suffering from a disability such as hearing loss, vision loss, memory loss, or IBS change that? Should people with disabilities be forced to disclose them whenever they have a conversation? Does that include Carl with IBS? Or would some people with disabilities have to disclose while others are allowed to keep theirs private?
> or interject
Clippy?
TBH I think the problem with Clippy was more a problem with its implementation than the core idea.
It just wasn't helpful and we lacked the tech at the time to really make it helpful. My impression was that it was basically a glorified AIM Chatbot with some hooks into Office to get some context.
Before things like this become widespread, can we get some etiquette (and legal awareness)?
On one recent videoconf with a startup founder, it turned out that they were using some random AI product with access to video and audio on the call, without my knowledge or consent.
(Thanks a lot; now some AI gold rush company has video and audio recording of me, as well as ingested the non-public information on the call.)
Their response to me asking about that made me sure I wanted nothing to do with that startup.
But some AI company probably still has that private data, and if so, presumably will go on to leak it various ways.
And it seems the only way to get an AI goldrush company to actually remove all trace of data it's obtained sketchily/illegally, might be to go legal scorched-earth on the company and its executives, as well as to any affiliates to whom they've leaked.
We shouldn't need random people undertaking filing lawsuits and criminal complaints, just because some random other person was oblivious/indifferent about "consenting" on their behalf. Which "consent" I don't think is legal consent (especially not in "two-party" states), but AI goldrush companies don't care, yet.
> Before things like this become widespread, can we get some etiquette (and legal awareness)?
I was watching CNBC interview last week with the founder of https://mercor.com/ (backed by Benchmark, $250m valuation).
The founder was pitching that their company would take every employee's employment and payroll history (even from prior roles) and use that to make AI recommendations to employers on things like compensation, employee retention, employee performance, etc.
The majority of what the founder was describing would clearly be illegal if any human did it by hand. But somehow because a LLM is doing it, it becomes legal.
Specific example: In most states it's illegal for a company to ask job candidates what their salary was in prior roles. But suddenly it's no longer illegal if a big company like ADP feeds all the data into a LLM and query against the LLM instead of the raw dataset.
Copyright issues wasn't enough to regulate LLMs. But I suspect once we start seeing LLMs used in HR, performance reviews, pay raise decisions, hiring decisions, etc, people will start to care.
[0] https://www.cnbc.com/video/2024/09/27/streamlining-hiring-wi...
You don't need AI to get this data, Equifax already hoovers it all up and offers it as a service.
https://theworknumber.com/solutions/products/income-employme...
A number of states have laws where you must disclose if the call is being recorded. I pointed this out to a former supervisor that was using otter.ai to record and transcribe calls he would make with potential leads and conference contacts. He said that law didn't apply in the state of our home-office. I told him it applies on calls made to subjects in other states. He disagreed. Not a lawyer, but I don't think that's how it works.
And something like this... yikes. Sure, boss, you're not doing eyeball tracking, but all they would have to do is install this on a work computer and just ask AI for a percentage of time not directly spent hammering out code and pay you piecemeal per keystroke or something truly awful. (and the webcam module is coming later, I'm sure.) The future is dystopian.
If really it is to become widespread it means we as society really got completely lost in the fold. It would be an act of defeat of the human element. But the magnates gonna love it.
"But some AI company probably still has that private data, and if so, presumably will go on to leak it various ways."
Both OpenAI and Anthropic don't train on data sent to them via their API. If they leak that private data it was from a security breach, not because they piped it into their training run.
(Cue a dozen comments saying "if you believe them about that you're naive", to which I have no useful response.)
This is a nightmare and illegal for anyone in the EU or two-party consent state OR anyone who interacts with others in the EU or any two-party consent state. What comes across your screen and what can be picked up by your device's mic includes other people's data. If we are on a Zoom call, this is recording both sides of the conversation without notice or consent. If we are meeting in person, and I leave my device on the table with this installed, same problem.
I can't find anything in the docs about how to pause or temporarily stop data collection. People don't like others recording every interaction they have, which is what killed Google Glass.
Are you sure Google Glass looking absurd wasn't what killed Google Glass?
It looking absurd was a key element in the creepiness factor, because it drew attention to how you knew someone else was recording you.
Not all EU countries are two-party consent.
I've been playing around with this concept this year as well. Not surprised to see the negativity in the comments. But there is value in this concept, and some of us are going to explore it and find out how to make it work without the dystopian weirdness some of y'all immediately jump to.
I've recorded roughly ~1000 hours of livestream of myself this year. 90%+ of it is boring nothingness, but it is not intended for public consumption anyways. I have and will continue to chop up and post on youtube/twitter the interesting moments I do end up capturing, but it's mostly for myself anyways.
I haven't quite gotten to the point where I've been able to articulate the benefits of this practice in a way that might sufficiently pique the interest or at least acceptance of others in the tech community or otherwise, but that's ok. I did make one video where I started to touch on this idea https://www.youtube.com/watch?v=2zqXkNhaJx0 and I will keep working on it and hopefully demonstrate the personal value (and perhaps societal at scale) as time goes on.
The future is going to get pretty weird. Keep an open mind.
I tried it a week or so ago, it didn't really go well. Transcription was terrible, even though using the same model (whisper-large) on its own works well. The UI messages were trying to make it sound like a straightforward app, they should have been much more helpful as many things went wrong with a "try again later" type message. I also wish they'd bundled more functionality in the service, so the app could be a simple web front end that uses its API.
At a greater level, I've always wanted something like this, but we shouldn't be able to collect info on other people without their permission. The dangers of breaches or abuse are too great.
Since corporations are holding back the greatest benefits, we should be able to remember commercial works we've accessed, and collect and organize info on corporations, and some info on governments, but by their nature corporations will be better at getting the upper hand and the resulting attacks on government might not be for the better for society at large.
Yes, some parts of some governments conduct abuses which should be called out, but that is specific departments, other departments work to other principles, sometimes pushing back against the abuse. Otherwise comparing governments to business or computers is a downward spiral. This[1] is an interesting series on this topic.
1. https://en.wikipedia.org/wiki/All_Watched_Over_by_Machines_o...
How do you as a user validate the security of tools like this? I am avoiding many potentially useful tools (e.g. Some Obsidian or Chrome plugins) out of paranoia.
Is there a better way than going through the code or running Wireshark myself? Even these are not bulletproof…
For now, I am resorting to building the simple things for my use myself. The benefit is that its often quite fun.
Hmm this might unintentionally be the glue that brings us actually smart Star Trek computer assistants.
Think about it, you can access every single kind of automation through a desktop app or android emulator. Screenpipe becomes a working memory that the LLM develops to have context of its previous actions AND their results.
"Computer, lights" can not only send out a signal like a TV remote, it can check a camera to make sure that the light for the room the user is looking at actually turned on at an appropriate light level for the situation.
I’ve dabbled with building something like this for myself, I’m guessing it’s not totally unintentional, it’s the first step. After getting it to interpret what it sees on your computer, give it the ability to use mouse/keyboard, maybe in a sandbox vm, and trying to do some basic tasks, working up from there.
No way I’d use something like this that wasn’t local-only, though.
How is the data stored? Isn't this the feature Windows got royally roasted for because it stored the data in something like a SQLite db?
How are you protecting the data locally? Sorry if it's in the README, I didn't see it when skimming.
They store everything in an SQLite db :)
https://github.com/mediar-ai/screenpipe/blob/4f2391c6dfd8775...
What is the recommended approach for this? I feel as though the specific database should be irrelevant. All OSes are equipped with permissions models that can restrict a SQLite file to use by a single application.
Admittedly I have little knowledge on the Windows feature's functionality but my problem with that is that I want to choose whether or not something like this is happening on my computer and have control over it. I barely trust Microsoft and Windows anymore as it is but it's a somewhat-necessary evil in my case. I don't trust them to record my data and actually keep it local to me and I want to actively find software to do it not have them auto install something and have full control over the data.
Love the focus on just recording your system, and then using that as a building block for more advanced apps.
When I prototyped doing this for a sub-problem (terminal agent), it was nice to have a tight feedback loop between read/write.
Curious how difficult it would be to add “actions” on top of this, or if it’s mostly geared towards a read-only/replay mindset.
So, basically this is Windows Recall for Mac.
I'm still very iffy about this. It opens a huge can of worms in terms of privacy. However at least in this case it's not managed by a big company but installed and maintained by the users themselves.
What’s the power consumption like for running this 24/7? Is it event based to reduce the need to process data when pc is idle? It’s an interesting idea for sure, but seems like a lot for an alternative of providing specific context.
screen recording isn't generally that hard on a system, depending on display config of course. video compression would be piped thru the GPU's media encoders, which are extremely efficient these days.
Hopefully one day we will reach the place where such AI contraption after watching us for hours, days and months will be able to just do stuff we do and we could switch off the computers.
Check email, respond to some, see some news, pull up tasks, do some code, ship some code, read some more news, watch a tutorial, do some more code, check mails, respond to some etc etc.
At the end of the day send you a summary, some highlights, occasionally call you for manual intervention.
https://www.rewind.ai/ tries to do this also. Ultimately I found over the course of a work week, there was way too much noise vs signal for it be useful.
I heard some not so great things about the CEO of that company on Reddit. Now sure how true it was but I recall it putting me off the product at the time, considering the sensitivity of the data they would have on me and my company. Reputation matters in this space and his seemed questionable.
An intelligence agency's dream :)
True, though those will probably install loggers on their targets' computers anyway.
I miss BonziBuddy :/
With such technology, we are becoming less and less like human beings and more like technological beings augmented with a biological base. I think it's a bad thing because at least the average human being in modern society is not brought up with wisdom, but only the drive to advance technology and operate in a highly capitalistic world.
The augmentation of human beings with tech like this is a proto-type for a dismal world where wisdom is lacking and the pure pursuit of knowledge is becoming a more and more seductive path to destruction.
If it's all done locally, this is just a more efficient way of taking notes.
It's an efficient way, but I vehemently disagree with "just". No technology is "just" anything. All of these little "improvements" constitute a very advanced modification of human beings to become more mechanical and less empathetic towards life.
Cyber augmentation (hearing aids, cochlear implants, etc.) are often a means to become more empathetic, because it allows deeper connections.
As someone who suffers from ADD, I simply won't be able to recall forever everything someone and I said, so I use technological augmentation in the form of writing down birthdays, for example. When I'm at meetups, when a conversation huddle ends, I'll write down notes, or more likely, send a custom linkedin connection request mentioning what we talked about.
The result is that we have the same, empathetic, human conversation as before, and also next time we talk, I can ask them about their startup or hobby, and also I wish them a happy birthday every year, which I think is a net positive without any downsides.
Its hard for me to see how you could think it is “just” taking notes.
Objectively the notes are being constructed and filtered by an external 3rd party (even if it is run on device locally, someone external is still training and choosing the agent).
It is the homogenization of thought and note taking of everyone using AI to record their lives that is the potential problem.
>the pure pursuit of knowledge is becoming a more and more seductive path to destruction.
How so?
As knowledge becomes more powerful in the sense of enabling us to do more things, it becomes more tempting to use it to gain short-term advantages that typically have long-term detrimental consequences. Such as AI for example, which is too quick at disrupting employment or cheap energy to generate bitcoin but is problematic for local energy grids. The more powerful the knowledge, the easier it is for people to ignore the downsides at the expense of fellow human beings.
That is especially true because we have an economic system that rewards short-term improvements in the efficiency of the system, regardless of the long-term costs. Fossil fuel use, cutting down local forests (has relatively litle short-term impact, but adds up).
And, as we pursue knowledge and technology more vigorously, we slowly lose other forms of gaining knowledge such as a relationship with nature.
Human society is advanced with regard to its knowledge capability, but exceptionally primitive with regard to basic wisdom about community, love, nature, and friendship. We continually donwgrade these things to make way for new technology, and the prisoner's dilemma (tech gives some people advantages, so everyone is pressured to use it), makes it hard to make decisions for the long-run like the Amish do.
What a bizzare attitude to take on a site fundamentally based on the advancement and refinement of information handling technology
Like what do you think everyone who posts here does?
Arguably this kind of viewpoint can be particuarly interesting to this group. People are well placed to see some of the more worrying aspects of technology.
I understand exactly what everyone else does here. And nothing intrinsically wrong with that -- technology is unquestionably fun and interesting. I like programming myself. BUT, and this is a huge BUT, I think we as people who are well versed in technology should take a little more responsibility for what we create.
So, not bizarre at all.
Do you want an echo chamber? Perhaps just being fed with opinions you agree with?
We should celebrate opinions that go against local conventions
i guarantee you not everyone here has benevolent intent. for example, we know people from FB,TikTok,Snap,Twit...er,X are here.
what do you think everyone does?
Microsoft is doing Recall, encrypted and what not with the TPM => Microsoft BAD!
A random dude is doing the same thing, but in rust (super important to mention right), storing the data in sqlite => Magnificent project, we want more!
You guys are fucking weird.
> Microsoft is doing Recall, encrypted and what not with the TPM => Microsoft BAD!
1) It was not in fact encrypted and any user could mess with it. AND the data was stored in SQLite too. Microsoft only started fixing this after their totally negligent security was brought to light.
2) Recall is maintained and auto updated by Microsoft which can change the rules at any point (e.g. add datamining at a later point). At least with Screenpipe the end user decides. This solution is open-source so you know what's happening.
Random dude making the same thing is not the same thing what MS does.
1. You have a choice. With MS you don't. You can't opt-out, at least for now.
2. And as prev buddy said, you never know what MS will do with your data.
3. Recall will be heavily targeted and from day-1 some malware will target it. Random dude's pet project doesn't (even though it is a security through obscurity).
You understand that the data stays on the computer right? With Microsoft you never do what they do down the road even if they start local
