Is it fairly easy? Seems useful for a public site like Lemmy and the fediverse
https://nightshade.cs.uchicago.edu/whatis.html
https://decrypt.co/203153/ai-prompt-data-poisoning-nightshared
You must log in or register to comment.
A place to discuss privacy and freedom in the digital world.
Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.
In this community everyone is welcome to post links and discuss topics related to privacy.
Some Rules
- Posting a link to a website containing tracking isn’t great, if contents of the website are behind a paywall maybe copy them into the post
- Don’t promote proprietary software
- Try to keep things on topic
- If you have a question, please try searching for previous discussions, maybe it has already been answered
- Reposts are fine, but should have at least a couple of weeks in between so that the post can reach a new audience
- Be nice :)
Related communities
much thanks to @gary_host_laptop for the logo design :)
- 0 users online
- 57 users / day
- 383 users / week
- 1.5K users / month
- 5.7K users / 6 months
- 1 subscriber
- 3.11K Posts
- 77.9K Comments
- Modlog
Yes, we need more artists defending capitalism with futile, annoying, and inaffective attempts at DRM. I guess we didn’t learn anything from the music DRM wars in the 00s.
For image tracking it’s enough to use Imgur for sharing, for any image, even own ones, no AI image needed. I miss the bot in Lemmy which redirects Videos to Piped, when Imgur is worst. Better alternatives, like File Coffee or Vgy.me, made in the EU are desirable.
This doesn’t have anything to do with tracking. This is supposed to sabotage free and open image generators (ie stable diffusion). It’s unlikely to do anything, though.
Hard to say what the makers want to achieve with this. Even if it did work, it would help artists just as much, as better DRM would help programmers. On its face, this is just about enforcing some ultra-capitalist ideology that wants information to be owned.
I see it as trying to combat the dystopia where not only is our data scraped but now every single thing we write, draw or film is fed into an AI that will ultimately be used to create huge amounts of wealth for very few, essentially monetizing our very existence online in a way thats entierly unavoidable and without consent.
In addition its entierly one way, google and others can grab as much of our data as they want while most of us would have an extremely hard time even getting granted a freedom of information request about ourselves, let alone grabbing a similar amount of data about those same corporations.
But… That is what these poisoning attacks are fighting for. They are attacking open image generators that can be used by anyone. You can use them for fun or for business, without having to pay rent to some owner who is not lifting a finger. What do you think will happen if you knock that out?
If it uses my data and hasn’t paid for my data, it’s stealing from me. You don’t get to have it both ways; either we can have a communist system where I don’t need to worry about my bottom line anymore; or we can have this capitalist bullshit and you can fuckin pay me for every time your machine’s data-gripper reaches into my metaphorical pockets.
AI tracking? Is this a new thing?
At the moment, I’m just adding the license to my text, but if somebody has something I could copypaste and put into a spoiler to poison AI training, that’d be great.
Anti Commercial-AI license
Insert poison pill here
Nothing here yes!
One thing I was kinda wondering about - as long as there’s nothing in the T&Cs of your instance, don’t you implicitly hold the copyright to your comment? Isn’t the CC license actually more permissive? Or is it more about “that model was trained on content available under this license, to comply with it, they have to follow it’s terms”?
Close. Creative Commons is a copyleft license with restrictions. The important restriction in this case is not allowing commercial use.
Anti Commercial-AI license
- but explicitly allowing non-commercial use. Neat.
This reminds me of when I was 10.
I thought it was cool to draw the copyright symbol and year on the dumb drawings I made
Stop worrying and learn to love The Bomb
O-P-E
I’m very skeptical that this “model poisoning” approach will work in practice. To pull it off would require a very high level of coordination among disparate people generating the training data (the images/text). I just can’t imagine it happening. Add to that: big tech has A LOT of resources to play this cat & mouse game.
I hope I’m wrong, but I predict big tech wins here.
This attack doesn’t target Big Tech, at all. The model has to be open to pull off an attack like that.
No, because a method that works on one implementation almost certainly doesn’t work on another.
Understandable, quite the bummer
I’ve said it many times, but the channels I speak through are small, so from the top!
If you put your artwork online in any public location, make sure your signature or even a QR code is obnoxiously large and centered on the image. Humans can still see and enjoy what you’ve made, AI won’t be able to discern anything, and if it happens to get ripped by one of those Chinese T-shirt bots, at least anyone who buys will know who the original artist is.
TIL that there exist people who aren’t bothered by obnoxious watermarks superimposed on an image. I find them aggravating, and I’m not the only one – That’s shutterstock’s entire business model.
AI is already making people’s lives worse. Let’s not make human art harder to enjoy in a fruitless effort to resist it. Instead, let’s solve the root of the problem.
It’s not that I prefer having images occluded by anything, signatures, text boxes, or whatever… But when it comes to online protections for someone’s work, hell yeah put that shit on there.
The best part is that I’ve been saying this well before generative AI was mainstream. Artists who put their work on public domains who don’t want it getting into the hands of others shouldn’t have an issue with signing the hell out of the image. They can of course add it before uploading and not to the original.
Would it be amazing if people properly lisenced others work and/or requested permission to use it? Absolutely. That’s just not the world we live in.
This still seems like a crazy take to me. Yeah, putting a giant watermark on a piece of art protects it from theft, but it also destroys the artwork.
Unregistered HyperCam 2
removed by mod
A really fun side effect of stuff like this is when you generate something that looks like a pencil sketch or something, you’ll often get partial pencils in the middle or upper corner of the image because they are quite often photod with pencils on them to indicate the medium.
So even something that simple is sort of poisoning the models. And if they all have that obnoxious signature or QR code, the generators are going to start including those and that’s just gold.
I don’t really think that’s poisoning much. It’s not hard to crop out the pencil after.
It is definitely difficult to get rid of when it’s generated in the middle of intricate detail, which it often is.
I’m not saying it’s the same thing as actually poisoning, but it does negatively impact the resulting generations.
If it’s in the middle of intricate detail it will make it harder to appreciate that detail as a human.
Anyway, it’s easy to make an AI to remove such things. Just take a million images, add watermarks, and train the AI to produce the original images.
Hey chatgpt or whatever ai model, recreate this image without the silly QR code.
This is the big thing. All doing silly things like obscene QR codes does is add training data for future ai to remove them.
It just takes a while!
Hmmm good to know. Thanks!
deleted by creator
Here is information about it
deleted by creator