EU votes to ban AI 'nudifier' apps after explicit deepfake outrage

You can do locally a lot illegal stuffs. You can make new Disney movie. With Disney logos and everything on your computer. But you have problem when you share it or even sell it. I would say that's the same with ai nudificaton. Ai can do id. You can run the models. But if you share it, it's your problem.

You can make bombs at home too, doesn't mean it's a good idea to make it legal to sell bombs at the supermarket.

Someone posts a nudified image. They get traced. They get prosecuted for using a nudifier, because they've been banned. Just like how heroin possession has been banned. It's enforced by prosecuting people who possess it.

> Does this not comprise all AI image generators, many of which can be locally run with basically any modern gaming GPU? Many generators are limited and can't do this, but even when they're not they probably won't care much as long as you don't share what you generate if it's local. Technically you don't even need an "AI" to do this so the problem is more what you do than the tool you use.

Sometimes regulation does not mean that the thing is shot behind the sauna and it stops existing. Sometimes regulations are made beforehand to work as/with a framework when legal issues come up. It is a lot easier to start planning from there than plan when it finally becomes a major issue that needs to be dealt with. Stealing is illegal. However not every case is prosecuted or dealt with.

Same with other illegal online stuff I suppose. No one's going to search your PC without a warrant. But don't be dumb enough to post it on twitter.

Go after platforms that allow it to be hosted or sent through their messenging apps. Make it the problem of the companies that unleashed this hell.

You can run a Facebook equivalent at home with full chat applications with e2e encryption. So yeah home run stuff won't technically be affected, but isn't it still good that they stop the big companies doing it for the lazy AHs? Yes, you can set it up home, but most people doing this will not go through the learning or spend the money. You know what, I speculate further that those who have the opportunity to do this at home and the knowledge have a much lower percentage of them wanting to do this. Modern gpu, sure... But not on consoles. That also cuts out a huge fraction of people.

There are laws against the creation of CSAM, that doesn't make cameras illegal. Same logic applies, if caught doing it, you are prosecuted.

Likely they aren't going to go after every single thing as there's too big a grey area on so many apps where it's possible to abuse but not intended for such software to be used that way, it's probably more likely to target Grok and Musk specifically for not only going out of their way to make it widespread but encourage such degenerate behaviour. Basically trying to make sure they can shut down those deliberately trying to commercialise such a function in Europe at the very least.

I'd guess that it's down the lines of other "could be used for bad stuff, but also can be used for other things" rules You say that services that are are being pushed primarily for said uses and/or that said services have to put some level of protection to stop those services Not the first time we've had to deal with things like this. You set things up so it's harder for people to casually do it(and have something to hit them with if they do). Just like a masterlock on a shed, it might not be great protection but it'll stop a good number of thefts just because it makes it a bit harder

Making it illegal is the first step in charging the really problematic people. Not to stop every person from doing it.

Westerners tend to think about the individual, not the collective whole - if this is a problem, how can we stop individuals from doing it? I don’t think laws really work that way - we have laws for murder, but murder still happens. Europeans have gun control laws on top of their murder laws, and still people get shot - although much less than in America - so the laws work, but at a societal not an individual level. So point of laws is to reduce undesirable behaviour in your society, not to expect it to stop completely. One incident of law breaking doesn’t make the law useless. You were speculating on tech changes to try to make nudefaking impossible - eliminating the problem, rather than just mitigating it - and then rightly concluding such a thing will never work. Although the EU has a history of really stupid tech legislation, my guess is they won’t try anything so impractical. Instead, they’ll just regulate the platforms - preventing mass-market access will drive the problem way down, but not eliminate it. It also scales well because you’re regulating a few hundred companies and giving you easy access to takedown orders and that kind of thing. If you make it about the individuals, then you’re going after *production* and that’s virtually impossible, since anyone with a $50 graphics card can generate this stuff, and then suddenly you’re running around having to identify individuals and prosecuting them, which will quickly prove how toothless you are because a lot of the perpetrators will be in other jurisdictions or good enough at covering their tracks that all you can do is go back to the distribution platform and ask them to shut it down anyway.

It will end up banned as a technology similar to human cloning. AI is an existential threat to societal cohesion and over time it will see more and more regulations eventually leading to an outright ban+jail time.

I would that the legislation was written to target businesses that are explicitly offering such services. But this statement seems to put that into question, and raises the risk of general open source AI models being targeted: > Systems with safeguards will not be affected. Lawmakers said AI tools with “effective safety measures preventing users from creating such images” would remain allowed.

"We can't let the Chinese win the nudifying race!"

The only way to actually enforce this would be to lock down every home computer to such an extent that it can only run government-approved programs. That's basically insane, and would fall under "EU is restricting innovation", yeah. Some kind of selective enforcement against the people making money selling these things is the best we can hope for.

If you explicitly market for the EU, EU law applies.

>HOWEVER, can we also look at banning voice deepfakes? Oh, we can for sure, but it is like banning p****** games or banning mp3 music that was obtained illegally - a.k.a. pointless All it takes to create a deepfake voice is 5 seconds sample and 1 mouse click in ComfyUi. You can make the whole audiobooks with that >Sharing either of these should count as a violation of privacy, identity theft, and imo assault or harassment You are a bit off with qualifications here (you could throw in assisination, murder, r*** and genocide aswell while you on it, why not lol) - but sharing n*** pictures of a person was always illegal anyway, regardless of a method they were created

Loading slowly on dialup, the bottom part of the picture could be *very* different, so no masturbation until complete

Think people are more concerned on how these things are going to be enforced in the future. I don't want government spyware on everything I own. Protect the children has always been a propaganda slogan to incorporate very intrusive measures of control.

How many teenagers will have real n**** leaked and now they’ll be able to claim it’s just AI? Seems like the real thing would be way more harmful than anything fake. The math isn’t as simple as you make it out to be.

[removed]

Right, without AI deepfake image generators suddenly bullying will vanish and all kids will get along instead. Since as we know, the entire concept of it was born suddenly a few years ago when Midjourney came out. The tools change with the times but the dynamics are social, not technological. Stomping this doesn't somehow save the kids, there'll be just another way bullies use to humiliate their victims. You can keep playing that whack-a-mole forever and never get anywhere if all you focus on is just whatever's fashionable at a given time.

as a teenager, I was running half naked on the beach every summer What the hell are you kids traumatized this days and why it is you religion?

It's creating non-consensual p**********. Simple as that. These people didn't consent to their head being put on a n*** body or having software generate an image/video of what it thinks they look like naked. Some of it can get extremely graphic and vile as well.

Seriously dude? How about you send me a photo, I de-nudify you, then share it on a platform for anyone to see and share. Eventually someone who knows you recognizes you, maybe your boss or coworker. You think you'll just have a laugh and get over it?

Because people won't know it's fake and will assume it's an actual naked picture of that person. I think one possible solution is that every browser should have the built-in capability to detect if a picture is AI generated or enhanced, and automatically label it as such to the user.

Terrorism is not the answer.