I deleted all my photos online, the day I saw nano banana. A lot of people called me paranoid, but this technology just seemed too dangerous. I am now also seeing open source models catch up with them, which was the exact thing I was scared of.
Does it scare y’all too? Especially open source part?
The danger depends more on who you are. If you are in a position where deepfakes could be made to undermine you in your life, there is a higher danger. If you work a desk job in an accounting firm, that risk is much lower.
Deleting all your pictures from the internet is a fig leaf. How many pictures exist in other people’s photorolls that you are in? And even if you trusted all of them implicitly, how well do they do their security?
I think at this point in time, deepfakes are ultimately identifiable. By which I don’t mean anybody can tell immediately that it is one. But on repeated viewing enough people would get suspicious and when somebody analyzes the 1s and 0s it can be made certain. Society needs to adapt a delayed response tactic. This will take time but eventually we will look at deepfakes with the same skeptical eye we developed for photoshopped images. We are in the period of adjustment lag so the jeopardy is higher today than it will be a couple of years from now.
The biggest danger is for ladies because sexualized deepfakes are not only appalling but the legal system is also lagging to catch up in many places. As soon as a believable deepfake of a famous man makes the rounds, the laws are going to be tightened ASAP though.
There is also a legal battle that needs to be fought. Can I hypothetically make a deepfake sex video of my favorite female celebrity just for my own enjoyment? I could paint her oil on canvas as long as I kept it at my house. I could write fan fic and might even get away with posting that online. Could I not make this movie just for me? And if I protected my computer in a reasonable way, can I be held accountable if some other asshole leaked it onto the internet? We’ll have the answers in 10-15 years.
I don’t think you can make all deepfakes illegal so we’ll have you find a way to live with the threat.
Impersonating a person, living or dead, could absolutely be a law. It’s pretty simple. It’s the same with all consent. Do you enthusiastically consent to me beating the shit out of you? If the answer is yes, then let’s goooooo. If the answer is no, then I’ll remove your restraints and wish you well. It’s not fucking hard.
Nothing in law is simple. Legislators pass a law and after it passed that meat grinder it eventually gets brought up in courts where a second sausage is made by evaluating whose rights take precedence over others. And if we imagine the current US Supreme Court they will not ban deepfakes completely because it could limit the first amendment. And they would probably find in favor of the sad smelly asshole in his basement who made deepfake porn that was never meant to be public. So the creation of deepfakes will not be limited by law. The system can only react after the creation. By which point the damage is already done for the celebrity whose likeness was abused.
Right now it might be possible to get the companies to limit the models that can generate this stuff. But soon enough, maybe in a few years, it will be possible to train you own model on your terms that will run locally and if you’re savvy enough to set that up you’ll be savvy enough to sidestep any restrictions there as well.
Don’t impersonate without enthusiastic consent will not survive the tour up the legal system.
Aha. That explains all the rape kits that got unprocessed every year.
No, it doesn’t. Because I was not talking about physical sexual assault.
I don’t understand people who misunderstand basic consent.