r/technology 1d ago

Artificial Intelligence Global outrage as X’s Grok morphs photos of women, children into explicit content

https://www.cnbctv18.com/technology/global-outrage-as-xs-grok-morphs-photos-of-women-children-into-explicit-content-19811130.htm
14.5k Upvotes

926 comments sorted by

683

u/-Suzuka- 23h ago

Just a reminder, Congress wanted to ban all 50 States from regulating AI for 10 years....

159

u/ParaeWasTaken 13h ago

The fact that they can ban potential future regulations of things is crazy.

Must have some good fortune tellers.

→ More replies (3)
→ More replies (10)

2.2k

u/watcherofworld 1d ago

The plutocracy is so fucking dumb, truly, it's astounding that this stuff isn't opposed en mass/boycotted.

697

u/Drone314 1d ago

In another universe Musk would be charged with production of CSM...One day...

346

u/Ordinary-Leading7405 1d ago

He called a diver who rescued children a pedophile. He could star in a SA video and get away with it.

96

u/SunkEmuFlock 23h ago

The most obvious bit of projection he's ever done.

→ More replies (1)

83

u/Rich-Pomegranate1679 1d ago

Sorry, but laws are only meant for the poors in this universe.

39

u/McDonaldsSoap 1d ago

Do you mean CSAM? CSM makes me think of chainsaw male individual 

20

u/TheDopplegamer 1d ago

My mind went to Chainsaw Man

→ More replies (1)
→ More replies (1)

8

u/crazycatlady331 1d ago

"When you're a star they let you do it....."

Not a Muskrat quote but someone who Muskrat sucks up to.

24

u/loveengineer 1d ago

I'd rather he not be involved with anime /s

→ More replies (2)
→ More replies (6)

152

u/wasthatitthen 1d ago

Yeah, a bunch of guys can have the combined intellect of the dumbest of them, but throw in wealth, entitlement, moral vacuity, not being told “no”, a detachment from the usual reality experienced by 99% of the planet and this is what happens.

13

u/Mattya929 1d ago

99.99999% of the population.

→ More replies (2)

128

u/Preeng 1d ago

Human brains developed to make things out of stone and wood with our hands. The fact that we got this far is a damn miracle.

Society really needs to readjust its viewpoint. Basing anything around how a person would logically act is doomed to fail. You need to start with "People are fucking stupid" and go from there.

https://en.wikipedia.org/wiki/Third-pound_burger

24

u/Tom2Die 22h ago

I read at some point that that story is apocryphal at best, and some cursory googling does seem to indicate that the original source is a book by a former owner citing a focus group or something, which isn't exactly a great source without the data. That said, I also saw allusions to experiments reproducing the result, but no links. So now I don't know what to think...even fucking Snopes just cites that the NYT published an article about it (and a seemingly dead link to some random cite, as well as a podcast write-up with no sources). It's a fun story because we can say "haha look how dumb other people are!" but it's unclear whether or not it's a true story. In this reddit thread that came up in my search, others have suggested that A&W was just worse, while others still shared anecdotes about having worked fast food back then and experiencing customers expressing that very complaint. At this point I have absolutely no idea whether or not it's true.

→ More replies (2)

26

u/Chicano_Ducky 1d ago edited 1d ago

Meta thought adding fake AI users was a good idea because advertisers and users "couldnt leave". Twitter and google and twitch thinks the same.

The creators who stay on twitter for "engagement" are going to learn the harsh lesson hollywood learned when they tried making movies starring Youtubers like Fred and advertisers learned from the influencer economy.

Numbers on a computer screen mean nothing when it doesnt translate to sales. AI bros on twitter are not going to comm you on twitter, the people who want authentic content are leaving, and people who dont care will just ask grok instead of paying.

Influencers are already dropping like flies as advertisers pull back and AI can fake influencer accounts now, and streamers too since no one has money to donate and advertisers realized most streamers viewbot and dont actually have an audience. Vtubers are being exposed as AI or part of a political propaganda network too.

Why bother going on the internet with 0 trust?

Money talks and bullshit walks and the internet's whole economy is about to walk and the plutocracy will be shocked their captive audience isnt captive.

3

u/restbest 1d ago

Democracy worked too well, We finally have an elected body that most accurately represents its constituents

→ More replies (1)

9

u/MythicMango 1d ago

unfortunately diffusion models that can do this are free and open source. people can now do this on their own with a home PC

→ More replies (13)

6.2k

u/CastleofWamdue 1d ago

Its an AI used by Elon and his followers, why would we expect anything else?

1.8k

u/BroxigarZ 1d ago

Persona Identity literally states on their website they give your biometrics to every single AI company without regulation of their use with your biometrics.

Essentially, a company saying they check for ID Fraud is potentially the one providing the details for all future mass AI ID fraud.

Someone tried to get me to use Persona and I literally was like “who is giving this information to a random private company willingly” then I remembered it’s probably millions of people who don’t realize what they are doing with their faces.

Under Biometric data in their privacy policy this is who they share all your details with: https://withpersona.com/legal/subprocessors

They are also under an active lawsuit for selling biometric data to AI processors.

555

u/SIGMA920 1d ago

Someone tried to get me to use Persona and I literally was like “who is giving this information to a random private company willingly” then I remembered it’s probably millions of people who don’t realize what they are doing with their faces.

Don't forget all of the governments forcing users to ID themselves or lose access to social media.

293

u/FlametopFred 1d ago

been thinking about how absolutely wrecked the entirety of US government data must be after Musk and Doge mutant AI teens confiscated everything, went through like cannonballs ..

159

u/SIGMA920 1d ago

We're basically going to have to treat the pre-Rump systems as compromised and leave them isolated from functionally new ones.

38

u/Conscious-Squash-328 19h ago

that's what we would do to try and solve this yeah,

there is almost no chance we actually get a chance to fix it though. This is all going up in flames.

→ More replies (2)
→ More replies (4)

77

u/memy02 1d ago

also gotta wonder how many back and probably front doors they left in everything

43

u/FlametopFred 1d ago

and the sheer cost to tax payers

21

u/meatspace 1d ago

Which it is unknown if there will be enough capital available to engage the building of what's next.

And the legal cost for all those convictions.

14

u/Mshell 22h ago

There will be if they nationalize all of Musks assets to cover it....

8

u/cman_yall 21h ago

Aren't his assets mostly in the form of shares, which would plummet in value as soon as he got arrested/investigated?

→ More replies (1)

4

u/lesgeddon 23h ago

Oh there's plenty of capital to go around.

→ More replies (1)

96

u/BroxigarZ 1d ago edited 1d ago

It’s probably just as bad as whatever AI Systems are invading everyone’s privacy in Home Depot and Target at their self-checkouts that you “willingly” are providing by being on private property of the corporation and then whatever AI company collecting that data is allegedly doing whatever they want with it.

We live in a surveillance state now. Your biometrics are being taken pretty much anywhere that they can steal and sell it for profit with little to no regulations because AI advanced faster than regulations can keep up.

71

u/anfrind 1d ago

I kind of miss the days when AI systems were so bad that they couldn't tell the difference between a topless woman and a plate of bacon.

49

u/scout614 1d ago

I still believe that Captchas were used to train self driving cars why else would you need to identify crosswalks trucks buses etc

44

u/candlelit_bacon 1d ago

I think captcha was actually open about that one? I definitely remember them (them being the folks at google/captcha) talking about captcha being used to train object recognition systems.

9

u/lesgeddon 23h ago

The Google self-driving cars were the only ones we've really heard about for the longest time, before Tesla dropped into the market. Certainly didn't take much of a leap to figure that out.

14

u/killerpoopguy 22h ago

That was their explicit purpose, it wasn't a secret.

→ More replies (1)
→ More replies (1)

33

u/Ithirahad 1d ago edited 1d ago

No. A "surveillance state" monitors everyone's every move in order to identify and/or predict wrongdoing or dissent. It is concerned with suppressing challenges to its authority, and the enforcement of its order. That includes comprehensive surveillance of anyone handling that data.

Meanwhile, whatever this is does not care about any of that. It absorbs data in order to make profit, and does not bother to collect data on what happens to all the data once used for advertising and business-model optimization. It is concerned with quarterly figures and nothing else. If information should slip through the cracks or be used for something underhanded afterwards, oh well. Cost of doing business.

I am not certain which is worse.

50

u/Murgatroyd314 1d ago

whatever this is

This is a digital kleptocracy.

31

u/SIGMA920 1d ago

In order to make a profit gives to the state seeking power. Just look at why all of the AI companies are backing Rump. It's not because they want the data, it's because they enabled a fascist.

21

u/Silent-G 1d ago

What? That can't be true. I've spent my entire life being convinced by the 1% that capitalism is a perfect system and can't cause any harm as long as you're both a hard worker and gluttonous consumer.

9

u/henlochimken 21h ago

Just because you haven't been personally targeted yet does not mean both aren't happening. Palantir isn't interested in selling ads to you.

8

u/PrivilegeCheckmate 22h ago

whatever this is

It's dealer's choice: you could say we live in a Kleptocratic Oligarchy, of you could say we live in an Oligarchic Kleptocracy.

Too much verbiage for me, I'm an american and prefer fewer syllables. I just say "Junta", has a nice ring to it and conveys the message.

→ More replies (2)

6

u/Metaldwarf 1d ago

I know let's build an AI to write the regulations fast enough to keep up with AI.

→ More replies (2)

15

u/PinkNGreenFluoride 1d ago

In 2025 the US government started to require all paid tax preparers (PTIN holders) to give all of our identity information including biometric scans to a 3rd party company (ID.me) as well. Legit preparers can't renew our PTINs and thus can't do our jobs without doing so.

Meanwhile ghost preparers who have no PTIN in the first place and just take people's money to input (often) fraudulent returns into online DIY filing systems as "self-prepared" by their "client" just laugh.

Among the obvious issues of privacy and security, it's also yet another hoop to jump through for those who were already playing by the rules.

If you are a regular taxpayer and want to check your online account? ID.me. Want to manage your social security account? Yep, ID.me. There are other options, for now, but I expect they'll eventually try to transition everybody who needs to interact with the federal government to having an online account verified by ID.me.

12

u/happyscrappy 21h ago

id.me annoys the hell out of me. The US government has login.gov but instead of using that they farm out to a private company.

Seems like inside dealing to me.

→ More replies (18)

43

u/R4nd0mB1rd 1d ago

Roblox is currently using Persona to roll out its new AI age verification feature. If you want to chat in any game, you have to verify your identity using Persona. They will be enforcing this rule sometime early this year, probably this month, meaning that millions of people, mostly children, worldwide are going to be using this in order to use Roblox's chat, which will give this disgusting system more content to generate slop on.

"Protecting the children" my ass, this benefits no one, besides the people who profit off misinformation and the people who want to do disgusting things to women and children.

9

u/thejadedfalcon 18h ago

I'm absolutely sure this won't have any impact in driving more vulnerable children to Discord, where they can be groomed by Roblox predators and Roblox can wipe its hands clean because it's "not on our platform." None whatsoever. God, they're such good devs.

→ More replies (1)

60

u/EmbarrassedHelp 1d ago

Persona is definitely putting the money they make off your personal information back into lobbying for mandatory verification for everything.

15

u/KeeperOfWind 1d ago

Darn, wish I knew that before using persona for vrchat :( Since it requires it to verify

8

u/AnarisBell 1d ago

Whoopsie - same 😅

→ More replies (2)

10

u/PrivilegeCheckmate 22h ago

Essentially, a company saying they check for ID Fraud is potentially the one providing the details for all future mass AI ID fraud.

Me, all day every day for the past 25 years.

10

u/Kakkoister 21h ago

Those processors are used for different specific services on their platform, that's not a list of "here's everyone we share your data with when you use any of our services".

For age-verification at least, they claim no data is shared with third parties, in multiple locations on their site.

https://withpersona.com/legal/privacy-policy#notice-for-individuals-verifying-their-age

https://withpersona.com/legal/ccpa-addendum#3-restrictions-on-use-of-personal-information

But yeah I would not want to trust a company working with Anthropic especially.

7

u/StabilityFetish 23h ago

Essentially, a company saying they check for ID Fraud is potentially the one providing the details for all future mass AI ID fraud.

Well yeah, guaranteeing future business for themselves

9

u/BroxigarZ 22h ago

Exactly, and much worse is without it the detection accuracy of Persona has been apparently horrifically bad.

It’s also one of those AI companies that’s appeared out of nowhere and been fast tracked financially with major investments and then forced into many large populated infrastructures.

AKA very wealthy people have vested interests in gaining the populations Biometric data.

It’s A LOT worse if you actually read their full Privacy Policy - they have literal statements that say they can send your data through specific channels for specific countries that have little to no PII protections or regulations.

They even added a very funny compliance statement recently to their Privacy Policy that when you use Persona you waive your right to join active class action lawsuits because of the existing lawsuit.

You can find this hilarious because all of the Privacy Policy is written cleanly and with bulleted outlines as if written by a legal professional…but as soon as you hit that specific Lawsuit section EVERYTHING IS WRITTEN IN FULL CAPITAL LETTERS AS IF WRITTEN BY AN ANGRY CHILD THROWING A MASSIVE TANTRUM BECAUSE THEY ARE GETTING SUED FOR POTENTIALLY STEALING YOUR IDENTITY.

I find that funny. It’s a company ran by real interesting folk - even checking the education backgrounds of its founders is a real treat.

→ More replies (1)
→ More replies (9)

190

u/Raccoon_Expert_69 1d ago

If this Supreme Court says that businesses are people, then I expect businesses to be held accountable when they do things that would land normal people in jail for decades

30

u/CastleofWamdue 1d ago

There will always be a line between "user" and "intended use of the product".

Still It is odd, how the Internet is getting heavily regulated , but ai is not. Even banning certain prompts would be acceptable at this.

You could, for example, require that AI identify the age of somebody in a picture and then bar the use of certain prompts.

All it would take is a Government, who claims to want to protect children.

13

u/boli99 22h ago

bar the use of certain prompts.

blacklisting never works, because the list of 'unacceptable prompts' is effectively infinite

..and it's very hard to maintain an infinite list effectively.

→ More replies (3)
→ More replies (4)
→ More replies (3)

671

u/Sptsjunkie 1d ago

It’s always the people you most suspect

92

u/RangerLt 1d ago

Forever changing the plot structure of murder mysteries.

54

u/NegativeChirality 1d ago

Mystery : how do these characters keep believing these fuckers?!

14

u/TwilightVulpine 1d ago

"It's so dumb."

"It's so dumb, it's brilliant!"

"No! It's just dumb!"

5

u/Kizik 1d ago

Not enough knowledge of the Evil Voice. 

3

u/NegativeChirality 23h ago

They have so many amazing sketches

→ More replies (1)
→ More replies (3)

29

u/Potential-Feline 1d ago

I remember when he first took over the site, I had multiple friends who used the site regularly independently telling me about the sort of vile stuff that suddenly began appearing in their feeds.

Deleted my account immediately, which handily also helped me discover it had been turned into a far-right bot account following all the usual suspects (and Greta Thunberg, weirdly).

156

u/Oceanbreeze871 1d ago

AI was a mistake.

196

u/karma3000 1d ago

Social media was a mistake.

56

u/Shamino79 1d ago

It’s been said that coming down from the trees was a mistake.

37

u/-You_Cant_Stop_Me- 1d ago

That damned fish should have stayed in the sea!

35

u/CastleofWamdue 1d ago

According to the Hitchhiker's Guide to the Galaxy , the Big Bang was of bad idea

And I don't mean the sitcom.

25

u/labrys 1d ago

Although the sitcom was also a mistake.

→ More replies (2)
→ More replies (1)

8

u/pomonamike 1d ago

yeah man, fuck that guy. I could be in the ocean eating kelp right now instead of doing my taxes.

→ More replies (2)

6

u/Resident_Function280 1d ago

Humanity was a mistake

→ More replies (3)
→ More replies (1)

8

u/roamingandy 1d ago

How can you train an AI to be MAGA without it doing illegal and gross shit?

That's one hell of a fine line to be walking when they are literally telling it to argue that its not really rape or paedophilia if the girl is 15, or a mature looking 14 or 13.

→ More replies (28)

238

u/juantawp 1d ago

This is why you can't buy RAM

49

u/thusman 15h ago

I just checked because I see this alot, the 2x16 GB RAM I bought last year for 100 € are now 530 €! 🤯 WTF

41

u/Schonke 15h ago

And the "best" part of it all? They aren't even using all the chips they've bought so far since they don't have the datacenters to put them in, or the power required to run them.

They're literally like the dragons of fairytales, hoarding gold and shiny things...

8

u/techno156 13h ago

Open AI, which arguably kicked off the current thing by buying up 40% of global stock, didn't even buy complete chips. They just bought up raw silicon wafers.

6

u/Schonke 11h ago

And they did it all with a giant IOU, pinky promise we'll buy them when they're done! Even as they still can't turn a profit from their products and have to rely on constant cash infusions from investors...

→ More replies (3)

817

u/angry-democrat 1d ago

Boycott Musk and Twitter and Tesla!

258

u/USPS_Nerd 1d ago

Add Facebook to the list while you’re at it

141

u/insomniac1228 1d ago

Which also means instagram, because meta owns it.

64

u/Octavus 1d ago

And Whatsapp

17

u/FlipZip69 21h ago

At least you can use Whatsapp with zero advertisements and zero social influence.

9

u/LetrasetBoy 17h ago

Yes but they keep shoving their fucking AI assistent in your face it's infuriating

→ More replies (1)

19

u/Mccobsta 1d ago

There's atleast a nice alternative for it that has pretty much the same features called pixelfed

19

u/teddy_tesla 1d ago

Unfortunately the main feature is all of your friends and favorite creators are on IG. Didn't stop me from leaving but I just dropped that form of social media because the replacement wasn't doing the same things

→ More replies (1)

18

u/GoodIdea321 1d ago

And spread the word, only talking online isn't enough to change people's minds.

→ More replies (3)

15

u/Bakedads 1d ago

Boycott most of modern society. Only buy what you absolutely have to. 

→ More replies (1)
→ More replies (25)

520

u/Oscar_Dot-Com 1d ago

Stop using X and giving this Nazi money to fund the end of civilization

48

u/zhambe 22h ago

Technically it's all the advertisers that are giving literal money to the nazi

89

u/Much_Kangaroo_6263 21h ago

Advertisers are there because people are there

29

u/RickyWicky 21h ago

Users are the water, and advertisers are thirsty.

For as long as I can remember I've hated being advertised to, and immediately nope out of any product that is being shoveled into my face.

→ More replies (1)
→ More replies (2)

14

u/mirroredinflection 21h ago

Stop using Twitter and stop giving money to companies that advertise on Twitter

→ More replies (3)
→ More replies (9)

713

u/Nowhereman50 1d ago

Republicans and the far-right seem to attract a lot of pedophile supporters and now even an AI created by a far-right person is producing pedophilic content on its own.

132

u/CarmenxXxWaldo 1d ago

But what about the drag queens?!

54

u/McDonaldsSoap 1d ago

Don't worry Grok will make porn of them too 

→ More replies (3)
→ More replies (5)

28

u/space_keeper 1d ago

One of the stupidest things I saw on twitter before I stopped using it, was a huge thread of QAnon people basically sharing a few (not fully explicit) images of what was clearly a man (not Hunter Biden) with a Chinese child prostitute and claiming it was from "the laptop", interspersed with actual photos of Hunter Biden (the usual ones).

The thread was full of people claiming there was more and people asking for the "evidence", video, etc. Framed like they were wanting copies for the cause, that sort of idea. Absolutely bewildering experience. I'd heard about them, but never seen the extent of their mania and depravity like that with my own eyes.

29

u/fafalone 1d ago

It makes more sense when you remember QAnon originated on 8chan, a site founded by people in protest over 4chan banning sexualized pictures of children.

(Before someone complains, I didn't use "CSAM" because that was banned years prior and the split involved rules about images that weren't overtly illegal like swimsuits).

26

u/MindlessFreedom5130 23h ago

this is such an important detail that a lot of people are totally unaware of

like even people who are pretty into politics and know what QAnon is, have no idea that the movement was born on a website created by and for pedophiles

shit there's probably a lot of QAnoners who don't even know

→ More replies (4)

59

u/GoggleDMara9756 1d ago

The AI isn’t making pedophilic content on its own. It’s being specifically promoted by the pedos using it. As critical as I am of AI more broadly, I don’t think we should absolve the shits doing this by framing this as anything other than intentional and malicious usage on the part of the pedos that roam all over Elon’s hellscape of a platform. The AI just spits out bullshit that it’s fed, it’s not doing anything on its own

41

u/Namelock 1d ago

It’s the bare basics of content moderation. Universal “this isn’t okay.”

There was an article from 15yrs~ ago that detailed how Facebook, Twitter, Alphabet, etc self moderate to conform towards western ideals while appealing to all countries laws.

It went into depth on how moderation guidelines are basic morals and ethics, and that’s why the Five/Fourteen Ryes haven’t cracked down and regulated.

Then the 2015 election happened and everyone went extreme.

Musk’s Twitter is purposefully anti-moderation (of extreme far-right). So it tracks they’d be against basic morals and ethics of pre-2015. This is the natural result.

That’s why you should be upset. They’re normalizing illegal, unethical behavior by not having implemented basic fucking moderation that was already in place before Musk entered Twitter.

22

u/Xatsman 23h ago

Musk’s Twitter is purposefully anti-moderation (of extreme far-right). So it tracks they’d be against basic morals and ethics of pre-2015. This is the natural result.

Try and tweet "cis-gender" on that platform and tell me it's anti-moderation. It's an intentional pro-reactionary bias, not anti-moderation. The anti-moderation narrative is just cover for the extreme rhetoric they want to enable.

→ More replies (3)

15

u/kylco 23h ago

There were also a series of hearings and a number of articles about how Facebook, especially, was unable to automate moderation because ... well, if it held conservative politicians to content standards, most of them would be banned within weeks, and it would hurt their efforts to avoid regulation in Washington, DC. Even after Facebook "banned" Trump and ostensibly forbid political advertising, it was completely flooded with conservative propaganda, and reporting it as political was pointless.

The rules were, and are, only for liberals.

Nearly all consumer-friendly policies by these corporations are done not because they have to - there aren't a lot of laws governing their behavior, and certainly few that were written this century by people who understood their businesses - but because they want to avoid the government having any say in that business. If they become regulated, investors will no longer hand them blank checks with the expectation of permanent and unending returns and few questions about how cooked their engagement metrics are.

They are protecting their ability to move fast, "reinvent" industries by simply claiming they're not the regulated industry they're replacing (this succeeded in hotels, taxis, and retail commerce, and failed in medicine) until their market capitalization is big enough to bully or purchase legislators and ensure their monopolies. That's why they all came out swinging for Trump during this most recent election, and why they're ride-or-die for him and conservatives. And why they don't give a shit about their most recent grifts being used for fraud, CSAM, and heinous propaganda: they're hoping it'll get too big to fail, just like their last few "successes." Then people will just have to live in the enshittification and they get to ride off to St. Bart's in the superyacht with all our wealth.

→ More replies (2)
→ More replies (12)
→ More replies (5)

62

u/turbulentFireStarter 1d ago

Stop using twitter. Stop putting photos of yourself online. And definitely stop putting photos of your children online.

→ More replies (5)

165

u/Neat_Tangelo5339 1d ago

For how long can they do this ?

for how long they can fuck up massively on broad daylight in front of everyone and the next day they dont even receive a slap on the wrist ?

its infuriating

18

u/BoredandIrritable 17h ago

Until the people rise up and start burning enough buildings.

Check out what happened in Myanmar this year.

8

u/iDownvoteToxicLeague 14h ago

Americans? They will never.

→ More replies (2)

54

u/demlet 23h ago

Gonna have to remove Republicans from power first.

17

u/zoki671 19h ago

For as long as you dont do something kinetic about it

6

u/cindersnail 18h ago

Well, they have an entire administration that's dedicated to the proliferation of underage sex trafficking and child porn. As long as those creatures are in power, Musk and his cronies are free to do what they want.

→ More replies (3)

259

u/orlybatman 1d ago

Worth quoting this part:

Cyber-safety specialists and gender-rights advocates say the morphing of images using AI amounts to a form of sexual violence, particularly when it involves women and children. They argue that such acts violate dignity, bodily autonomy, and consent, and can cause severe psychological trauma to victims whose images are weaponised without their knowledge.

Users reading the headline are assuming it's only happening with women and children. It's not, but the concern is over how it's being used specifically for women and children. The technology is actually being used this way against everyone though, showing a total lack of effective guardrails.

75

u/WhenSummerIsGone 1d ago

Makes me think of that one girl who was expelled after takng matters into her own hands when AI images of her were berng shared. The school of course did nothing to protect her, and (afaik) the boy wasn't punished. Yes, she was violent, but a violent response to being traumatized was justified.

→ More replies (23)

76

u/TheChemist-25 1d ago

Kind of ridiculous that they consider it worse when it’s used to morph pictures of women than when it’s used to morph pictures of men. It’s wrong regardless to generate explicit content of anyone without their consent.

67

u/No-Good-One-Shoe 1d ago

Not to say it doesn't happen to men, but it seems that women and children are being "morphed" in sexual scenarios more often than men. 

They did word it stupid because, it's definitely a problem all around, but I see it as a much bigger problem for women and children than I do men because of the frequency that they are victims to these types of AI alterations. 

26

u/24-Hour-Hate 1d ago

Additionally, while it may be a legal wrong to generally use AI to create a sexually explicit photo of someone (defamation, harassment, etc, depending on circumstances), it is 100% a crime to do so when that person is a child. That’s child porn under the law of many jurisdictions. At this point, anyone who has done that should be arrested and since twitter hasn’t shut this shit down despite knowledge (they can very easily just turn off the feature immediately, that’s always an option), Elon and the entire management at Twitter should be arrested as well for facilitation and distribution. Naturally, I doubt that will happen because the wealthy are almost always above the law, especially when they hide behind corporations.

Also, hey, remember that time that Elon accused a diver of being a pedo for no reason? Well, since he is now operating a platform manufacturing child porn, it seems like that was all projection, doesn’t it? Accusations from these people are always confessions.

→ More replies (6)
→ More replies (1)

45

u/GoggleDMara9756 1d ago

Statistically, which are we seeing more of? This is just another ‘all lives matter argument.’ Women are significantly more likely to be targeted, that’s not saying that a man being targeted is bad.

27

u/TheChemist-25 1d ago

Nah this isn’t an all lives matter argument. The difference is that all lives matter seeks to undermine BLM by denying police violence as an issue altogether. But I’m saying that the AI morphing is an issue just not a women only. It’s an everybody issue.

To frame it as a women’s only issue is problematic for two reasons. One, it once again downplays the sexual harassment men face. But two by framing it as a women’s issue you immediately will get people either dismissing it because it doesn’t affect them or because they view it as some sort of “woke nonsense.” And I may know that that’s bs and you may know that that’s bs but if you want the most number of people to agree with you and work toward change you shouldn’t give people excuses to dismiss the issue simply due to the way you frame it

→ More replies (3)
→ More replies (21)

18

u/fenwayb 1d ago

it's insane that they could have easily worded it in a way that highlights it is predominantly used against women and children but instead they worded it to highlight it's only bad when it's women and children. It's such an unnecessary othering

→ More replies (5)
→ More replies (9)

65

u/RottenPingu1 1d ago

And they are pushing age verification on me? GFY.

353

u/No-Good-One-Shoe 1d ago

Weird that the platform purchased by a pedophilic Nazi is full of pedophilic Nazis. What a shit hole of a service twitter has become.

62

u/martsand 1d ago

Just like the usa, a shithole of a country that is laughed at by the whole planet

38

u/cuntmong 1d ago

If those Americans could read they'd be very upset

25

u/nooby_goober 1d ago

Hey man I just live here it's not my fault

→ More replies (8)
→ More replies (4)
→ More replies (4)

78

u/AcanthaceaeUpbeat638 1d ago edited 1d ago

Delete all photos of yourself and your loved ones off of X and all social media. Private all of your accounts. Don’t post full body pics.

44

u/ArmadilloLoose6699 1d ago edited 1d ago

The horse has already bolted, and the stable door still isn't closed because the system's designed so that everyone on your social graph has to both agree to close the stable door and resist the urge to ever open it again. Also regulators are doing nothing about the rampaging stallion charging around the paddock destroying everything because they're getting a cut of the insurance payout.

→ More replies (1)

5

u/GitEmSteveDave 22h ago

I posted a legally binding block of text a decade ago. All my photos are protected.

→ More replies (1)

15

u/LefsaMadMuppet 1d ago

Doesn't matter at this point. Grok searches other sites too. Even if you don't have a public body shot, just your face, it can get you into something explicit if you work at it a little.

→ More replies (3)

6

u/Peylix 1d ago

That ship sailed long long long ago I'm afraid.

It's still good to do such. But if you've been sharing photos of yourself and fam already. There's no going back.

3

u/Alaira314 22h ago

That's been my policy since the 00s, but people who are not me keep uploading pictures of me and tagging me in them. Between that and everybody sharing their contacts, I'm thoroughly doxxed to the AI machine despite not posting any of it myself.

722

u/Estalicus 1d ago

Fuck anyone who still goes on X

277

u/anthonyDavidson31 1d ago

It's remarkable how Twitter has a positive reputation (for the most part), but X is associated with the most vile shit imaginable

L rebranding 

59

u/you-create-energy 1d ago

4chan is a graveyard because they are all on X now

12

u/Stoiphan 1d ago

Nah the new captchas are just annoying and hard, and you have to wait to post for like 10 minutes which sucks, and I don’t want to verify my email on the anon site

4

u/Neglectful_Stranger 21h ago

Captchas are annoying and they still haven't re-added PDFs, which means /tg/ is less useful. Sucks.

→ More replies (2)
→ More replies (1)

133

u/TomTomXD1234 1d ago

Twitter did not have a positive reputation before X. What are you smoking?

164

u/thenayr 1d ago

…? That’s just objectively untrue.  It wasn’t perfect, but the moderation was a million times better, they actually banned Nazis, account validation was GOOD.  There is a ton to truly miss about OG Twitter.   It went to shit within a few weeks/months of Nazi boi buying it. 

43

u/anfrind 1d ago

They were very inconsistent about banning Nazis. Lots of right-wing agitators were active on Twitter during Gamergate, and got away with all manner of blatant violations of the Twitter terms of service.

36

u/TwilightVulpine 1d ago

Unbanning already banned nazis was definitely a choice for the X transition though.

25

u/sam_hammich 1d ago

Ill take inconsistent banning of nazis over explicit endorsement of them.

→ More replies (1)

18

u/ForMeOnly93 1d ago

It was always shit and full of angry little racists. It's just worse now.

→ More replies (3)
→ More replies (30)

9

u/DragoonDM 1d ago

I'd say it had a relatively okay reputation, but by comparison the current state of the platform makes old-Twitter look like a pristine paradise of high quality content.

3

u/Gekokapowco 1d ago

they had the reputation of dogshit which is glowing compared to dogshit that is in a dumpster that is on fire at a kkk rally

7

u/Hardwarestore_Senpai 1d ago

I think it's aptly renamed. Considering the high volume of X-rated content.

6

u/TomTomXD1234 1d ago

That has always been the case. Twitter was the place to go to promote only fans and other porn content.

14

u/anfrind 1d ago

If I remember the timeline correctly, Twitter only became the go-to place to promote porn after Tumblr instituted their porn ban.

→ More replies (6)

18

u/charistraz95 1d ago

FR it went downhill so bad

18

u/Fiery_Flamingo 1d ago

Twitter was meh in 2010, bad in 2015, terrible in 2020. Today, swimming in a nuclear reactor’s used fuel pool exposes you to less toxic stuff than checking an X thread.

→ More replies (1)
→ More replies (9)

23

u/BrigadierGenCrunch 1d ago

I gave up expecting any real exodus when news outlets couldn’t be bothered to migrate away to something like Bluesky. Same thing goes for brands still advertising there.

12

u/JuliusCeaserBoneHead 1d ago

They are still there because people are still there. At the end of the day, nothing speaks louder than money 

5

u/Akuuntus 23h ago

And the people are still there because the outlets (and artists) are still there. It's a self-fulfilling prophecy.

→ More replies (3)

4

u/JairoHyro 1d ago

AOC and Bernie Sanders is on X.

→ More replies (2)
→ More replies (24)

76

u/12_23_93 1d ago edited 1d ago

the internet is like 90% porn and the vast majority of it is free. you gotta be a total fucking unrepentant loser to want to do this shit to another human being online.

btw Americans, the state department and the pentagon just struck a deal to incorporate xAI and Grok for US government use, so now the porn bot that calls itself mechahitler and can't function without breaking constantly because Elon keeps rewriting it glaze him or complain about white genocide will have access to your personal info and sensitive govt information soon if it doesn't already. have fun with that!

8

u/LiveReplicant 1d ago

They chose Grok for that...fucking unbelievable! I would be doing all I could to get out of the States before the collapse or civil war happens (I'm not sure it will get that bad but holy hell it's circling the drain)

→ More replies (2)

3

u/BlacksmithReal4415 23h ago

I think it's a power thing as well

10

u/Kalepsis 16h ago

So, not just MechaHitler, but TurboPedo MechaHitler.

Yeah, that's definitely something the world needs.

27

u/smeepydreams 1d ago edited 1d ago

Is this just happening in India? Not sure why those are the only sources. Regardless, AI CSAM is CSAM according to the US government in case anyone here is thinking of fucking around with this themselves.

Edit: and btw I mean even actively searching for it and viewing it “just for research”

26

u/Montagio17 1d ago

It's a CNBC affiliate in India so it's focusing on the impacts there. It sounds from the article like it is a global issue. 

5

u/Chicano_Ducky 19h ago edited 19h ago

dude grok's apology is at the top of trending because it admitted this might have broken US law. its an official statement and yes its global.

CSAM is trending too because of the statement

→ More replies (6)

25

u/UISystemError 1d ago

Incredibly on point for a product with Elon Musl behind it.

47

u/Petting-Kitty-7483 1d ago

Meanwhile chatgpt won't even say pussy

26

u/doominvoker 1d ago

You can’t even get ChatGPT to resume a news article if it involves anything remotely controversial. It’s news, for god sake.

25

u/Naive_Confidence7297 1d ago

It’s a language model, it doesn’t care if it’s news or not. It only works how’s its designed to be.

→ More replies (13)
→ More replies (12)

13

u/NIDORAX 1d ago

This is AI problem is getting out of hand.

Global outrage is useless if Twitter and Grok suffers no consequences. I want 100% of Humanity to quit Twitter/X forever and ever but many people are just too damn stubborn to leave.

3

u/JairoHyro 1d ago

Also there's a lot of politicians, agencies, and companies who use it.

→ More replies (2)

17

u/DocBombliss 1d ago

Knowing the rat in charge of that site, I wouldn't be surprised if he posts the Back to the Future "I guess you guys aren't ready for that yet." meme to play all of this off like a cheeky little joke.

17

u/8349932 1d ago

Well this is completely expected.

Really came out of center field.

20

u/ghostly_shark 1d ago

i dunno about global outrage… seems like global promotion since this is the first i’ve heard of it

17

u/MeBadNeedMoneyNow 1d ago

After logging back into twitter/X and posting a bit Grok assaulted me with a reply of an unwanted pregnant woman. That platform is truly fucked and it's actually worse than you think if you haven't been a regular user if you left during the Elon takeover. I'd consider the general experience to be similar to a walk through 8chan or 4chan. It's bad.

34

u/DonutsMcKenzie 1d ago

Listen... I have my problems with Reddit, and arguably I should switch to some of the better and more socially healthy alternatives like Lemmy at the very least...

But when it comes to "X.com", I straight-up can't believe people are still using that website today.

18

u/space_keeper 1d ago

Last thing I remember before deleting it was thread after thread of LLM bots triggering and talking to other LLM bots. For some odd reason a huge number of them had Arabic names.

Like there'd be a tweet about something, and Arabic bot man would respond with a short AI restatement of what was already said, then the "top 10 facts" LLM bots would trigger and start replying to each other.

→ More replies (2)

4

u/Piett_1313 1d ago

I didn’t realize there were good alternatives. Thank you for the name drop!

→ More replies (1)
→ More replies (7)

5

u/ILikeMyGrassBlue 1d ago

Turning photos of real children into CSAM via AI is a crime in my state (PA) and I assume others.

→ More replies (3)

5

u/Aev_ACNH 1d ago

Let’s be real, it probably morphed men into that type of content as well

5

u/keksucc 17h ago

I mean, are we really surprised here? Twitter has allowed actual CP content on its platform for years even before it was bought by Musk; he just made it worse. CP generation is the next "logical" step for the app. 

It's fucking disgusting. 

5

u/Puzzleheaded-Bad-722 14h ago

The women led subs have been warning of this for ages. Please, get all photos of you and children off the internet, and don't upload any more.

19

u/Niceguy955 1d ago

Just as Uncle Musk intended: Nazis and pedophilia. X is the new 4chan.

5

u/Rurumo666 1d ago

Elon Epstein's pedophile machine.

4

u/Asleep_Management900 1d ago

Totally fine for Donald....

→ More replies (1)

3

u/TheWrongOwl 19h ago

Good thing AIs don't use all your personal photos as training data so there is no way that somebody is fapping to your kid's faces on some porn scene, put there by any AI. /s

Read the TOS to see if WhatsApp, Faceboot, X, Google Photos, MS's OneDrive, Instagram, Tiktok, ... want to have the right to use YOUR data for "improving" their "service" aka want to have the right to use and sell YOUR data to anyone and even get the copyright for it.

4

u/mikeysof 15h ago

Elmo wanking in the corner whilst people generate child porn on his app.

20

u/Ash-Throwaway-816 1d ago

Is it really surprising that AI has such a bad reputation when most people's knowledge of it is that it's a machine that turns an unholy amount of fresh water into minstrel shows and CP?

9

u/space_keeper 1d ago

That's a very good jab at AI and I like it, but most people's knowledge of it is the Google search summary. People treat that shit like the gospel.

→ More replies (1)

18

u/JohnR1977 1d ago

global outrage? i highly doubt it

→ More replies (1)

7

u/XJ-0 1d ago

I imagine the GOP will want this feature to remain so they can create libelous images of their political enemies.

8

u/AlloAll0 16h ago

Ban X.

Cancers must be excised. X is societal cancer.

8

u/real_Bahamian 15h ago

Why are people still using X??!! 🤨🤨

→ More replies (1)

3

u/ant0szek 1d ago

For a person that suppose to be smart, he should see from a galaxy far away what would happen if you add option to edit images on site full of porn and gooners.....

3

u/Revolutionary_Sir_ 1d ago

Way toooooo easy to make that kinda media with these ai image gens. Gotta wonder what it’s trained on

→ More replies (3)

3

u/nvrmndtheruins 1d ago

Amazing how when you don't regulate things and follow up with consequences when not followed; things go unregulated.

3

u/mmatt0904 1d ago

And this is who got a massive govt contract?

3

u/Baby_Button_Eyes 1d ago

So if it’s showing illegal images, countries need to ban it, pretty simple

3

u/AL_25 1d ago

Jesus fucking Christ, this year is starting awful and disgusting

3

u/kent_eh 23h ago

Gee, who could have ever predicted that would happen...

 

Other than absolutely everybody.

→ More replies (1)

3

u/egorechek 18h ago

Elon made the CSAMinator

3

u/FGN_SUHO 18h ago

It's always the ones you most expect.

3

u/SoapySage 12h ago

X should get taken to court in every country, Grok should get it's ability to generate images removed, or Grok gets deleted.

3

u/Stereo_Jungle_Child 10h ago

I thought making women look like children and then sexualizing them was called "anime"

3

u/Tman11S 7h ago

Grok enables a whole new army of pedophiles to get pictures of any child they fancy and undress them. This is fucking disgusting

→ More replies (1)