The plaintiffs embrace two minors and an grownup who was underage when the occasions within the lawsuit came about. One of many victims, recognized as “Jane Doe 1,” alleges that final December, she realized that specific, AI-generated pictures of herself and at the least 18 different minors had been obtainable on Discord. “Not less than 5 of those information, one video and 4 pictures, depicted her precise face and physique in settings with which she was acquainted, however morphed into sexually specific poses,” the lawsuit claims.
The perpetrator, who has since been arrested, allegedly used Jane Doe 1’s AI-generated CSAM “as a bartering instrument in Telegram group chats with lots of of different customers, buying and selling her CSAM information for sexually specific content material of different minors.” The lawsuit claims the perpetrator generated the express pictures of Jane Doe 1 and the 2 different victims utilizing Grok. It additionally alleges that xAI “failed to check the security of the options it developed” and that Grok is “faulty in design.”
Although X has tried making it more durable for customers to edit pictures with Grok, The Verge has discovered that it’s nonetheless doable to control pictures uploaded to the platform. X has maintained that “anybody utilizing or prompting Grok to make unlawful content material will undergo the identical penalties as in the event that they add unlawful content material.” X didn’t instantly reply to The Verge’s request for remark.
“These are youngsters whose faculty pictures and household photos had been changed into youngster sexual abuse materials by a billion-dollar firm’s AI instrument after which traded amongst predators,” One of many victims’ attorneys, Annika Ok. Martin of Lieff Cabraser, stated in a press release. “We intend to carry xAI accountable for each youngster they harmed on this means.”
The lawsuit seeks damages for victims impacted by Grok’s “unlawful pictures.” It additionally asks the courtroom to forestall xAI from producing and spreading alleged AI-generated CSAM.
