"AI detection platform Copyleaks reported Wednesday that its review of the recently released Sora 2 app, with its improved video generation model, uncovered several videos using celebrity likenesses to recreate a 2020 incident in which a man wearing a Burger King crown was kicked off a JetBlue flight for a racist tirade. In place of the James May lookalike from the original incident, Sora users recreated the scene using Altman and Cuban, as well as popular streamers xQc, Amouranth, IDKSterling, and YouTuber Jake Paul."
"Sora 2 users weren't able to perfectly recreate the incident, mind you, as OpenAI's software does include guardrails to prevent the creation of content with epithets used in the original (i.e., the n-word). However, a simple homophone can be enough to sidestep those restrictions and make it sound as though public figures, including some who've opted into Sora's Cameo feature, were uttering racist slurs, according to Copyleaks."
"The so-called Cameo feature, added when Sora 2 launched last month, allows users to upload short clips of themselves that can then be inserted into Sora-generated videos. There's no official list of celebrities and public figures available in Sora, but users have compiled their own that include a number of dead people and historical figures whose families have been less than happy about their inclusion, apparently granted without permission."
AI detection platform Copyleaks reviewed Sora 2 and uncovered deepfake videos that use celebrity likenesses to reenact a 2020 racist tirade. The Sora 2 model includes guardrails blocking direct epithets, but creators used homophones and coded prompts to produce audio that mimics slurs. The Cameo feature lets users insert uploaded clips into generated videos, and community-compiled lists of public figures — including deceased and historical persons — expanded available likenesses, sometimes without permission. Targeted figures included high-profile CEOs, streamers, and entertainers, demonstrating how content safeguards can be circumvented.
Read at Theregister
Unable to calculate read time
Collection
[
|
...
]