

It’s becoming increasingly easy for scammers to use a creator’s content to create fake voice recordings by using the videos they post online. So, how did this scammer get her voice and use AI to make a ransom call?Īlthough this scammer couldn’t have used TikToks to create Payton’s voice, this proposes another big risk to popular creators on social media. But Payton disproved those claims because she wasn’t on TikTok until after the scam call happened. Some have said it was because she is a popular TikTok creator the scammer could’ve just used the TikTok videos. One of the big concerns behind this case is how the scammer got Payton’s voice.

Thankfully, when the police called Payton’s phone, she was safe at work. The mother called the police, believing without a doubt that the voice on the other end was her daughter. As the man shouted profanities at the Bock parents, Payton was heard talking on the phone, saying “Mom, I don’t want to die.” A man claimed that her daughter crashed into his car and he was holding her against her will in the back of his truck. Arizona mom DeLynne Bock received a phone call from an unknown number, and when she picked up the phone, her daughter Payton was on the other end. One recent consequence of AI-generated voices involved a ransom call. For instance, these voices can be used to impersonate individuals, manipulate audio recordings or create fake news. “But it is a little creepy that the AI can make them sound exactly like the real people.”Īlthough it is fun to listen to these songs and TikToks, the AI-generated voices bring forth a huge problem there is a potential for malicious misuse. I think they are particularly funny because these are conversations that they would never have and would never say,” he said. “I always love how Joe Biden and Trump get into a roast session. Senior Parth Choudhary enjoys watching these AI-generated TikToks. They proceeded to make fun of each other while they were giving their orders. One video in particular featured Elon Musk, Donald Trump, Barack Obama, Ben Shapiro, Drake, Joe Biden, and Tucker Carlson all in the same car going through the Chick-fil-A drive-thru and ordering food. The trend showcased a variety of US presidents and celebrities in voice chats of video games or ordering fast food on drive-thrus, simulating funny conversations between these figures. Although the vocals in “Heart on My Sleeve” were on point, the melody in the song was very basic and the mixing and production lacked creativity due to the fact that it wasn’t produced in an actual studio.įollowing “Heart on My Sleeve,” multiple other AI-generated songs appeared on social media, going viral “Ivory & Gold” by Travis Scott and Baby Keem and “Winter’s Cold” by Drake are two of the most streamed AI generated songs.Īnother popular trend went viral on TikTok, thanks to AI-generated voices. The Weeknd’s feature is also almost flawless, with his voice and tone sounding identical to his actual voice in his real songs. The lyrics seemed similar to Drake’s discography as well, but it is unclear if the lyrics were written by AI or by Ghostwriter977. However, there were a couple of times when his voice bugs out, showing the imperfections of the AI. On the track, Drake’s chorus sounded nearly identical to his real voice. The song garnered over 15M streams across Spotify, Apple Music, TikTok and Youtube before being removed. Because of the song’s widespread attention and ambiguous legality, it has been deleted from all streaming platforms.

TikTok account Ghostwriter977 is claiming credit for the song. “Heart on My Sleeve” contained vocals sung by an AI Drake, featuring an AI The Weeknd. Over the past week, a song entirely created by AI went viral on TikTok. While these AI-generated voices, nearly indistinguishable from a human’s, may seem harmless, there are several potential dangers associated with their use.

Of most notable applications of AI is the development of synthetic voices, which have become increasingly prevalent in the tech industry. The rapid advancement of artificial intelligence (AI) has brought about a myriad of benefits to our society.
