AI

$600,000 ‘Deepfake’ Fraud Heats Up AI Debate in China

 

The debate around artificial intelligence, and its potential use for financial crimes, gained steam in China this week after a scammer used sophisticated “deepfake” technology to dupe a man of 4.3 million yuan ($622,000).

The victim, surnamed Guo, who works at a technology company, received a video call via WeChat from a “friend” who sought his help to bid on a project in another city, state media China Daily reported.

Police say the perpetrator used AI-powered face-swapping technology to impersonate the friend.

 

Also on AF: China Makes First Arrest Over Fake News Generated by ChatGPT

 

“He chatted with me via video call, and I also confirmed his face and voice in the video. That’s why we let our guard down,” Guo told China Daily.

Guo realised the call was a scam after he called his friend to confirm receipt of the transfer. When his friend denied making such a call, Guo alerted the authorities.

Police in Baotou city, in the Inner Mongolia province, where the perpetrator’s bank account was located, said they had managed to stop the transfer of about 3.37 million yuan. Work to recover the remaining 931,600 yuan was ongoing, police added.

The deepfake scam unleashed a heated debate around the threat to online privacy and security on China’s microblogging site Weibo.

“This shows that photos, voices and videos all can be utilised by scammers,” one user wrote. “Can information security rules keep up with these people’s techniques?”

By Monday, the hashtag “#AI scams are exploding across the country” gained more than 120 million views.

The case comes at a time when China is tightening scrutiny of technology and apps capable of manipulating voice and facial data. New rules, in effect since January, ban the use of AI-generated content to spread “fake news”.

The regulations from the Cyberspace Administration of China (CAC) also direct providers of such technology to clearly label photos, videos and text as synthetically made or modified if they could be misinterpreted as real.

Police in Baotou, meanwhile, urged the public to remain careful while sharing information such as facial images and fingerprints. It also asked people to verify the identity of such a caller through alternate modes like phone calls before making any financial transfers.

 

  • Vishakha Saxena, with Reuters

 

Also read:

Beijing Unveils Sweeping Laws to Regulate ChatGPT-Like AI Tech

OpenAI Boss Urges Regulations to Prevent ‘Harm to the World’

Chinese General Urges More Use of ‘Tech, Financial’ Warfare

AI ‘Godfather’ Quits Google, Warns of ‘Risk To Humanity’ – NYT

 

Vishakha Saxena

Vishakha Saxena is the Multimedia and Social Media Editor at Asia Financial. She has worked as a digital journalist since 2013, and is an experienced writer and multimedia producer. As a trader and investor, she is keenly interested in new economy, emerging markets and the intersections of finance and society. You can write to her at vishakha.saxena@asiafinancial.com

Recent Posts

FTX Crypto Fraudster Bankman-Fried Jailed For 25 Years

A US District Judge said the former billionaire wunderkid was responsible for one of the…

3 hours ago

China’s Big 5 Lenders Warn of Property Risks as Margins Shrink

Banks have been reluctant to deepen their exposure to the ailing real estate sector but…

4 hours ago

Chinese Biotech Giant WuXi ‘Sent US Client’s Data to Beijing’

US intelligence officials say Chinese pharma companies are risking national security at a time when…

8 hours ago

China’s BYD Delays EV Factory; Solid-State Batteries ‘Unsafe’

BYD has set back plans for an EV factory in Vietnam, while CATL has said…

8 hours ago

Yellen: China’s Green Energy Push a Threat to Global Jobs – AP

US Treasury Secretary Janet Yellen has accused China of ‘distorting prices’ with its increased green…

9 hours ago

Yen Fears Drag on Nikkei, Hang Seng Lifted by Policy Bets

Japan’s plunging currency and the threat of BoJ intervention sent Tokyo’s soaraway benchmark downwards

10 hours ago