In recent years, with the rapid development of artificial intelligence technology, some criminals have used AI tools to fabricate false information in order to gain traffic and attract attention, seriously damaging the network ecology, disrupting social order, and misleading public perception. In order to further improve the people's ability to identify rumors, on June 3, the Shanxi Internet Security Department exposed 5 typical cases that have recently been investigated and dealt with using AI technology to create and spread online rumors.
[Case 1] Fictitious "factory explosion" scene for blog traffic, company employees were investigated and punished according to law
Recently, the Datong Internet Security Department discovered at work that a netizen posted a video on a platform saying: "An explosion occurred in a workshop in Datong, Shanxi. Only one worker was injured at the scene, and the injured person's facial area was 100% burned." This attracted the attention of netizens. After investigation, it was found that no safety accidents occurred in the company involved, and the relevant content was false copywriting and fake videos generated by Zhao Moumou, an employee of the company, through AI tools. After being released on the Internet platform, it attracted the attention of netizens and caused adverse effects. At present, the public security organs have imposed administrative penalties on Zhao Moumou in accordance with the law.
[Case 2] Using AI to imitate celebrities to deliver goods live, disrupting order and being investigated and punished according to law
Recently, the Datong Internet Security Department discovered during work that Xing, a resident of the area, illegally used an AI digital person in the image of Zheng Liwen, the chairman of the Chinese Kuomintang, to live stream goods, which aroused doubts from netizens and seriously interfered with normal network order. After investigation, it was found that Xing was engaged in live-streaming to bring goods, which coincided with Zheng Liwen’s visit to the mainland and was very popular, so he came up with the idea of using the popularity of celebrities to increase traffic. Later, without authorization, AI tools were used to generate AI digital human images and product delivery plans, and then live broadcast on media platforms to deliver products, which aroused social concern and caused negative impacts. At present, the public security organs have imposed administrative penalties on Xing in accordance with the law.
[Case 3] AI generated rumors about "high-speed car accident" and fabricated "2 died and 6 were seriously injured" and was investigated and punished according to law
Recently, the Changzhi Internet Security Department discovered during work that a netizen named Zhao posted a post on an online platform entitled "Changzhi people, look at it! A bus rolled over on the Changjin Expressway, killing 2 and causing 6 serious injuries. The road icing warning is in effect. These driving rules must be remembered!" and posted multiple so-called "accident scene pictures", which triggered netizens to forward it. After investigation, no such traffic accident occurred on the Changjin Expressway, and the content described in the article is purely fictitious. Zhao admitted that in order to attract the attention of fans, he used AI tools to generate and publish false information about major accidents. At present, the public security organs have imposed administrative penalties on Zhao in accordance with the law.
[Case 4] Using AI to fake a “concert fire” to gain traffic was investigated and punished according to law
Recently, the Jincheng Internet Security Department discovered during work that a netizen on a certain platform posted a video showing a suspected fire in a stadium, with the text saying "A fire broke out at Taiyuan Red Lantern Stadium." The video quickly attracted the attention and forwarding of netizens, causing negative social impact. After investigation, netizen Zhang Moumou used AI tools to fabricate false information about "a fire broke out at Taiyuan Red Lantern Stadium" without verifying the authenticity of the incident and without any factual basis. At present, the public security organs have imposed administrative penalties on Zhang Moumou in accordance with the law.
[Case 5] AI generated false articles and published rumors about "Wutai County car accident" and was investigated and punished according to law
Recently, the Xinzhou Internet Security Department discovered during work that a netizen on a certain platform published an article "A tragic car accident occurred on April 29: A large truck rolled over and killed 3 people, and the scene footage was exposed." The article clearly mentioned "Wutai County in Xinzhou, Shanxi Province" and included AI-generated pictures of the accident, which aroused widespread concern among netizens. After investigation, there have been no such traffic accidents in Wutai County recently. The publisher, Tian Moumou, explained that after seeing a similar title on an App, he copied the link to the AI writing platform to generate the article and published it directly. At present, the public security organs have imposed administrative penalties on Tian Moumou in accordance with the law.
The public security agency reminds that currently, the use of AI to generate false images, texts, audios and videos has become a new trend in the spread of online rumors. This type of information is highly simulated, spreads quickly, and is highly misleading, and can easily trigger social panic. Shanxi Public Security Bureau will continue to intensify the crackdown on such illegal activities, investigate and deal with rumors, spreading rumors, traffic manipulation, malicious diversion and other behaviors in accordance with the law, and resolutely maintain a clean cyberspace.
(Headquarters reporters Yue Xuhui and Hu Xiaodong)
