AI Image Manipulation Scams: How Criminals Blackmail Victims Using Deepfake Images

Post Views: 12

AI-generated fake images and videos are being used by cybercriminals to extort money from victims, posing significant risks to online users.

Introduction

Cybercriminals are leveraging artificial intelligence to generate explicit images and videos of individuals, using them as leverage to extort money. Security professionals have highlighted the increasing threat posed by these fabricated materials, which can appear authentic and pose significant risks to online users.

Understanding AI Photo Morphing Scams

Morphed photographs and videos refer to digitally altered media that depict individuals in scenarios that never occurred. These alterations may involve modifying facial features, inserting inappropriate content, or generating entirely fabricated scenes. The rise of artificial intelligence has enhanced the realism of such manipulations, making it increasingly difficult to distinguish between genuine and synthetic media.

How Criminals Use AI to Create Fake Content

A single image shared on social platforms can be repurposed to create convincing deceptive content. Perpetrators exploit this capability to threaten victims with reputational harm, public exposure, or financial loss. In many instances, the individuals depicted have no knowledge of the content being used against them. Criminals employ a range of digital techniques to produce explicit material. Basic photo-editing tools allow modifications to facial expressions, body structure, or background elements. Face-swapping technology enables the transfer of one person’s features onto another’s image or video. Deepfake systems use machine learning to alter facial movements, vocal patterns, and other characteristics to create highly realistic forgeries. AI-driven content generation tools can synthesize entirely new images or videos based on existing photographs or textual descriptions. Video manipulation techniques further enable the creation of misleading recordings that falsely depict individuals engaging in activities they never participated in. These methods often operate without the subject’s consent or awareness.

The Mangaluru Case

A recent incident in Mangaluru, Karnataka, involved a 19-year-old man whose image was allegedly manipulated into an obscene depiction. Scammers reportedly demanded ₹5.24 lakh in exchange for refraining from distribution.

Steps for Victims to Take

Victims are typically targeted after criminals obtain photographs from public online sources or social media profiles. Once acquired, these images are altered into explicit content and used to extort payments. Threats often involve sharing the material with the victim’s contacts or the broader public, leveraging fear of embarrassment or reputational damage. Victims should document all evidence, including screenshots of the manipulated material and communication records. Preserving contact details of the perpetrator, such as phone numbers or social media profiles, is critical. If the content has been published online, the specific links or posts should be saved. Financial transactions, including UPI or bank records, must also be retained. Reporting the incident to the relevant social media platform is essential, as well as filing a complaint through the National Cyber Crime Reporting Portal. Victims are advised to contact local cybercrime authorities and avoid engaging with the perpetrator or sharing the content further. Maintaining records of all reported actions can aid in tracking subsequent developments.

Removing Circulated Manipulated Content

Removing circulated manipulated content requires proactive measures. Victims should report the material to the platform hosting it, providing details about the content, the responsible account, and the nature of the violation. For adult users, the StopNCII initiative offers a tool to generate digital fingerprints (hashes) of the content, enabling platforms to identify and remove duplicates. However, repeated removal may be necessary if the material reappears under different accounts. Each new instance should be reported separately, with supporting evidence retained. Updating cybercrime complaints with new information ensures ongoing legal and technical intervention.

Legal Recourse for Victims

Legal recourse exists for those affected by the creation or distribution of explicit morphed content. Under the Information Technology Act, Section 67 penalizes the publication of obscene material in electronic form, with penalties including up to three years in prison and a fine of ₹5 lakh for a first offense. Section 67A addresses sexually explicit content, imposing up to five years of imprisonment and a ₹10 lakh fine for initial violations. Subsequent convictions carry harsher penalties. Additional legal actions may involve investigations into associated harassment or financial fraud. The specific charges depend on the content’s nature, the accused’s actions, and the circumstances of the offense.

Mitigation Tips for Users

To mitigate risks, social media users should adopt cautious online practices. Publicly accessible profiles increase the likelihood of personal images being harvested by malicious actors. Accepting friend requests from unknown individuals, sharing excessive personal content, or uploading photos to unverified websites heightens exposure. Avoiding untrusted AI photo-editing applications and restricting app access to device galleries is recommended. Private media should not be shared through insecure channels or with unfamiliar parties. Implementing strong passwords, enabling two-factor authentication, and regularly updating software can enhance account security. Reviewing and limiting app permissions on social media platforms further reduces vulnerabilities. While these measures cannot eliminate all risks, they significantly diminish opportunities for exploitation.

Conclusion

The proliferation of AI-generated explicit content underscores the evolving tactics of cybercriminals. Victims must prioritize evidence collection, report threats promptly, and utilize platform-specific removal tools. The Mangaluru case exemplifies how fabricated images can lead to substantial financial harm when perpetrators exploit fear and social stigma. As technology advances, continuous education and robust legal frameworks remain critical in combating these threats.