How AI Cybercrime is Entering a Dangerous New Era - and What Businesses can Do to Protect Against It

In early 2026, social media company X (formerly Twitter) and its integrated generative AI tool Grok found themselves at the center of a fast-escalating controversy. Users were able to prompt the AI to generate or digitally alter images of real people — including women and minors — into sexualized or revealing depictions without consent. The backlash was global, with regulators and advocacy groups demanding stronger safeguards and even removal from major app stores. Many victims reported the crimes to local law enforcement and appealed to X to have the altered photos taken down.

However, this event isn’t just another social media scandal. It’s a watershed moment in how artificial intelligence can be weaponized to harm individuals and undermine trust, with significant implications for companies, brands, and employees worldwide.

The X / Grok Controversy: A Case Study in AI Abuse

What happened?

• Grok (X’s AI chatbot and LLM), was given an integrated AI image generation and editing tool which allowed X users to transform photos of people. Many users took this power to transform women and children into revealing or sexualized images — often without permission.
• Regulators around the world responded swiftly: France expanded criminal probes, California’s Attorney General opened an investigation into non-consensual content production, and major advocacy groups urged Apple and Google to remove the apps for facilitating this abuse.
• Faced with mounting pressure, X announced restrictions, geoblocking the image tool in areas where such content is illegal and limiting certain generation features to paid subscribers.
• Many of the images still exist online as X took 5 days to implement any sort of regulations on its AI image generation tool. 

The incident highlights profound risks when powerful AI capabilities are deployed without robust safety measures or ethical guardrails. It raises fundamental questions about responsibility — from the platform operators to policymakers.

Why This Signals a Broader Shift in AI-Enabled Cybercrime

The X / Grok controversy is more than a social platform failing — it’s an early example of how AI can facilitate new types of cyber abuse that are asocial and scalable by design:

AI Makes Harm Scalable

Before generative AI, creating convincing deepfakes or intimate image manipulation took technical expertise. Now a casual user with a prompt can generate thousands of non-consensual edits per hour, exponentially increasing both volume and impact. In the hands of someone who wanted to do real harm to a person, it is not hard to imagine how much easier and more impactful this type of harm could be. 

AI Blurs the Line Between Creative Tools and Offensive Weaponization

Tools intended for creative editing are being repurposed by malicious actors for harassment, intimidation, and exploitation. Without clear ethical constraints, AI features become vectors for harm. With LLM and AI generation becoming much more sophisticated and believable, cybercriminals are able to craft much more convincing impersonations for phishing attacks and other nefarious activities. 

Legal and Ethical Frameworks Have Lagged Behind Technology

The global backlash and multi-jurisdiction probes show that policymakers are scrambling to catch up with threats already in motion. This lag creates uncertainty and risk for organizations that rely on AI-enabled services and can also create doubt for those who are already .

The Hidden Dangers for Businesses

While individuals are immediate victims of non-consensual image abuse, the ripple effects can also reach employers and brands:

Employee Harm and Brand Reputation Risk

If employees are targeted online — especially in imagery tied to their professional personas — it can lead to emotional distress, reputational damage, and secondary attacks against the employer. There have already been examples of people’s likeness being taken from professional images on social media like LinkedIn, Instagram and X to be used for deepfakes and non-consensual image generation.

Corporate Social Responsibility Exposure

Brands that remain silent or fail to protect employees can face public criticism, loss of trust, and negative media coverage. Moreover, these issues bring AI-related issues to the forefront of the media, and companies using any forms of AI may also face backlash.  

Operational and Legal Risk

Companies increasingly must navigate evolving regulations around AI misuse, data privacy, and digital rights protection — including liability if corporate data or imagery is misappropriated by AI.

How Companies Can Protect Their People and Their Brand

1. Develop a Clear AI Usage Policy

Businesses must create internal policies governing how employees may use generative AI — especially tools that can create, edit, or replicate images and personal data. This policy should address:

• What tools are approved or prohibited
• Rules around imagery of employees or executives
• Reporting mechanisms for misuse

2. Educate Employees on Digital Safety

Additionally, to protect your employees, offer training on:

• Recognizing deepfakes and manipulated content
• Reporting harassment or misuse of likenesses
• Best practices for protecting personal and professional images online

Companies can help protect their employees from AI misuse and scams with adequate cybersecurity training. 

3. Monitor Brand Mentions and Imagery

Businesses can and should implement AI-powered monitoring tools to detect unauthorized use of brand or employee likeness across platforms and the wider web. 

4. Establish Incident Response Protocols

Be prepared with clear escalation paths when non-consensual or harmful AI content involving the company is detected. This includes legal, PR, HR, and IT coordination.

5. Advocate for Responsible AI Regulation

Engage in industry coalitions and support initiatives that push for ethical standards in AI development. This not only protects your people — it strengthens the ecosystem for everyone.

Looking Ahead: AI Is Inevitable — But Abuse Doesn’t Have to Be

The rapid misuse of AI on X is not an isolated glitch — it’s a preview of the broader challenges businesses will face as generative AI becomes woven into everyday digital life.

Unchecked AI can empower cybercriminals to harass, defraud, or exploit at scale. But organizations that anticipate the threat, educate their workforce, and implement safeguards can turn this challenge into a competitive advantage — protecting not just their brand, but the dignity and digital safety of their people.