Instagram penalizes undisclosed AI-generated profiles

Instagram is updating its labeling system for synthetic accounts, renaming its "AI creator" tag to "AI-generated profile." Under this new policy, creators who feature AI-generated people on their profiles must use the label or face a reduction in their content's reach. The platform clarified that the label is not required for minor creative tweaks, such as using artificial intelligence to edit photos, polish captions, or design graphics. Instead, it targets profiles where the central persona is substantially created using AI.

The social media giant introduced the policy following user complaints about accounts that mimic real humans. Deceptive AI personas have become a growing issue across social media. For example, a Wired investigation earlier this year uncovered more than two dozen AI-generated male influencers on Instagram promoting a gay dating app called Goose, with some accounts directly messaging users to drive signups. Additionally, a July report by The New York Times identified hundreds of AI-generated doctors and wellness figures promoting dietary supplements and making unverified health claims.

For digital marketers and creators, this policy establishes a clear boundary between acceptable AI assistance and deceptive synthetic identities. Creators who openly label their AI-generated personas will not face penalties, allowing legitimate virtual influencers to operate without losing visibility. However, those attempting to pass off synthetic figures as real people will see their distribution severely throttled. This shift forces practitioners to prioritize transparency in their synthetic media campaigns.

This policy shift follows other recent challenges for Instagram's parent company, Meta. The company recently withdrew an AI tool that allowed users to generate images using other people's likenesses after facing severe user backlash. Separately, Meta agreed to an $18 billion settlement with U.S. states over the platform's impact on younger users, which will introduce features like a default two-hour daily usage limit for teenagers.