top of page
  • Vishal Narayan

Election 2024: OpenAI working on image provenance tool to fight against deepfake



 

With several elections around the corner, including one in India, OpenAI has announced measures to prevent the subversion of the election process with the use of AI, one of them will be a tool to reveal the source of the image.  

 

In a blog published on its website on Monday, OpenAI said that it won't permit the use of AI for political campaigns or influencing elections through lobbying.

 

"We expect and aim for people to use our tools safely and responsibly, and elections are no different. We work to anticipate and prevent relevant abuse—such as misleading 'deepfakes,' scaled influence operations, or chatbots impersonating candidates," it said.

 

The company said that to prevent fraud through fake images it will be implementing the Coalition for Content Provenance and Authenticity’s digital credentials approach which allows users to detect the provenance of images generated by Dall-E 3, a text-to-image AI tool.

 

"Better transparency around image provenance—including the ability to detect which tools were used to produce an image—can empower voters to assess an image with trust and confidence in how it was made. We’re working on several provenance efforts.

 

"Early this year, we will implement the Coalition for Content Provenance and Authenticity’s digital credentials—an approach that encodes details about the content’s provenance using cryptography—for images generated by DALL·E 3," it said.

 

OpenAI also said it is experimenting with a provenance classifier, a new tool for detecting images generated by DALL-E and that its internal testing has shown "promising early results."

 

"We plan to soon make it available to our first group of testers—including journalists, platforms, and researchers—for feedback," it said.

 

OpenAI said that in the US – which is also due for presidential election – it is working with NASS, or National Association of Secretaries of State – the oldest not-for-profit of public officials.

 

It said it will direct users seeking details about elections and candidates to an authoritative website for more information.

 

"ChatGPT will direct users to CanIVote.org, the authoritative website on US voting information, when asked certain procedural election related questions—for example, where to vote. Lessons from this work will inform our approach in other countries and regions," it said.

 

Concerns about election subversion run high in the US, with former president Donald Trump, a hit with the alt right prone to use of fake communications, leading the nomination race with 20 delegates.

 

Although election dates in India are yet to be announced, they are likely to be held between April and May later this year.  

 

bottom of page