The AI threat has emerged at a time when democracy advocates already are deeply concerned about the potential for “ordinary” online disinformation to confuse voters. Photo from Getty Images.

By Zachary Roth
Indiana Capital Chronicle

INDIANA — This year’s presidential election will be the first since generative AI — a form of artificial intelligence that can create new content, including images, audio, and video — became widely available. That’s raising fears that millions of voters could be deceived by a barrage of political deepfakes.

But, while Congress has done little to address the issue, states are moving aggressively to respond — though questions remain about how effective any new measures to combat AI-created disinformation will be.

Last year, a fake, AI-generated audio recording of a conversation between a liberal Slovakian politician and a journalist, in which they discussed how to rig the country’s upcoming election, offered a warning to democracies around the world.

Here in the United States, the urgency of the AI threat was driven home in February, when, in the days before the New Hampshire primary, thousands of voters in the state received a robocall with an AI-generated voice impersonating President Joe Biden, urging them not to vote. A Democratic operative working for a rival candidate has admitted to commissioning the calls.

In response to the call, the Federal Communications Commission issued a ruling restricting robocalls that contain AI-generated voices.

Some conservative groups even appear to be using AI tools to assist with mass voter registration challenges — raising concerns that the technology could be harnessed to help existing voter suppression schemes. 

“Instead of voters looking to trusted sources of information about elections, including their state or county board of elections, AI-generated content can grab the voters’ attention,” said Megan Bellamy, vice president for law and policy at the Voting Rights Lab, an advocacy group that tracks election-related state legislation. “And this can lead to chaos and confusion leading up to and even after Election Day.”

Disinformation Worries

The AI threat has emerged at a time when democracy advocates already are deeply concerned about the potential for “ordinary” online disinformation to confuse voters, and when allies of former president Donald Trump appear to be having success in fighting off efforts to curb disinformation.

But states are responding to the AI threat. Since the start of last year, 101 bills addressing AI and election disinformation have been introduced, according to a March 26 analysis by the Voting Rights Lab.

On March 27, Oregon became the latest state — after Wisconsin, New Mexico, Indiana and Utah — to enact a law on AI-generated election disinformation. Florida and Idaho lawmakers have passed their own measures, which are currently on the desks of those states’ governors.

Arizona, Georgia, Iowa and Hawaii, meanwhile, have all passed at least one bill — in the case of Arizona, two — through one chamber.

As that list of states makes clear, red, blue, and purple states all have devoted attention to the issue.

States Urged To Act

Meanwhile, a new report on how to combat the AI threat to elections, drawing on input from four Democratic secretaries of state, was released March 25 by the NewDEAL Forum, a progressive advocacy group.

“(G)enerative AI has the ability to drastically increase the spread of election mis- and disinformation and cause confusion among voters,” the report warned. “For instance, ‘deepfakes’ (AI-generated images, voices, or videos) could be used to portray a candidate saying or doing things that never happened.”

The NewDEAL Forum report urges states to take several steps to respond to the threat, including requiring that certain kinds of AI-generated campaign material be clearly labeled; conducting role-playing exercises to help anticipate the problems that AI could cause; creating rapid-response systems for communicating with voters and the media, in order to knock down AI-generated disinformation; and educating the public ahead of time.

Secretaries of State Steve Simon of Minnesota, Jocelyn Benson of Michigan, Maggie Toulouse Oliver of New Mexico and Adrian Fontes of Arizona provided input for the report. All four are actively working to prepare their states on the issue.

Loopholes Seen

Despite the flurry of activity by lawmakers, officials, and outside experts, several of the measures examined in the Voting Rights Lab analysis appear to have weaknesses or loopholes that may raise questions about their ability to effectively protect voters from AI.

Most of the bills require that creators add a disclaimer to any AI-generated content, noting the use of AI, as the NewDEAL Forum report recommends.

But the new Wisconsin law, for instance, requires the disclaimer only for content created by campaigns, meaning deepfakes produced by outside groups but intended to influence an election — hardly an unlikely scenario — would be unaffected.

In addition, the measure is limited to content produced by generative AI, even though experts say other types of synthetic content that don’t use AI, like Photoshop and CGI — sometimes referred to as “cheap fakes” — can be just as effective at fooling viewers or listeners, and can be more easily produced.

For that reason, the NewDEAL Forum report recommends that state laws cover all synthetic content, not just that which use AI.

The Wisconsin, Utah, and Indiana laws also contain no criminal penalties — violations are punishable by a $1000 fine — raising questions about whether they will work as a deterrent.

The Arizona and Florida bills do include criminal penalties. But Arizona’s two bills apply only to digital impersonation of a candidate, meaning plenty of other forms of AI-generated deception — impersonating a news anchor reporting a story, for instance — would remain legal.

And one of the Arizona bills, as well as New Mexico’s law, applied only in the 90 days before an election, even though AI-generated content that appears before that window could potentially still affect the vote.

Experts say the shortcomings exist in large part because, since the threat is so new, states don’t yet have a clear sense of exactly what form it will take.