AI-generated clip used to frame high school principal with racist remarks,police say

Baltimore:A high school athletic director in Maryland has been charged with usingartificial intelligence to impersonate a principal on an audio recording that included racist and antisemitic comments,authorities said.

Dazhon Darien faked the voice of Pikesville High School’s principal in January following conversations that Darien’s contract would not be renewed,according to charging documents filed by Baltimore County police.

Pikesville High School in Maryland.

Pikesville High School in Maryland.Supplied

The principal had expressed concerns over Darien’s work performance,including a theft investigation involving allegations that Darien had paid his roommate using school funds,police said.

Using cloning technology,Darien forged an audio clip in which it sounded as if the principal was frustrated with black students and their test-taking abilities,police wrote. The recording also purported to capture the principal disparaging Jewish individuals and two teachers who “should never have been hired”.

The audio clip quickly spread on social media and had “profound repercussions,” the court documents stated,with the principal being placed on leave.

The recording also triggered a wave of hate-filled messages on social media and an inundation of phone calls to the high school’s front office,police said. School activities were disrupted for a time,and some staff felt unsafe.

Darien,31,faces charges that include theft,disrupting school activities,stalking and retaliating against a witness,according to court documents.

Online court records for Darien,filed on Thursday US time,do not list a lawyer who might be able to speak on his behalf. Authorities said he’s being held in a local jail on $US5000 ($7600) bond.

Scott Shellenberger,the Baltimore County state’s attorney,said the case appears to be one of the first of its kind nationwide that his office was able to find. He said Maryland’s Legislature may need to update state laws to catch up with the nefarious possibilities of the new technology.

For example,the charge of disrupting school activities “only carries a six-month sentence,” Shellenberger said.

“But we also need to take a broader look at how this technology can be used and abused to harm other people,” the prosecutor said.

Baltimore County detectives had asked experts to analyse the recording,according to the charges against Darien.

A professor from the University of Colorado-Denver told police that the audio file “contained traces of AI-generated content with human editing after the fact,which added background noises for realism,” court records stated.

A second opinion from a professor at the University of California-Berkley told police that “multiple recordings were spliced together using unknown software,” according to the records.

A Baltimore County detective found that Darien had used Large Language Models,such as OpenAI and Bingchat,which can “create or produce results that tell users what steps to take to create synthetic media,” court documents stated.

Darien was arrested on Wednesday evening as he was attempting to board a flight at Baltimore/Washington International Thurgood Marshall Airport,Baltimore County Police Chief Robert McCullough said. Darien was stopped because of how he had packaged his firearm for the flight,leading officers to learn he had a warrant for his arrest,according to McCullough.

McCullough said authorities had entered the warrant for Darien’s arrest into the system on Wednesday night and planned to serve it Thursday morning. The chief said he didn’t know why Darien was catching a flight to Houston and did not suggest that he was trying to escape.

“He could have been simply going there for other purposes,” the chief said.

AP

Get a note directly from our foreigncorrespondentson what’s making headlines around the world.Sign up for the weekly What in the World newsletter here.

Most Viewed in World