SHEBOYGAN FALLS, WI — An attempted artificial-intelligence voice-cloning scam targeting 78-year-old Marlene Doerfler collapsed Tuesday afternoon when her Charter Spectrum service went out at 2:47 p.m., approximately ninety seconds before she would have read her routing number aloud to a man pretending to be her grandson Travis.
According to the Sheboygan County Sheriff’s Department, the caller used an AI-generated replica of Travis Doerfler’s voice to report that he had been arrested outside a Walgreens in Madison and needed $14,200 in bail money wired to a bondsman within the hour. Mrs. Doerfler, a retired dental hygienist who has lived on Giddings Avenue since 1973, said the voice was “basically him,” though she had noted some concerns.
“I thought Travis sounded a little nasal,” she said Wednesday from her kitchen, where a landline phone sat on a doily that has been there longer than the area code. “But he gets that way in March. I was going to ask about it after I helped him.”
The Spectrum outage, which affected roughly 1,400 customers in the Falls and a portion of Kohler, was caused by a contractor striking a buried line near the Pick ‘n Save. Charter restored service at 4:18 p.m. By 4:19 p.m., Mrs. Doerfler’s actual grandson Travis, age 31, had called her from his desk at a logistics firm in Brookfield to ask why his mother was sobbing.
Sgt. Daryl Vanevenhoven of the sheriff’s department said the office has logged eleven similar AI-voice attempts in the county since January, three of them successful, and that Tuesday’s case is believed to be the first prevented by infrastructure failure. “We’ve been doing community education seminars,” he said. “We’ve also been doing them in rooms where the projector doesn’t work. It’s possible those are related.”
A Charter Spectrum spokesperson, reached by email, said the company “regrets any inconvenience caused by Tuesday’s service interruption” and did not respond to a follow-up question asking whether the company would like to take credit for preventing a federal wire fraud.
Mrs. Doerfler’s neighbor, Lorraine Buetow, said she had warned Marlene about the scams at least twice, once at coffee hour at St. Paul’s and once in the parking lot of the Festival Foods, but acknowledged that her own husband Ron had been taken for $3,800 in November by someone claiming to be a Microsoft technician. “Ron isn’t on the computer,” Lorraine clarified. “That’s what made it work.”
Travis Doerfler, the real one, has since driven up from Brookfield and spent Wednesday evening trying to explain to his grandmother the difference between his voice and a synthetic facsimile of his voice, a conversation he described afterward as “the longest forty minutes of my adult life.” Mrs. Doerfler has agreed, going forward, to ask any caller claiming to be Travis what she put in his Christmas card in 1998, a piece of information Travis confirmed he does not remember either.
As of Thursday morning, Mrs. Doerfler said she remains grateful but unsettled. She has canceled her Spectrum upgrade appointment, citing a newfound appreciation for the service she already has, and has begun answering the phone with the words “prove it.”