When pediatrician Jocelyn Wilson sees patients at Atrium Health Levine Children鈥檚 Charlotte Pediatrics, she begins each visit with a simple request: for permission to record the conversation.
The reason isn鈥檛 surveillance 鈥� it鈥檚 efficiency.
Like a growing number of doctors, Wilson uses an artificial intelligence tool that listens to her conversations with patients. It then transforms them into a clinical visit summary that she can review, edit and upload to a patient鈥檚 medical record in just a few minutes.
The goal? To allow doctors to spend less time doing paperwork and more time caring for patients.
鈥淚've never really liked using the computer very much when I'm in the exam room 鈥� I just feel like I'm not very present,鈥� Wilson said. 鈥淣ow, I don't have to be writing anything down. I can make direct eye contact.鈥�
She said the AI tool, known as , is saving her more than an hour a day entering appointment details into patient medical records.
While health care systems are using AI in a variety of ways to reshape care behind the scenes, these 鈥渧irtual scribe鈥� tools are some of the most visible to patients 鈥� they bring AI directly into the exam room.
More than 1,500 Atrium Health doctors are licensed to use DAX Copilot, according to an Atrium spokeswoman. At least three other North Carolina systems 鈥� Novant Health, UNC Health and Duke Health 鈥� are using similar technology.
The platforms are similar to the AI tools that many other industries 鈥� from finance to marketing 鈥� have adopted to streamline tasks like note taking and summarizing information.
AI tools aren't perfectThe AI assistants are not perfect, however, and health care providers are grappling with some of the same challenges experienced in other industries.
Research has shown that voice recognition programs don鈥檛 always understand people in racial minorities, people who speak English as a second language and people with speech disabilities. The tools can also misinterpret information or even fabricate responses 鈥� a phenomenon called hallucination 鈥� underscoring the need for doctors to review the summaries.
A sign posted at Providence Pediatrics in Charlotte notifies patients about its use of AI. 鈥淚t's imperative to have a human in the loop to make sure that we鈥檙e properly evaluating these tools and making sure they are working for all different types of patients and doctors,鈥� said Allison Koenecke, an assistant professor of information science at Cornell University, whose research uncovered problems with AI-generated medical notes.
Health care systems also need to address patient concerns about privacy and ensure that patients are told how the software works so they can make informed decisions about whether to participate.
What patients can expectAtrium was the first health system in the country to test DAX Copilot 鈥� short for Dragon Ambient eXperience Copilot 鈥� a platform developed by Microsoft subsidiary . The software installs a secure app on doctors鈥� smartphones that does the recording.
Wilson piloted an early version, which she described as 鈥渟omewhat clunky.鈥� But the latest iteration, she said, is incredibly accurate, and she has been using it consistently for the past few months.
Here鈥檚 how it works: Before Wilson walks into the room, she records a brief note about the patient and the reason for the visit.
Once inside, she introduces herself and explains the process, saying something like, 鈥淚 have my phone with me today because it's helping me write my notes at the end of the day. If you're OK with that, it'll just sit here and listen to our conversation.鈥�
So far, she said, no patient has declined.
Wilson then sets her phone down on the counter and doesn鈥檛 touch it again until she leaves and stops the recording. Within minutes, the software sends a visit summary to her computer for her to review and edit.
A cure for physician burnout?In a perfect world, Wilson said, doctors would have time between appointments to update their notes while the details are fresh in their memories.
鈥淏ut the reality is, sometimes you鈥檙e in a patient room longer than expected, and there are two or three more patients waiting to be seen,鈥� Wilson said. 鈥淎nd when you鈥檙e five or six patients in and haven鈥檛 started any of (your notes), that internal pressure starts to build. You鈥檙e anxious you鈥檒l forget something, stressed about how long it鈥檚 going to take to catch up.鈥�
Wilson said DAX Copilot has drastically reduced the stress of unfinished notes. Instead of staring at a blank screen, she now has a draft summary waiting for her.
鈥淚t鈥檚 a lot easier to edit a note than it is to start a note,鈥� Wilson said.
Since she started using the technology, she said she has more time for lunch breaks and for exercising or cooking a meal in the evenings, rather than 鈥渨riting notes right until it鈥檚 time to go to bed,鈥� she said.
When the clinic is busy, DAX Copilot also allows her to squeeze more patients into her day, she said.
Burnout has become a crisis among physicians nationwide, with symptoms in 2023, and a major culprit is the increasing burden of documentation. A found that doctors spend one to two hours outside of the office writing up required notes from patient visits, cutting into personal and family time.
found that 47 percent of Atrium Health physicians using DAX Copilot reported a significant reduction in time spent doing documentation at home.
Eric Poon, chief health information officer at Duke Medicine, was also an early tester of the DAX Copilot technology in his primary care practice.
After years of running late for appointments, he said the tool has significantly improved his efficiency.
鈥淪ince I started using the technology about a year ago, I could actually step back from the keyboard and not take telegraphic notes as I talked to the patient, and I realized that I was able to have much closer conversations with patients in a natural way,鈥� he said. 鈥淎nd then guess what? I find that I'm now finishing clinic on time for the first time in my clinical life.鈥�
So far, Poon said, about 50 Duke physicians have been trained on DAX Copilot.
Privacy and accuracy concernsAbout 70 percent of patients nationally are comfortable with physicians using AI in appointments, according to a. However, patients do have some reservations, the poll found, with just over half saying health care AI is 鈥渁 little scary鈥� and 70 percent expressing concerns about data privacy.
At a time when any phone or computer can be hacked, some patients worry about where a recording could end up. Atrium says the DAX Copilot app on physicians鈥� phones is accessible only through biometrics or password authentication, and recordings disappear after doctors approve the associated AI-generated clinical note.
When it comes to accuracy, it鈥檚 important for doctors like Wilson to carefully review the AI-generated content to ensure that it鈥檚 correct, Koenecke said.
Her research into one Microsoft speech-to-text tool revealed error rates twice as high for Black speakers as for white speakers. And when investigating a non-Microsoft model, she found instances where the technology omitted facts or fabricated content. In one case, for example, it invented a nonexistent medication called 鈥渉yperactivated antibiotics.鈥�
As with many AI technologies, the success of these virtual scribes will likely depend largely on how they are implemented, Koenecke said. Will they be used to reduce the burden on physicians, with adequate time for screening and review? Or will hospitals deploy them to push physicians to see more patients and increase revenue?
Without adequate oversight, she said, the AI assistants could 鈥渓ead to really massive downstream harms, especially for certain groups whose speech isn鈥檛 well captured by these tools,鈥� Koenecke said. 鈥淗ow can we make sure these workers who are already overworked aren鈥檛 just skimming through and clicking 鈥極K鈥�?鈥�
NC Health 瓜神app reporter Emily Vespa contributed to this report.
This article is part of a partnership between The Charlotte Ledger and North Carolina Health 瓜神app to produce .
This first appeared on and is republished here under a Creative Commons license.
North Carolina Health 瓜神app is an independent, non-partisan, not-for-profit, statewide news organization dedicated to covering all things health care in North Carolina. Visit NCHN at northcarolinahealthnews.org.
