Author: Timothy Powell, CPA, CHCP | November 11, 2026
Hospitals should treat artificial intelligence (AI) implementation as a change to an operating process, with a responsible manager and measurable results. For revenue-cycle leaders, success means accurate claims, defensible appeals, and appropriate collections after accounting for the full cost of the technology.
A federal analysis of hospital survey data found that, among hospitals using predictive AI, use for billing simplification or automation increased from 36 percent in 2023 to 61 percent in 2024. Those figures measure adoption, not proven savings, and concern predictive AI rather than generative AI alone.[1]
Start with the business problem
In KFF’s May 2026 interview, “AI at Scale: Does It Deliver?” HCA Healthcare’s Michael Schlosser emphasizes evaluating the outcomes produced by people working with AI. His account focuses on solving clinical and operational problems, involving users early, and monitoring performance after deployment.[2]
I would begin with one defined task, such as preparing appeal drafts for a particular denial category. Assign a revenue-cycle manager responsibility for the result, supported by compliance, information technology, and the employees doing the work. Record the current turnaround time, error rate, and cost before introducing the tool.
Test the entire workflow
A UW Health study of AI implementation in outpatient documentation, published in NEJM AI in 2025, offers a concrete warning. An audit of 797 encounters across 17 providers identified a note template change associated with the study’s measure of diagnosis documentation accuracy falling from 79 percent to 35 percent. Redesign and training restored accuracy to approximately 80 percent. The authors traced the problem to the surrounding electronic record workflow, outside the core AI process.[3]
For revenue-cycle departments, that experience supports testing the complete path from source record to final claim or appeal. A correct recommendation has limited value if a missing diagnosis, incorrect account match, or broken interface changes what reaches the payer.
For an appeal assistant, verify that the tool receives the actual denial reason, the relevant claim, and the documentation supporting the requested payment. Require it to identify its evidence. A persuasive letter containing an invented clinical fact or an unsupported coverage argument creates additional risk.
Run the initial pilot alongside the existing process. Have qualified employees review outputs against the medical record and applicable payer requirements before submission. Record corrections and investigate their causes. Retest whenever templates, data feeds, or the AI application change.
Include the people who will use it
Employees need time to practice, report errors, and learn when to escalate an uncertain result. Include difficult accounts in testing so the pilot reflects the department’s actual workload.
KFF’s April 2026 analysis of AI and health disparities emphasizes representative data and continued monitoring to address bias.[4] For a hospital, I would extend that principle to checking results across relevant patient groups, languages, service lines, and payer categories. An acceptable overall average can conceal recurring failures within a smaller group.
Before using patient information, establish approved data access, retention limits, vendor responsibilities, and a procedure for correcting errors. Give staff a clear route to pause a malfunctioning workflow.
Measure results after launch
The financial review should include integration, licenses, training, human review, and correction costs. Follow appeals through payment or final disposition; count legitimate collections and avoid treating every dollar identified by software as recoverable revenue.
Continue sampling completed work, including accounts the system handled without flagging a problem. Assign someone authority to suspend the tool when accuracy or controls deteriorate, and maintain a workable fallback process.
Expansion should follow demonstrated results from the pilot. Hospital leaders should be able to explain what improved, what it cost, and who remains accountable when the system makes a mistake.
Sources
Source links for editorial review. Checked November 3, 2026.
1. Chang W, Owusu-Mensah P, Everson J, Richwine C. Hospital Trends in the Use, Evaluation, and Governance of Predictive AI, 2023–2024. ASTP Data Brief No. 80. September 2025. Read the source
2. KFF. AI at Scale: Does It Deliver? The Business of Health with Chip Kahn. Interview with Michael Schlosser; published transcript. May 26, 2026. Read the source
3. Afshar M, et al. A Novel Playbook for Pragmatic Trial Operations to Monitor and Evaluate Ambient Artificial Intelligence in Clinical Practice. NEJM AI. doi:10.1056/aidbp2401267. August 28, 2025. Read the source
4. Pillai D, Artiga S, Ndugga N. The Growing Use of Artificial Intelligence in Health Care and Implications for Disparities. KFF. April 30, 2026. Read the source
This article was originally published on RACmonitor.