Researchers surveyed 136 U.S. prescribing clinicians on autonomous AI medication systems now authorized under federal bill H.R. 238 and Utah's pilot program, finding clinicians will reject full autonomy without three key architectural features: calibrated confidence scores for escalation, clear distinction between model uncertainty and clinical ambiguity, and transparent reasoning for liability purposes. The study argues that meeting these safety requirements transforms so-called autonomous systems into heavily supervised decision-support tools, effectively constraining what regulators can ethically permit.
Why it matters: As AI prescription authorization moves from pilot to policy, this clinician-backed research provides concrete technical and regulatory requirements that could shape how healthcare systems deploy autonomous agents while managing liability and maintaining human oversight.