Search arXiv⌕ Search
Home/Archive/arXiv

arXiv · 2407.11205

Impact on clinical guideline adherence of Orient-COVID, a CDSS based on dynamic medical decision trees for COVID19 management: a randomized simulation trial

Mouin Jammal·Antoine Saab·Cynthia Abi Khalil·Charbel Mourad·Rosy Tsopra·Melody Saikali·Jean-Baptiste Lamy
View original source ↗Read source document ↗Export metadata ↓

Abstract

Background: The adherence of clinicians to clinical practice guidelines is known to be low, including for the management of COVID-19, due to their difficult use at the point of care and their complexity. Clinical decision support systems have been proposed to implement guidelines and improve adherence. One approach is to permit the navigation inside the recommendations, presented as a decision tree, but the size of the tree often limits this approach and may cause erroneous navigation, especially when it does not fit in a single screen. Methods: We proposed an innovative visual interface to allow clinicians easily navigating inside decision trees for the management of COVID-19 patients. It associates a multi-path tree model with the use of the fisheye visual technique, allowing the visualization of large decision trees in a single screen. To evaluate the impact of this tool on guideline adherence, we conducted a randomized controlled trial in a near-real simulation setting, comparing the decisions taken by medical students using Orient-COVID with those taken with paper guidelines or without guidance, when performing on six realistic clinical cases. Results: The results show that paper guidelines had no impact (p=0.97), while Orient-COVID significantly improved the guideline adherence compared to both other groups (p<0.0003). A significant impact of Orient-COVID was identified on several key points during the management of COVID-19: ordering troponin lab tests, prescribing anticoagulant and oxygen therapy. A multifactor analysis showed no difference between male and female participants. Conclusions: The use of an interactive decision tree for the management of COVID-19 significantly improved the clinician adherence to guidelines. Future works will focus on the integration of the system to electronic health records and on the adaptation of the system to other clinical conditions.

Explore related subjects

cs.HCcs.AIcs.CY

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Mouin Jammal, Antoine Saab, Cynthia Abi Khalil, Charbel Mourad, Rosy Tsopra, Melody Saikali, Jean-Baptiste Lamy. 2024-06-21. Impact on clinical guideline adherence of Orient-COVID, a CDSS based on dynamic medical decision trees for COVID19 management: a randomized simulation trial. https://arxiv.org/abs/2407.11205

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Explanation Navigator: Rectifying Out-of-Scope Human Interpretations of Leaky AI Explanations through Conversational Guidance

As explanations of artificial intelligence systems proliferate, their recipients must grasp not only what they convey but also recognise what they cannot. We conducted an interview study with nine participants to examine how explainees reason when their information needs exceed the scope of available explanations. Participants often unwittingly confabulated explanatory insights when relevant information was missing from the explanations, not recognising the inherent limitations thereof. We characterise such explanations as leaky explanations -- simplifications that strive to hide complexity yet whose correct interpretation hinges on understanding of the concealed details. To address out-of-scope interpretations we propose Explanation Navigator: a conversational interaction framework that detects mismatches between users' information needs and explanations' content, elucidating pertinent yet implicit details and providing complementary explanations for unmet information needs. An online study with 316 participants showed that our approach allowed explainees to recognise and rectify confabulated explanatory insights, guiding them towards developing correct understanding.

cs.HC↗
arXiv2026

Biased AI improves human performance but reduces perceived helpfulness

Artificial intelligence (AI) increasingly shapes how people think, engage, and evaluate information. To minimize risk, most current systems are designed to present as ideologically neutral with standardized output. Yet growing evidence suggests that these principles suppress cognitive engagement, impair human decision-making, and erode societal diversity. Here we test the opposite approach by deliberately injecting bias into AI assistants. In three randomized experiments with 5,000 participants, biased AI improved human performance relative to default and neutral AI in tasks ranging from misinformation evaluation and financial investment to graduate education. These gains carried a subjective cost. Participants systematically undervalued AI they believed to be biased and inflated the helpfulness of AI they believed to be neutral, regardless of the systems' actual behavior. Interacting with two AIs whose biases flanked the participant's own perspective preserved the performance gains while limiting the subjective cost and one-sided influence. Our findings reveal the strategic value of intentional bias in AI design. Rather than performing a single fair, reliable, and authoritative voice, AI that speaks from specific viewpoints triggers cognitive agency and elevates human-AI performance in judgment, decision-making, and problem-solving.

cs.HC↗
arXiv2026

Learning Password Best Practices Through In-Task Instruction

Users often make security- and privacy-relevant decisions without a clear understanding of the rules that govern safe behavior. We introduce pedagogical friction, a design approach that inserts brief, instructional interactions at the moment of action. We evaluate this approach in the context of password creation, a familiar task with clear quality criteria. We conducted a randomized study with 128 participants across four interface conditions that varied the depth and interactivity of guidance. We assessed three outcomes: (1) rule compliance in a subsequent password task without guidance, (2) accuracy on survey questions tied to password rules, and (3) behavior-knowledge alignment, which captures whether participants who correctly followed a rule also recognized it on the survey. Across the guided conditions, participants corrected most rule violations in the follow-up task and showed high behavior-knowledge alignment. Survey results suggested clearer advantages for some rule types, especially symbol related questions. These results position pedagogical friction as a lightweight intervention for security- and privacy-critical interfaces.

cs.HC↗