Physician Response Evaluation With Contextual Insights vs. Standard Engines - Artificial Intelligence RAG vs LLM Clinical Decision Support

Clinical decision support tools powered by artificial intelligence (AI) are being rapidly integrated into medical practice. Two leading systems currently available to clinicians are OpenEvidence, which uses retrieval-augmented generation to access medical literature, and GPT-4, a large language model. While both tools show promise, their relative effectiveness in supporting clinical decision-making has not been directly compared. This study aims to evaluate how these tools influence diagnostic reasoning and management decisions among internal medicine physicians.

NCT Number	NCT07037940
Lead Sponsor	Montefiore Medical Center Collaborators: Beth Israel Deaconess Medical Center
Conditions	Large Language Models
Enrollment	41 participants
Start Date	2025-07-03
Primary Completion	2025-12-30 (estimated)
Study Completion	2025-12-30 (estimated)
Updated on ClinicalTrials.gov	2026-08-11