The rapid advancement of artificial intelligence (AI) has expanded its applications in healthcare, particularly in diagnostic assistance, intelligent triage, and patient interaction. Hepatobiliary and pancreatic diseases (such as liver cancer, pancreatic cancer, cirrhosis) are characterized by insidious onset, rapid progression, low early-diagnosis rates, and poor prognosis. However, grassroots medical institutions in China face challenges including physician shortages, variable patient health literacy, and incomplete initial information collection, leading to high misdiagnosis/missed diagnosis risks.
Recent breakthroughs in large language models (LLMs) and multi-agent systems (MAS) offer new solutions. LLMs enable advanced natural language processing, while MAS coordinates specialized agents for complex decision-making. Integrating MAS with medical LLMs could create intelligent pre-consultation systems that systematically collect patient symptoms, risk factors, family history, and lifestyle data to enhance diagnostic efficiency.
This study aims to develop a MAS-based pre-consultation system for hepatobiliary-pancreatic diseases featuring four specialized agents ("guidance agent," "medical history agent," "risk assessment agent," and "summary generation agent"). The system will simulate clinical reasoning to generate structured diagnostic reports for physicians.
Research Objectives:
Develop a specialized multi-agent framework combining LLMs to simulate clinical diagnostic logic and standardize symptom collection Enhance pre-consultation data integrity through intelligent dialogue focusing on key disease indicators Generate structured diagnostic summaries highlighting critical symptoms and risk factors Establish foundation for clinical validation and application through expert evaluation and user feedback This pre-diagnostic tool will assist physicians rather than replace clinical judgment, promoting safe, effective AI applications in early disease screening and tiered healthcare systems.
Inclusion Criteria:
Exclusion Criteria:
dingyuan@zju.edu.cn18858101960
Patients in this group will first complete a full interaction with the multi-agent system described above until the Arbiter confirms the medical record is error-free. The system will then generate a structured "Case Characteristics" summary and an initial diagnostic recommendation produced by the Oracle. However, this complete AI-generated output will not be displayed to the subsequent attending physician. The physician will then conduct an independent routine consultation following standard clinical protocols. The medical records generated by the physician are solely for maintaining the integrity of clinical workflows and will not be used as evaluation metrics for this study. The core assessment objective for this group is to evaluate the concordance between the AI-generated final medical records and the predefined gold standard.
Patients in this group will complete the interaction with the multi-agent system and confirm the final "Case Characteristics" (CC). The system will then push this structured CC summary (excluding the Oracle's diagnostic recommendations to avoid excessive guidance) to the attending physician's electronic workstation in a standardized format. Prior to the formal consultation, physicians may refer to this summary to adjust their interview priorities, verify information accuracy, or supplement missing details. The medical records written by the physicians will serve as the primary evaluation metrics for this group.
This group will exclude AI intervention entirely. Physicians will independently complete the consultation and documentation from scratch, serving as the baseline reference for evaluating AI system performance.
AI Multimodal Model for Liver Cancer Diagnosis and Prognosis
Development of an AI-Agent for Urological Disease Diagnosis and Treatment
Interventional AI-Human Collaboration for Liver Tumor Diagnosis
AI-Powered Precision Decision-Making for Pancreatic Diseases
Research on Construction and Verification of Multimodal Medical Imaging Large Model
AI-assisted Rare Disease Diagnosis
AI-Assisted Pathologist Performance Improvement: A Multicenter, Prospective, Randomized Controlled Trial
AI-powered Early Detection for Pancreatic Cancer Via Non-contrast CT in Opportunistic Screening Cohort