Multi-modal Intelligent Diagnosis System for Multiple Ophthalmic Diseases

Research on Key Technologies of Intelligent Auxiliary Diagnosis for Multiple Eye Diseases Based on Multimodal Ultra-High-Speed SS-OCT/OCTA

Aiming at the problems of low image reading efficiency, crowded medical resources and fragmented cross-modal information of ophthalmic OCT and OCTA, a multimodal large model diagnostic framework for various diseases such as retinal diseases and optic nerve damage in glaucoma is constructed to fully explore the complementary information of various images such as SS-OCT structural images, SS-OCTA vascular images and optic nerve scans. Extract cross-modal joint features to improve the accuracy of automatic diagnosis.

Inclusion Criteria:

• Diagnosed as macular degeneration, diabetic macular edema, retinal vein obstructive macular edema, high myopia, glaucoma or other clearly diagnosed ophthalmic diseases. The SS-OCT/SS-OCTA images of the patient are clear.

Exclusion Criteria:

• The image quality is poor and difficult to analyze due to reasons such as refractive media opacity and poor coordination.