Deep Learning for Fluorescein Angiography and Optical Coherence Tomography Macular Thickness Map Image Translation

Bridging the Resources Gap: Deep Learning for Fluorescein Angiography and Optical Coherence Tomography Macular Thickness Map Image Translation

Diabetic macular edema (DME) is one of the leading causes of visual impairment in patients with diabetes. Fluorescein angiography (FA) plays an important role in diabetic retinopathy (DR) staging and evaluation of retinal vasculature. However, FA is an invasive technique and does not permit the precise visualization of the retinal vasculature. Optical coherence tomography (OCT) is a non-invasive technique that has become popular in diagnosing and monitoring DR and its laser, medical, and surgical treatment. It provides a quantitative assessment of retinal thickness and location of edema in the macula. Automated OCT retinal thickness maps are routinely used in monitoring DME and its response to treatment. However, standard OCT provides only structural information and therefore does not delineate blood flow within the retinal vasculature. By combining the physiological information in FA with the structural information in the OCT, zones of leakage can be correlated to structural changes in the retina for better evaluation and monitoring of the response of DME to different treatment modalities. The occasional unavailability of either imaging modality may impair decision-making during the follow-up of patients with DME.

The problem of medical data generation particularly images has been of great interest, and as such, it has been deeply studied in recent years especially with the advent of deep convolutional neural networks(DCNN), which are progressively becoming the standard approach in most machine learning tasks such as pattern recognition and image classification. Generative adversarial networks (GANs) are neural network models in which a generation and a discrimination networks are trained simultaneously. Integrated network performance effectively generates new plausible image samples.

The aim of this work is to assess the efficacy of a GAN implementing pix2pix image translation for original FA to synthetic OCT color-coded macular thickness map image translation and the reverse (from original OCT color-coded macular thickness map to synthetic FA image translation).

Inclusion Criteria:

• Patients from the retina clinic in Assiut University Hospital who had simultaneously undergone same-day FA and OCT with a diagnosis of confirmed or suspected DME.

Exclusion Criteria:

• Significant media opacity that obscured the view of the fundus
• OCT images with high signal-to-noise ratio expressed by the device as"TopQ image quality," below 60
• Vitreoretinal interface disease distorting the OCT thickness map.
• Patients with concurrent ocular conditions interfering with blood flow
• Patients with uveitic diseases
• High myopia of more than -8.0 diopters.