Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Class |
|---|---|
| University of Rochester | OTHER |
Not provided
Not provided
Not provided
This study evaluates a second review of ultrasound images of breast lesions using an interactive "deep learning" (or artificial intelligence) program developed by Samsung Medical Imaging, to see if this artificial intelligence will help the Radiologist make more accurate diagnoses.
Using ultrasound images prospectively acquired, the purpose of this study entails a second review of ultrasound images with suspicious breast lesions using an interactive "deep learning" (or artificial intelligence) program developed by SamsungMedison Co.,Ltd.
The images will be reviewed by the radiologists twice: first without, and then with assistance of artificial intelligence program by SamsungMedison Co., Ltd.
BIRADS system will be used in this study.
The objectives of the study are twofold: to quantify the statistical equivalence of radiologists' opinion and AI's output (CADe), and to check BIRADS score-based diagnostic accuracy (CADx) that is gained by the Radiologists' use of this interactive tool
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| Manual review | Active Comparator | The images will be reviewed by the radiologists using BIRADS scheme without any assistance of artificial assistance. This review will be done off-line using a separate program in entirely manual mode. During this review, BIRADS descriptor choices by each radiologist and the time it takes for the radiologist to make such decision will be stored. Radiologists also make assessment decision without any intervention from artificial intelligence. 10 radiologists review manually. |
|
| Review by S-Detect for Breast | Experimental | The same images will be separately processed by the artificial intelligence system (S-Detect for Breast) by Samsung. The two results, one by the radiologists and the other by artificial intelligence system, will be compared to statistically quantify equivalence (CADe). |
|
| Review with assistance of S-Detect for Breast | Experimental | Second, the images will be reviewed by the radiologists with the help of artificial intelligence system, which is an interactive tool automatically providing recommendations on BIRADS descriptor choices that can be modified by the radiologists. The radiologists, after selecting all the descriptors of BIRADS, will decide the assessment categories. These decisions will be compared with the ground truths generated from the biopsy results or a 24-month follow-up (CADx). |
|
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| Ultrasound Image review with CADe | Device | This software is a computer-aided detection (CADe) software application, designed to assist radiologist to analyze breast ultrasound images. S-Detect automatically segments and classifies shape, orientation, margin, lesion boundary, echo pattern, and posterior feature characteristics of user-selected region of interest. The device uses deep learning methods to perform tissue segmentation and classification of images. |
| Measure | Description | Time Frame |
|---|---|---|
| Concordance rate | Breast Imaging Reporting and Data System descriptors suggested by S-Detect for Breast are in good agreement with those selected by experts. In other words, the Breast Imaging Reporting and Data System Lexicon values generated by S-Detect for Breast are not statistically different from the consensus of experts. Breast Imaging Reporting and Data System Assessment Category Score: The user makes the final decision on the Assessment Category Score. Using this Score, S-Detect displays the assessment description. Category 0: Incomplete - Need Additional Imaging Evaluation Category 1: Negative Category 2: Benign Category 3: Probably Benign Category 4a: Low suspicion for malignancy Category 4b: Moderate suspicion for malignancy Category 4c: High suspicion for Malignancy Category 5: Highly Suggestive of Malignancy Category 6: Known Biopsy-Proven Malignancy | 2 days |
| Measure | Description | Time Frame |
|---|---|---|
| Reporting time | Measure reporting time of Breast Imaging Reporting and Data System Lexicon value in Breast imaging by radiologists without S-Detect for Breast and also measured report time by radiologists with S-Detect for Breast. | 2 day |
| Consensus |
Not provided
Inclusion Criteria:
Exclusion Criteria:
Subject Characteristics
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Affiliation | Role |
|---|---|---|
| Avice O'Connell | Department of Imaging Sciences, University of Rochester | Principal Investigator |
| Kevin Parker | Department of Electrical & Computer Engineering, University of Rochester | Principal Investigator |
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| University of Rochester | Rochester | New York | 14642 | United States |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| ID | Term |
|---|---|
| D001943 | Breast Neoplasms |
| ID | Term |
|---|---|
| D009371 | Neoplasms by Site |
| D009369 | Neoplasms |
| D001941 | Breast Diseases |
| D012871 | Skin Diseases |
Not provided
Not provided
| ID | Term |
|---|---|
| D001706 | Biopsy |
| ID | Term |
|---|---|
| D003581 | Cytodiagnosis |
| D003584 | Cytological Techniques |
| D019411 | Clinical Laboratory Techniques |
| D019937 | Diagnostic Techniques and Procedures |
Not provided
Not provided
This clinical study performed by multiple reader multiple case (MRMC) study design, where as set of clinical readers evaulate under multiple reading condition. All Interpreting physician(reader) independently read all of the cases. (fully-crossed design).
Not provided
Not provided
The study consisted of 10 readers with varying levels of training and experience providing analysis on a randomized set of 300 patients' breast ultrasound data with and without S-Detect for Breast. Two reading periods separated by at least 3-week washout, totaling 600 cases analyzed per reader. PI and her associate have knowledge about patients diagnosis and other information. So, they are exclueded in readers for "reviewing". And all breast US images are de-indentified.
|
|
| Ultrasound Image review with CADx | Device | This software is also a computer-assisted diagnostic(CADx) software application, designed to assist a medical doctor in determining diagnosis by presenting whether a lesion is malignant in a breast ultrasound image obtained from an ultrasound imaging device. |
|
|
| Ultrasound Image manual review | Device | The images will be reviewed by the radiologists using BIRADS scheme without any assistance of artificial assistance. This review will be done off-line using a separate program in entirely manual mode. During this review, BIRADS descriptor choices by each radiologist and the time it takes for the radiologist to make such decision will be stored. |
|
|
| Biopsy | Procedure | Suspicious lesions found on breast ultrasound are then followed either by ultrasound guided biopsy or ultrasound imaging every 6 months for two years. For those who undergo biopsy, ultrasound provides images which are used to localize the lesion and guide the placement of the biopsy needle. The sample is sent to pathology for diagnosis, while the ultrasound guidance images are stored. For those who have imaging follow-up, ultrasound images of the breast mass are obtained, digitally stored and interpreted by the radiologist typically using BIRADS scheme. |
|
Evaluate the consensus between manually reading of Breast Imaging without assistance and Automatically detection results(Breast Imaging Reporting and Data System Lexicons). Average of consensus is evaluated in both of Expert group and non-expert group.
| 2 day |
| Accuracy | Comparing to the Breast Biopsy results, The accuracy of Breast Imaging results by radiologists with CADx will be evaluated. | 7 day |
| Sensitivity | Comparing to the Breast Biopsy results, The sensitivity of Breast Imaging results by radiologists with CADx will be evaluated. | 7 day |
| Specificity | Comparing to the Breast Biopsy results, The specificity of Breast Imaging results by radiologists with CADx will be evaluated. | 7 day |
| Area Under Curve | Comparing to the Breast Biopsy results, Area Under Curve (ROC analysis) of Breast Imaging results by radiologists with CADx will be evaluated. | 7 day |
| D017437 |
| Skin and Connective Tissue Diseases |
| D003933 | Diagnosis |
| D013048 | Specimen Handling |
| D003949 | Diagnostic Techniques, Surgical |
| D013514 | Surgical Procedures, Operative |
| D008919 | Investigative Techniques |