Not provided
Not provided
| ID | Type | Description | Link |
|---|---|---|---|
| Softview 2.0.1 | Other Grant/Funding Number | Riverain Medical Group | |
| OnGuard 5.0 | Other Grant/Funding Number | Riverain Medical Group |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Class |
|---|---|
| Riverain Technologies | INDUSTRY |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
This is a clinical trial using retrospective data of two different software devices developed by Riverain Medical Group: Softview and OnGuard 5.0. The two studies will be run concurrently. Riverain Medical Group's computer systems are designed to assist radiologists in their identification of lung cancer on chest radiographs. The current machine received FDA Pre-Market Approval. This is to test two new software approaches.
In 2000, data was presented to the FDA to demonstrate that a new system for computer analysis could assist radiologists in the detection of small lung cancers on chest radiographs. Radiologists using the system showed a statistically significant improvement in lung cancer detection rate when they used the system, compared to their interpretation of chest radiographs when they did not use the computer system. This study, along with other supporting data, resulted in the FDA giving Pre-Market Approval for the system.
The system has undergone several improvements in software and hardware, and it is now intended to test two different software systems to determine whether radiologists using the systems can improve their detection of lung cancer on chest radiographs.
One of these systems processes the chest radiograph to decrease the emphasis given to the shadow of the ribs and thereby enhances the ability of radiologists to detect disease in the lungs. The second system performs a series of evaluations on chest radiographs and, based on a complex system of analysis, points to locations on the chest radiograph that contain solitary pulmonary nodules having the characteristics of primary lung cancer or solitary metastases of cancer to the lungs.
This will be a test of radiologists to determine the degree of improvement, if any, that results when they interpret chest radiographs that may or may not have cancer, first interpreted without the computer and, second, with the images output by the software.
Not provided
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| Radiologists | Radiologists who have certification by the American Board of Radiology |
|
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| Software | Behavioral | This is an observer performance study. Radiologists will interpret chest radiographs without and then with the Riverain software, both SoftView (TM) OnGuard (TM) CADe Software with be tested |
| Measure | Description | Time Frame |
|---|---|---|
| Improvement in Cancer Detection as Measured by Localized Receiver Operating Characteristic) LROC Changes Under the LROC Curve. | Standard methods for LROC methodology and statistical analysis were used. We are testing two different types of software using different cases, but the same radiologists to control for radiologist differences. LROC is Localized Receiver Operating Characteristic. LROC measures the trade-offs between sensitivity and specificity as radiologists use different levels of suspicion of disease. This analysis is for the software that decreases the visibility of the ribs and clavicles while preserving (and potentially enhancing) the visibility of the lungs and lung diseases. In this case, the level of suspicion recorded was for the radiologist's concern that a finding did or did not represent cancer. Please note that the FDA approved indications for use is to detected nodules that may represent cancer, but in our study scoring for a true finding was based on whether or not the nodule did represent cancer. A larger number, if statistically significant, indicates that that method is better. | Three days of experiment over 3-5 months, varied by participant |
| Measure | Description | Time Frame |
|---|---|---|
| Sensitivity and Specificity Using SoftView Software | Sensitivity and specificity were calculated using the radiologists' responses of recommendations for follow-up with CT or biopsy. Truth was whether or not the nodule identified was found to be cancer. Sensitivity is the percentage of correct identification of a positive case (a case with cancer). Specificity is the percentage of negative cases (those without cancer) that were correctly identified as not having cancer. The mean values of 15 radiologists are used. |
| Measure | Description | Time Frame |
|---|---|---|
| Difference in the Area Under the LROC Curve Comparing OnGuard 1.0 and OnGuard 5.1 | This reports the comparison of the detection of lung nodules that were proven to represent lung cancers. It compares the results of two versions of computer-aided detection software: OnGuard 1.0 from 2001 and OnGuard 5.1 from 2009. The results represent the responses of radiologists when they use one or the other types of software. To compare radiologists' results with the two types of software, the measurement analyzed was the difference in the areas under the localized receiver operating characteristic curve (LROC). The results from the 15 participating radiologists were averaged (mean value). The area under the LROC curve is a measure of the trade-offs between sensitivity and 1-specificity that occurs as the level of certainty of a positive finding changes. It is normally reported as a decimal without units. In this study dsign, a lower number indicates that the new method (OnGuard 5.1), if statistically significant, if better. |
Inclusion Criteria:
Exclusion Criteria:
Not provided
Not provided
Not provided
Not provided
Radiologists in active clinical practice who are not subspecialists in chest radiology
Not provided
| Name | Affiliation | Role |
|---|---|---|
| Matthew T. Freedman, MD, MBA | Georgetown University | Principal Investigator |
| Ben Lo, Ph.D. | Georgetown University | Study Director |
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| ISIS Imaging Science Research Center, Georgetown University | Washington D.C. | District of Columbia | 20057 | United States |
| PubMed Identifier | Type | Citation | Retractions |
|---|---|---|---|
| 21493789 | Derived | Freedman MT, Lo SC, Seibel JC, Bromley CM. Lung nodules: improved detection with software that suppresses the rib and clavicle on chest radiographs. Radiology. 2011 Jul;260(1):265-73. doi: 10.1148/radiol.11100153. Epub 2011 Apr 14. |
Not provided
Not provided
All recruited individuals met entry criteria. None were excluded or dropped from the study. Training in the use of studied device (software) occurred immediately prior to the experiment. Training took 55 to 80 minutes, depending on the individuals speed. Each individual served as his/her own control, so all participants were in both groups
Recruitment between April 9, 2009 and June 15, 2009. Recruited by email and phone calls to individuals meeting entry criteria specified in the protocl.
Not provided
| ID | Title | Description |
|---|---|---|
| FG000 | Radiologists | Radiologists who have certification by the American Board of Radiology Riverain OnGuard and SoftView Software : This is an observer performance study. Radiologists will interpret chest radiographs without and then with the Riverain software, Two types of software are tested: SoftView (TM). SoftView decreases the visibility of the ribs and clavicles on chest radiographs. OnGuard marks locations on chest radiographs meeting some of the software signs of lung nodules, a method often called Computer Aided Detection (CADe). |
| Title | Milestones | Reasons Not Completed | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Overall Study |
|
Power calculation was performed to determine the number of participants
Not provided
| ID | Title | Description |
|---|---|---|
| BG000 | Radiologists | Radiologists who have certification by the American Board of Radiology Riverain OnGuard CAD Software : This is an observer performance study. Radiologists will interpret chest radiographs without and then with the Riverain software, both SoftView (TM) OnGuard (TM) CADe Software with be tested |
| Units | Counts |
|---|---|
| Participants |
|
| Title | Description | Population Description | Parameter Type | Dispersion Type | Unit of Measure | Calculate Percentage | Denominator Units Selected | Denominators | Classes |
|---|---|---|---|---|---|---|---|---|---|
| Age, Customized | >= 25 years old |
| Type | Title | Description | Population Description | Reporting Status | Anticipated Posting Date | Parameter Type | Dispersion Type | Unit of Measure | Calculate Percentage | Time Frame | Units Analyzed | Denominator Units Selected | Arm/Group Information | Denominators | Classes | Analyses |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Primary | Improvement in Cancer Detection as Measured by Localized Receiver Operating Characteristic) LROC Changes Under the LROC Curve. | Standard methods for LROC methodology and statistical analysis were used. We are testing two different types of software using different cases, but the same radiologists to control for radiologist differences. LROC is Localized Receiver Operating Characteristic. LROC measures the trade-offs between sensitivity and specificity as radiologists use different levels of suspicion of disease. This analysis is for the software that decreases the visibility of the ribs and clavicles while preserving (and potentially enhancing) the visibility of the lungs and lung diseases. In this case, the level of suspicion recorded was for the radiologist's concern that a finding did or did not represent cancer. Please note that the FDA approved indications for use is to detected nodules that may represent cancer, but in our study scoring for a true finding was based on whether or not the nodule did represent cancer. A larger number, if statistically significant, indicates that that method is better. | 122 subjects had cancer that potentially could be detected on their chest radiograph. Power analysis showed that sample size of 351 patients, in a 2:1 ratio of nodule absent to present patients was selected to provide 80% power to detect a difference in areas under the curve of 0.10 or greater. | Posted | Mean | 95% Confidence Interval | unitless | Three days of experiment over 3-5 months, varied by participant |
5 months
Not provided
Not provided
| ID | Title | Description | Deaths (Affected) | Deaths (At Risk) | Serious Events (Affected) | Serious Events (At Risk) | Other Events (Affected) | Other Events (At Risk) |
|---|---|---|---|---|---|---|---|---|
| EG000 | Participants | The 15 radiologists who participated |
Not provided
Not provided
No adverse events occurred. Study was subject to the following potential biases: Sample bias; Majority rule bias; Referral Bias, bias from knowledge that this is an experiment; reader order bias; learning bias; Bias from use of new technology, et al
| Title | Organization | Phone | Extension | |
|---|---|---|---|---|
| Matthew T. Freedman | Georgetown University Medical Center | 4105429680 | MTFreedman@verizon.net |
Not provided
| ID | Term |
|---|---|
| D008175 | Lung Neoplasms |
| ID | Term |
|---|---|
| D012142 | Respiratory Tract Neoplasms |
| D013899 | Thoracic Neoplasms |
| D009371 | Neoplasms by Site |
| D009369 | Neoplasms |
Not provided
Not provided
|
| Three days of experiment over 3-5 months, varied by participant |
| 5 months |
| participants |
|
| Sex: Female, Male | Count of Participants | Participants |
|
| Region of Enrollment | Number | participants |
|
| chest radiographs |
| Participants |
|
|
|
|
| Other Pre-specified | Difference in the Area Under the LROC Curve Comparing OnGuard 1.0 and OnGuard 5.1 | This reports the comparison of the detection of lung nodules that were proven to represent lung cancers. It compares the results of two versions of computer-aided detection software: OnGuard 1.0 from 2001 and OnGuard 5.1 from 2009. The results represent the responses of radiologists when they use one or the other types of software. To compare radiologists' results with the two types of software, the measurement analyzed was the difference in the areas under the localized receiver operating characteristic curve (LROC). The results from the 15 participating radiologists were averaged (mean value). The area under the LROC curve is a measure of the trade-offs between sensitivity and 1-specificity that occurs as the level of certainty of a positive finding changes. It is normally reported as a decimal without units. In this study dsign, a lower number indicates that the new method (OnGuard 5.1), if statistically significant, if better. | 81 of the 263 radiographs contained a non-calcified nodule that had been diagnosed as lung cancer. Power calculation showed 246 patients, in a 2:1 ratio of nodule absent to present would provide 80% power to detect a difference in areas under the curve of 0.10 or greater. | Posted | Mean | 95% Confidence Interval | unitless | 5 months | number of radiographs | Participants |
|
|
|
| Secondary | Sensitivity and Specificity Using SoftView Software | Sensitivity and specificity were calculated using the radiologists' responses of recommendations for follow-up with CT or biopsy. Truth was whether or not the nodule identified was found to be cancer. Sensitivity is the percentage of correct identification of a positive case (a case with cancer). Specificity is the percentage of negative cases (those without cancer) that were correctly identified as not having cancer. The mean values of 15 radiologists are used. | Posted | Mean | 95% Confidence Interval | percentage of cases | Three days of experiment over 3-5 months, varied by participant |
|
|
|
| 0 |
| 15 |
| 0 |
| 15 |
Sponsor can review results communications prior to public release; review by sponsor must be completed within 60 days. Public release of results cannot occur prior to the completion of the FDA review of submitted results.
| D008171 |
| Lung Diseases |
| D012140 | Respiratory Tract Diseases |