Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
The goal of this observational study is to test periodontitis classification ability of ChatCPT. The main questions it aims to answer are:
question 1: Could ChatCPT classify periodontitis? question 2: Is there a better result if ChatCPT is trained for perodontitis classification?
The descriptive pilot research will be based on an analysis of the baseline digital record and subsequent stage, extent, and grade characterization of 75 untreated patients diagnosed with periodontitis. All cases will be evaluated by 4 examiners and the obtained standardized diagnosis for each case. The information will be used to determine the stage, grade, and extent of 75 periodontitis cases will be copied directly for each case as input to a large AI model called ChatGPT (https://chat.openai.com/), followed by query: "What is the stage, grade, and extent of periodontitis?" The received replies will be compared to standardized diagnosis.
2.2 Ethical Considerations From December 2022 to May 2023, baseline clinical and radiographic documentation of periodontitis patients were collected in the context of regular visits at the Necmettin Erbakan University Periodontology Clinic. In the study, anonymized data will be used. All participants have given their agreement in writing for the data to be used for training and research. This study will adhere to the 2013 revision of the 1975 Declaration of Helsinki and will be authorized by the Necmettin Erbakan University Faculty of Dentistry Ethics Committee for Non-Pharmac eutical and Medical Device Clinical Research.
2.3.Selection and preparation of the documentation of the periodontitis cases Using randomization software, a database of 150 patients receiving periodontal therapy will be used for selecting 85 cases of periodontitis from the archive of patients of the periodontology department at Necmettin Erbakan University. Acute periodontal lesions, gingival diseases, the presence of dental implants, and periodontitis as a manifestation of systemic diseases will be considered as exclusion criteria.
The case description included a comprehensive summary of the patient's medical and dental history, intra-oral photographs, a panoramic radiograph, a complete set of periapical radiographs, and periodontal charting that encompassed various clinical measures related to periodontal health. These measures will be plaque scores (visually assessed after the use of a revealing solution, as present or absent), probing depth, bleeding on probing, clinical attachment loss (CAL), furcation involvement (Hamp, Nyman, & Lindhe, 1975) and tooth mobility (Miller, 1985). The medical history will be also supplied, including details regarding pertinent medical issues including glycemic management and cigarette usage. The clinical, photographic, and radiological records for the 85 patients that will be chosen will be of excellent quality and good diagnostic sensitivity.
The whole documentation of the periodontitis instances will be compiled into four presentation files. They will be presented in different orders in all four presentations for four expert evaluations. The first presentation is provided 2.4 Experts' Evaluation Four experienced periodontists who work as full-time faculty members (Z.T.E, O.B, D.O.S, and F.U.Y.) will evaluate the cases in the first phase utilizing the prepared presentations. The four experts had gone over the consensus reports for the 2018 periodontal classification (Papapanou et al., 2018; Tonetti, Greenwell, & Kornman, 2018) multiple times and had been using it to make clinical diagnoses for at least 4 years. These diagnoses will be considered standardized diagnoses and served as the reference for each respective case. The cases that did not achieve a consistent diagnosis among the experts will be excluded from the study.
2.5 Staging, grading, and determining extent of periodontitis cases using ChatCPT
ChatGPT is an implementation of the Generative Pre-Training Transformer 3 (GPT-3) language model developed by OpenAI, which is publicly accessible and freely available for use. (Brown et al., 2020). GPT-3 is a highly expansive neural network-based natural language processing (NLP) model, currently one of the largest in existence. With training on 175 billion parameters, its primary purpose is to generate text that closely resembles human language. Acting as a versatile chatbot, GPT-3 is capable of performing diverse NLP tasks such as language translation, summarization, and question-answering (Balas & Ing, 2023). Among its many possible uses, we will evaluate the performance of GPT-3 in stage, grade, and extent determination of periodontitis using case descriptions. its ability to stage, grade, and determine extent when given case descriptions of periodontitis. Since ChatCPT is a language model and cannot use images, the radiographs of the cases will be evaluated by the four experts. Bone loss amounts and bone loss rates will be measured and turned into numerical data that ChatCPT could use. Standardized texts containing the information that should be used to determine the stage, grade, and extent of each case will be created. This information is as stated below.
For staging;
a. The amount of bone loss in the last 5 years; b. The age ratio of the percentage of bone loss in the worst area; c. Phenotype of destruction: d. Smokin status and number of cigarettes smoked per day; e. Diabetic status and HbA1c level below or above. For this study, a new account will be created, granting access to ChatGPT through the link provided (https://chat.openai.com/chat). The standardized texts for each case will be written in English, and then the question "What stage, grade, and extent is the periodontitis?" will be asked to ChatGPT. The same current version of the ChatGPT program will be used in the query, and the query process will be done in two ways.
In 2 different inquiries from chatCPT, an answer will be obtained for the stage, grade and extent of periodontitis for each case. The stage, grade and extent responses obtained for each case will be compared with the standardized diagnosis created by the experts.
Not provided
Not provided
Not provided
Not provided
| Measure | Description | Time Frame |
|---|---|---|
| Classficiation ability of ChatCPT | The primary result will the comparison of results obtained from two different queries in the ChatCPT with the standardized diagnosis. | 1 month |
| Measure | Description | Time Frame |
|---|---|---|
| Comparison of stage, grade and extent in ChatCPT's answers and standard diagnosis | In ChatCPT's answers, stage, grade and extent will be compared with compliance with the standard diagnosis. Thus, it will be evaluated that ChatGPT is more successful in guessing which of them correctly. | 1 month |
| Measure | Description | Time Frame |
|---|---|---|
| Determining which of the information used in determining the stage and grade is more effective in the agreement of stage and grade | Various information is used to determine the stage and grade of periodontitis. For example, "clinical attachment loss, periodontal pocket depth, percentage of radiographic bone loss and number of teeth lost due to peridontitis" are used to determine the stage. In determining the grade, "age ratio of bone loss percentage, phenotype of destruction, number of cigarettes smoked daily and diabetes" information is used. The study seeks to answer the following question: "Which of these information is most affected when estimating ChatGPT stage and grade?" |
Inclusion Criteria:
Exclusion Criteria:
Not provided
Not provided
Not provided
Periodontitis
Not provided
Not provided
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| Zeynep Taştan Eroğlu | Konya | Turkey (Türkiye) |
| PubMed Identifier | Type | Citation | Retractions |
|---|---|---|---|
| 1058213 | Result | Hamp SE, Nyman S, Lindhe J. Periodontal treatment of multirooted teeth. Results after 5 years. J Clin Periodontol. 1975 Aug;2(3):126-35. doi: 10.1111/j.1600-051x.1975.tb01734.x. | |
| 3858267 | Result | Miller PD Jr. A classification of marginal tissue recession. Int J Periodontics Restorative Dent. 1985;5(2):8-13. No abstract available. |
| Label | URL |
|---|---|
| Brown T, Mann B, Ryder N, et al. Language models are few-shot learners. Advances in neural information processing systems 2020;33:1877-1901. | View source |
Not provided
Not provided
| ID | Term |
|---|---|
| D010518 | Periodontitis |
| D004194 | Disease |
| D010510 | Periodontal Diseases |
| ID | Term |
|---|---|
| D009059 | Mouth Diseases |
| D009057 | Stomatognathic Diseases |
| D010335 | Pathologic Processes |
| D013568 | Pathological Conditions, Signs and Symptoms |
Not provided
Not provided
Not provided
Not provided
Not provided
| 1 month |
| 29926951 | Result | Papapanou PN, Sanz M, Buduneli N, Dietrich T, Feres M, Fine DH, Flemmig TF, Garcia R, Giannobile WV, Graziani F, Greenwell H, Herrera D, Kao RT, Kebschull M, Kinane DF, Kirkwood KL, Kocher T, Kornman KS, Kumar PS, Loos BG, Machtei E, Meng H, Mombelli A, Needleman I, Offenbacher S, Seymour GJ, Teles R, Tonetti MS. Periodontitis: Consensus report of workgroup 2 of the 2017 World Workshop on the Classification of Periodontal and Peri-Implant Diseases and Conditions. J Periodontol. 2018 Jun;89 Suppl 1:S173-S182. doi: 10.1002/JPER.17-0721. |
| 29926952 | Result | Tonetti MS, Greenwell H, Kornman KS. Staging and grading of periodontitis: Framework and proposal of a new classification and case definition. J Periodontol. 2018 Jun;89 Suppl 1:S159-S172. doi: 10.1002/JPER.18-0006. |
| 38951256 | Derived | Tastan Eroglu Z, Babayigit O, Ozkan Sen D, Ucan Yarkac F. Performance of ChatGPT in classifying periodontitis according to the 2018 classification of periodontal diseases. Clin Oral Investig. 2024 Jun 29;28(7):407. doi: 10.1007/s00784-024-05799-9. |