The Role of Humanoid Robot in Neuropsychological Assessment and Cognitive Training.

The Role of Humanoid Robot in Neuropsychological Assessment and Conducting Cognitive Training in Patients With Dementia and Severe Brain Injury

The role of humanoid robot in neuropsychological assessment and conducting cognitive training in patients with dementia and severe brain injury" Objectives Use of robotic solutions to carry out diagnostic and rehabilitation intervention in order to recover cognitive and relational performance of patients with dementia and severe brain injury.

Study Design. Observational Materials and Methods. Eighty subjects (25 with mild-moderate dementia and 25 patients with severe brain injury) will be enrolled. Patients will undergo neurological examination with collection of all medical history and information on current clinical condition. After that, they will undergo administration of neuropsychological tests via humanoid robot and two months of cognitive rehabilitation sessions.

Inclusion criteria

• Over 18 years of age;
• Patients with a moderately impaired cognitive profile;
• Written consent from the legal guardian or the patient himself/herself. Exclusion criteria.
• Patients with language comprehension deficits;
• Patients with disorders of consciousness;
• Patients who are unable to provide a localized, context-appropriate response; and All eligible patients will undergo cognitive assessment using the robot at the time of enrollment (T0), and after 2 months of rehabilitation treatment (T1)

Translated with www.DeepL.com/Translator (free version)

This is a nonpharmacological interventional study. Clinical and neuropsychological variables will be collected by the robotic system and transferred to a platform where it will be possible to verify the performance achieved by the patient. All patients will be evaluated through the robot with the indispensable support of the neuropsychologist. Patients will be recruited from the outpatient neurology and severe brain injury and neurodegenerative disease departments of the IRCCS Bonino- Pulejo Neurolesi Center in Messina. The rehabilitation treatment period and test administration will be carried out before the start of treatment (T0), after 2 months of treatment (T1).

The project will allow a high technological increase in robotic and informatics solutions available to patients, thanks also to the support of the University, the partnership between complementary companies, an interdisciplinary team capable of designing and developing a new integrated solution for innovative dementia and head injury therapy will be created. Unlike the other existing platforms that mostly use a Web interface and/or application software developed ad hoc, the platform that will be realized is mainly born to be fully integrated and used through an anthropomorphic humanoid robot as a direct communication channel between the content conveyed, the patient and the Tablet device as a reinforcing and feedback element where the patient himself responds and/or interacts with the therapeutic session in progress. In this sense, the robot acts as a performer and receiver of feedback related to the therapeutic process conveyed together with the tablet.

A unique platform of its kind will be developed, capable of managing robots and the self-learning and artificial intelligence platform with the following characteristics:

• Administer therapeutic contents
• Track and store the results of your therapy sessions
• Generate reports and statistics on the results of the training sessions
• Conveying therapeutic contents through robots and software solutions.
• Suggest the best therapy according to the therapeutic objectives of the individual patient Depending on the topic addressed, the operator will be able to choose the categories of exercises related to his own therapeutic objective and then create ad hoc sequences directly from the platform. Each exercise can be parameterised by setting, for example, the level of difficulty, duration, etc. Based on the content conveyed, the robot, for example, will perform the session through verbal or physical interaction with the subject and therefore request feedback which can in turn be performed verbally by the subject or through interaction always through the same Tablet. The results of each exercise and each test will be aggregated according to the chosen goal and stored within a centralized service possibly in the Cloud. Within this system there will be a database with the patient's personal data, the therapeutic objectives defined by the neuropsychologist and the results obtained by the patient. Access to this information will be directed exclusively to the doctor/therapist via Tablet or Web and possibly to the family who, via Web access, will be able to observe the progress of the exercises and therefore the improvement and/or deviation towards the set objective.

The study will be divided into three phases. Phase 1: the personal and clinical data of the patients will be recorded on the tablet directly connected to the robot. The patients will be subjected to the administration of neuropsychological tests, which will be proposed directly by the robot with the support of the neuropsychologist. The robot will acquire the answers (right or wrong), the response time, the execution time of the entire exercise and eventually the number of attempts (if the test foresees it). Starting from this information, a percentage evaluation will be deduced which identifies an overall score.

For each test that will be administered, the tablet connected to the robot will produce a report with incorrect and correct answers and a graph to check the progress.

Phase 2: Subjects will undergo cognitive training using robots 3 times a week for 2 consecutive months. Each session will last one hour, the treatments will take place inside the ward in a setting dedicated to rehabilitation or directly at the patient's bed. The rehabilitation sessions will enhance the cognitive reserve of the target population.

Phase 3: The subjects will again undergo neuropsychological evaluations using the robot and the tablet. A report will be produced with the tests administered and the results.

Materials All neuropsychological tests will be proposed using the "Pepper" robot. Pepper is a humanoid robot one meter twenty tall and weighs 28 kilos. It moves on wheels and interacts with humans also through a tablet located at the height of the torso. Using four directional microphones in its head, it can detect where sounds and voices are coming from and turn its face towards the speaker. These microphones also allow him to analyze the tone of the voice

to interpret the emotional state. A 3D camera and two HD cameras allow him to recognize images, objects and faces instead. Thanks to its three multidirectional wheels it can move in all directions at a maximum speed of three kilometers per hour. He is equipped with 20 motors that allow him to move his head, arms and back.

The tests proposed by the robot will be:

the Mini Mental State Examination (MMSE) which will evaluate the global cognitive profile; Raven's Color Matrices which will assess logical-deductive reasoning skills; Geriatric Depression Scale for mood assessment; WEIGL test for the assessment of executive functions. STUDY POPULATION Sample size Subjects meeting all inclusion criteria will be consecutively enrolled in the study. This research project is a pilot study: the sample will consist of 40 patients with moderate GCA and 40 patients with dementia with a mild and moderate level of cognitive impairment.

Inclusion criteria

• Over 18 years old;
• Patients with moderately impaired cognitive profile; Exclusion criteria
• Patients with language comprehension deficit;
• Patients with disorders of consciousness;
• Patients who are unable to provide a localized and context-appropriate response DURATION OF THE STUDY Overall, the study will last 24 months.

Inclusion Criteria:

• Over 18 years old;
• Patients with moderately impaired cognitive profile;
• Written consent from the legal guardian or the patient himself

Exclusion Criteria:

• Patients with language comprehension deficit;
• Patients with disorders of consciousness;
• Patients who are unable to provide a localized and context-appropriate response