Impact of GPT Use on Essay Writing Performance and Cognitive Abilities

A Randomized Controlled Trial on the Impact of Using Generative Artificial Intelligence on Analytical Writing Performance and Cognitive Abilities

The goal of this randomized controlled lab experiment is to examine if using generated artificial intelligence (AI) technology will affect people's academic performance and cognitive abilities in the context of analytical writing among college students. The main questions it aims to answer are:

1. Does using the technology affect students' writing performance?
2. Does using the technology affect students' cognitive effort during the writing process?

Participants will be randomly assigned to either a control group, which is writing without AI assistance, or an experimental group, which is writing with the assistance of ChatGPT. Researchers will compare the two groups to see if ChatGPT affects students' writing performance and cognitive effort.

For each participant, the lab experiment will last for no more than 1.5 hours. An eye-tracker will monitor the participant's gaze activities and pupil size. A functional near-infrared spectroscopy (fNIRS) will monitor the participant's brain activities in the frontal lobe. During the experiment, participants will be asked to:

1. Read learning materials on analytical writing techniques.
2. Based on the previously provided materials, complete an analytical writing assignment that will take approximately 30 minutes either with or without the aid of ChatGPT.
3. Answer survey questions about their experience with the writing assignment, attitudes on using ChatGPT, and demographic backgrounds.

Inclusion Criteria:

• Full-time university student.
• Able to read and write in English.
• Use the computer most days of the week.
• Have not taken, nor currently preparing for, the Graduate Record Examinations (GRE).
• Do not wear glasses (contact lenses are allowed).
• Have no eye impairment.
• Not currently taking any opioids, epinephrine, or anti-hypertensive drugs.
• During the experiment, not wearing any makeup around the eyes.