Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Physicians often form quick judgments about the risk for serious disease when interacting with patients. Underestimating risk can lead to underuse of diagnostic testing and untreated illness, which can worsen patient outcomes. On the other hand, overestimating risk can lead to overuse of diagnostic testing, which is costly for health systems.
To form judgments of risk, physicians should attend to a host of validated factors that are predictive of disease. However, research suggests that physicians may rely on demographic factors-such as race and gender. Physicians' judgments could also be influenced by non-health-related, personal information about their patients (e.g., hobbies, nicknames), which may moderate the impact of demographics on those judgments.
The investigators examine these dynamics in the context of heart disease. The History, Electrocardiogram, Age, Risk factors and Troponin (HEART) Score is a validated model that specifies a correspondence between certain risk factors and the likelihood of Major Adverse Cardiac Event (MACE). Importantly, there are substantially different diagnostic tests (e.g., noninvasive stress test versus coronary angiogram) that should be used depending on a patient's MACE likelihood.
Specifically, the investigators have three research questions:
Note that when the investigators discuss accuracy and error, they are referring to the comparison of physician judgments to the HEART score model benchmarks.
The investigators designed a survey to assess physicians' perception of MACE likelihood. Each physician rates a panel of patient profiles. The profiles randomly vary in risk factors, race, gender, and personal information disclosure (e.g., non-health related information about their hobbies). Using the HEART Score model as a benchmark, the investigators will assess how accurately physicians perceive MACE Likelihood based on the risk factors in a given profile. The investigators will further estimate how race, gender, and personal information disclosure causally affect physician judgments.
To do this, the investigators designed a mixed-design experiment. Each participant will respond to eight patient profiles that vary along three fully-crossed within-subject factors: (i) race: black vs. white, (ii) gender: man vs. woman, and (iii) risk factors: low vs. medium risk (based on risk levels from the HEART score model). Each participant will also be randomly assigned (between-subjects) to (iv) either see non-health-related personal information (e.g., hobbies) for all eight of their patients, or not see this information for any of their patients. The investigators refer to each factor as a profile attribute.
For each profile, participants indicate the perceived risk of a major adverse cardiac event in the six weeks following the visit. Our primary outcome is a measure of absolute error in perceived risk of MACE (described under the Primary Outcome section). They also indicate the diagnostic test they believe is most appropriate (Secondary Outcome #4).
Analysis plan
For all analyses, the investigators will format the data such that there are eight observations per participant, each corresponding to a patient profile the participant responded to.
As secondary analyses,
The investigators will also measure and explore (i) qualitative open-ended responses about how they made their risk estimations, (ii) whether participants use the HEART score model at their jobs (or another model), (iii) if they use a model, why they use it, (iv) if they have heard of the HEART score model, (v) if they looked up anything while taking the study, and (vi) if yes, what they looked up.
The investigators plan to recruit 300 physicians using the Medscape panel.
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| No Personal Information Disclosure | No Intervention | Participants rate 8 patient profiles of patients with chest pain. The profiles each contain info about the patient's race, gender, and risk factors associated with MACE. | |
| Personal Information Disclosure | Experimental | Participants rate 8 patient profiles of patients with chest pain. The profiles each contain info about the patient's race, gender, and risk factors associated with MACE. Each profile also contains non-health related personal information that the patient has disclosed (e.g., nickname, hobbies). |
|
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| Personal Information Disclosure | Behavioral | Each profile also contains non-health related personal information that the patient has disclosed (e.g., nickname, hobbies). |
|
| Measure | Description | Time Frame |
|---|---|---|
| Absolute Error in Perceived Risk of MACE | For each patient profile, all participants will be asked about their perceived risk of MACE: What is the likelihood that this patient experiences a major adverse cardiac event in the six weeks following the visit? [0-100]. The paradigm uses two levels of risk factors, each associated with a specific risk of MACE range as defined by the HEART score model: low risk factors = 0.9-1.7% (midpoint = 1.3%); and medium risk factors = 12-16.6% (midpoint = 14.3%). To calculate each participant's directional error, the investigators will take the difference between participants' perceived risk of MACE and the midpoint of the risk of MACE range from the HEART score model at each patient's corresponding risk level. The absolute error is calculated by taking the absolute value of the directional error. | At the time of survey completion, within approximately 2 weeks |
| Measure | Description | Time Frame |
|---|---|---|
| Perceived Risk of MACE | This reflects the raw, untransformed value of participants' response to the question: What is the likelihood that this patient experiences a major adverse cardiac event in the six weeks following the visit? [0-100]. | At the time of survey completion, within approximately 2 weeks |
Not provided
Inclusion Criteria:
Exclusion Criteria:
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Affiliation | Role |
|---|---|---|
| Joseph Reiff, PhD | University of Maryland Robert H. Smith School of Business | Principal Investigator |
| Aneesh Rai, PhD | University of Maryland Robert H. Smith School of Business | Principal Investigator |
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| Van Munching Hall | College Park | Maryland | 20742 | United States |
The investigators will share anonymized responses from participants containing all their responses to our survey.
Indefinitely upon the study concluding.
The investigators will post the data, code, and materials on Researchbox.org. The investigators will create a unique page for our project. Any interested reader can access this page.
Not provided
Not provided
Parallel randomized trial at the physician level.
Not provided
Not provided
Not provided
| Directional Error |
This reflects the directional error variable, explained under the primary outcome description. |
| At the time of survey completion, within approximately 2 weeks |
| Categorical Error | This is a binary variable for whether participants' perceived risk of MACE falls outside of the HEART score model's risk of MACE range at each patient's corresponding risk level [1 = outside of the range; 0 = within than range]. | At the time of survey completion, within approximately 2 weeks |
| Diagnostic Test Decision | "What would you recommend for this patient?" [(a) Coronary computed tomography angiography (cCTA), (b) noninvasive stress test, (c) left heart catheterization (coronary angiogram with potential percutaneous coronary intervention), or (d) routine follow-up.] | At the time of survey completion, within approximately 2 weeks |
| Overconfidence | "I believe my responses were more accurate than ____% of participants in this study." [0 to 100; there is more information in the survey about the meaning of "accurate" and the response options]. To measure true percentile placement, the investigators will calculate each participant's mean absolute error of perceived risk of MACE across the eight profiles and then calculate their percentile rank. The investigators will then calculate overconfidence by taking the difference between their perceived and true percentile placement. Note that this is specifically a measure of over-placement (rather than over-precision or over-estimation). | At the time of survey completion, within approximately 2 weeks |