E-ISSN 2146-8354
 

Original Research 


Performance-based assessment in a pre-clinical medical school chest radiology curriculum: Student achievement and attitudes

Faaiza Mahmoud, Thomas P. Sullivan, David C. Ensminger, Amany Aziz, Khalid Alsabban, Terrence C. Demos, Jennifer E. Lim-Dunham.

Abstract
Objective: The purpose of this study was to evaluate student achievement and attitudes pertaining to a performance-based assessment in a medical student chest radiology curriculum using mixed quantitative and qualitative methods.

Methods: One-hundred-and-sixty-one participating second-year students, in the 2015-16 academic year took a post-curriculum multiple choice question (MCQ) exam. Students also underwent a performance-based assessment in the form of a chest x-ray interpretation small-group session administered by radiology faculty at a picture archiving and communications system (PACS) workstation. Each student verbally interpreted one chest radiograph showing one of 6 pathologies and was given a numerical rating based on a standardized rubric. This score was compared to the correctness of the studentís answer to the corresponding MCQ question on the same topic. All students completed a post-session questionnaire. Open-ended free-text responses regarding student attitudes were coded into qualitative themes by three independent raters. High inter-rater agreement was demonstrated by average agreement index of .82 or greater (ranging from 0-1, with 1 indicating perfect agreement) for responses to the most frequent themes.

Results: There was no significant association between scores on MCQ exam and performance-based assessment. Up to 90% of post-session questionnaire respondents indicated a Likert rating of 5 (strongly agree) when asked if the sessions improved understanding of chest x-rays and their ability to identify specific radiologic pathology. Dominant themes from open-ended responses were then derived.

Conclusions: Lack of agreement between student performance on the chest x-ray interpretation small-group session and that on the parallel MCQ exam suggests that they each measure a different type of achievement, with the former emphasizing skills over knowledge. Features most commonly valued by students in the performance-based assessment were its ability to reinforce prior knowledge, supply an authentic and relevant PACS experience simulating real life, and provide an opportunity for active practice of radiology interpretive skills.

Key words: Inter-rater coding; Medical student education; Multiple-choice question; Performance-based assessment; Radiology


 
ARTICLE TOOLS
Abstract
PDF Fulltext
How to cite this articleHow to cite this article
Citation Tools
Related Records
 Articles by Faaiza Mahmoud
Articles by Thomas P. Sullivan
Articles by David C. Ensminger
Articles by Amany Aziz
Articles by Khalid Alsabban
Articles by Terrence C. Demos
Articles by Jennifer E. Lim-Dunham
on Google
on Google Scholar
Article Statistics
 Viewed: 956
Downloaded: 4


How to Cite this Article
Pubmed Style

Mahmoud F, Sullivan TP, Ensminger DC, Aziz A, Alsabban K, Demos TC, Lim-Dunham JE. Performance-based assessment in a pre-clinical medical school chest radiology curriculum: Student achievement and attitudes. doi:10.5455/jcme.20190429063757


Web Style

Mahmoud F, Sullivan TP, Ensminger DC, Aziz A, Alsabban K, Demos TC, Lim-Dunham JE. Performance-based assessment in a pre-clinical medical school chest radiology curriculum: Student achievement and attitudes. http://www.jcmedu.org/?mno=43953 [Access: April 20, 2020]. doi:10.5455/jcme.20190429063757


AMA (American Medical Association) Style

Mahmoud F, Sullivan TP, Ensminger DC, Aziz A, Alsabban K, Demos TC, Lim-Dunham JE. Performance-based assessment in a pre-clinical medical school chest radiology curriculum: Student achievement and attitudes. doi:10.5455/jcme.20190429063757



Vancouver/ICMJE Style

Mahmoud F, Sullivan TP, Ensminger DC, Aziz A, Alsabban K, Demos TC, Lim-Dunham JE. Performance-based assessment in a pre-clinical medical school chest radiology curriculum: Student achievement and attitudes. doi:10.5455/jcme.20190429063757



Harvard Style

Mahmoud, F., Sullivan, . T. P., Ensminger, . D. C., Aziz, . A., Alsabban, . K., Demos, . T. C. & Lim-Dunham, . J. E. (2020) Performance-based assessment in a pre-clinical medical school chest radiology curriculum: Student achievement and attitudes. doi:10.5455/jcme.20190429063757



Turabian Style

Mahmoud, Faaiza, Thomas P. Sullivan, David C. Ensminger, Amany Aziz, Khalid Alsabban, Terrence C. Demos, and Jennifer E. Lim-Dunham. 2020. Performance-based assessment in a pre-clinical medical school chest radiology curriculum: Student achievement and attitudes. doi:10.5455/jcme.20190429063757



Chicago Style

Mahmoud, Faaiza, Thomas P. Sullivan, David C. Ensminger, Amany Aziz, Khalid Alsabban, Terrence C. Demos, and Jennifer E. Lim-Dunham. "Performance-based assessment in a pre-clinical medical school chest radiology curriculum: Student achievement and attitudes." doi:10.5455/jcme.20190429063757



MLA (The Modern Language Association) Style

Mahmoud, Faaiza, Thomas P. Sullivan, David C. Ensminger, Amany Aziz, Khalid Alsabban, Terrence C. Demos, and Jennifer E. Lim-Dunham. "Performance-based assessment in a pre-clinical medical school chest radiology curriculum: Student achievement and attitudes." doi:10.5455/jcme.20190429063757



APA (American Psychological Association) Style

Mahmoud, F., Sullivan, . T. P., Ensminger, . D. C., Aziz, . A., Alsabban, . K., Demos, . T. C. & Lim-Dunham, . J. E. (2020) Performance-based assessment in a pre-clinical medical school chest radiology curriculum: Student achievement and attitudes. doi:10.5455/jcme.20190429063757





Most Viewed Articles
  • The impact of gender and English language on the academic performance of students: An experience from new Saudi medical school
    Najwa Al-Mously, Raneem Salem, Nasser Al-Hamdan
    J Contemp Med Edu. 2013; 1(3): 170-176
    » Abstract & References » doi: 10.5455/jcme.20130226121358

  • Oral medicine and radiology- the Indian scenario
    Shishir Ram Shetty, Mansib M Shaik, Subhas G Babu
    J Contemp Med Edu. 2013; 1(1): 59-61
    » Abstract & References » doi: 10.5455/jcme.20121220032624

  • Non scholae sed vitae discimus (Not for school but for life we learn): Thoughts on the traditional lecture in medical education
    Thomas Efferth
    J Contemp Med Edu. 2013; 1(2): 69-72
    » Abstract & References » doi: 10.5455/jcme.20130226121738

  • Knowledge, attitude & practices of medical students and teachers towards clinical research in a tertiary care hospital in Mumbai – cross sectional survey
    Dinesh K Dhodi, Karan B Thakkar, Gauri Billa, Akash A Khobragade, Shyamal R Sinha, Sadiq B Patel
    J Contemp Med Edu. 2013; 1(4): 238-244
    » Abstract & References » doi: 10.5455/jcme.20130608045519

  • The relationship between spirituality and burnout among medical students
    Amy Wachholtz, MaiLan Rogoff
    J Contemp Med Edu. 2013; 1(2): 83-91
    » Abstract & References » doi: 10.5455/jcme.20130104060612

  • Most Downloaded
  • Communication skills for medical students – An overview
    Ramesh Ramasamy, Sathish Babu Murugaiyan, Rachel Shalini, Kuzhandai Velu Vengadapathy, Niranjan Gopal
    J Contemp Med Edu. 2014; 2(2): 134-140
    » Abstract & References » doi: 10.5455/jcme.20140321110500

  • Oral medicine and radiology- the Indian scenario
    Shishir Ram Shetty, Mansib M Shaik, Subhas G Babu
    J Contemp Med Edu. 2013; 1(1): 59-61
    » Abstract & References » doi: 10.5455/jcme.20121220032624

  • The impact of gender and English language on the academic performance of students: An experience from new Saudi medical school
    Najwa Al-Mously, Raneem Salem, Nasser Al-Hamdan
    J Contemp Med Edu. 2013; 1(3): 170-176
    » Abstract & References » doi: 10.5455/jcme.20130226121358

  • Five-year trend of competitiveness and knowledge-gaining attitude of university students; Evaluation based on an event of continuing health sciences education
    Fujio Takayama, Yoshiko Amikura, Sudhakar John, Vidyasagar Devaprasad Dedeepiya, Rajappa Senthilkumar, Govindan Venkataramani, Kottoorathu Mammen Cherian, Hajib Naraharirao Madhavan, David W Green, Masahiko Matsumoto, Shoji Suzuki, Masaru Iwasaki, Senthilkumar Preethy , Samuel JK Abraham
    J Contemp Med Edu. 2013; 1(2): 92-99
    » Abstract & References » doi: 10.5455/jcme.20130115055107

  • Assessment of Emotional Intelligence in Pediatric and Med-Peds Residents
    Ramzan Shahid, Jerold Stirling, William Adams
    J Contemp Med Edu. 2016; 4(4): 153-158
    » Abstract » doi: 10.5455/jcme.20170116015415

  • Most Cited Articles
  • The relationship between spirituality and burnout among medical students
    Amy Wachholtz, MaiLan Rogoff
    J Contemp Med Edu. 2013; 1(2): 83-91
    » Abstract & References » doi: 10.5455/jcme.20130104060612
    Cited : 22 times [Click to see citing articles]

  • Perceptions of Personalized Medicine in an Academic Health System: Educational Findings
    Allison Vorderstrasse, Sara Huston Katsanis, Mollie A Minear, Nancy Yang, Tejinder Rakhra-Burris, Jason W Reeves, Robert Cook-Deegan, Geoffrey S Ginsburg, Leigh Ann Simmons
    J Contemp Med Edu. 2015; 3(1): 14-19
    » Abstract & References » doi: 10.5455/jcme.20150408050414
    Cited : 9 times [Click to see citing articles]

  • The impact of gender and English language on the academic performance of students: An experience from new Saudi medical school
    Najwa Al-Mously, Raneem Salem, Nasser Al-Hamdan
    J Contemp Med Edu. 2013; 1(3): 170-176
    » Abstract & References » doi: 10.5455/jcme.20130226121358
    Cited : 8 times [Click to see citing articles]

  • Building a theoretically grounded model to support the design of effective non-technical skills training in healthcare: The SECTORS model
    Morris Gordon
    J Contemp Med Edu. 2013; 1(2): 77-82
    » Abstract & References » doi: 10.5455/jcme.20121217125557
    Cited : 8 times [Click to see citing articles]

  • Assessment of Emotional Intelligence in Pediatric and Med-Peds Residents
    Ramzan Shahid, Jerold Stirling, William Adams
    J Contemp Med Edu. 2016; 4(4): 153-158
    » Abstract » doi: 10.5455/jcme.20170116015415
    Cited : 7 times [Click to see citing articles]