Medical Science Educator

, Volume 27, Issue 4, pp 685–692 | Cite as

A Crowdsourced System for Creating Practice Questions in a Clinical Presentation Medical Curriculum

  • M. Rick StoneEmail author
  • Marjorie Kinney
  • Carolyn Chatterton
  • Robin K. Pettit
Original Research



Medical students must learn a large amount of information in their first 2 years of medical school. Question banks such as UWorld and COMBANK are a popular method of preparation for national board exams, but it is difficult to have a similar uniform resource to prepare for exams administered by individual medical schools because the curriculum varies from school to school.

Project Creation and Implementation

In order to help prepare for course exams, students from the Class of 2017 at A.T. Still University School of Osteopathic Medicine in Arizona (ATSU-SOMA) collaborated to create crowdsourced practice quizzes based on the specific material taught at their school. Google Drive was used to manage sign-up sheets and collect questions, and Blackboard was used to create automatically graded practice quizzes.

Methods and Results

Participants were given a survey at the end of their second year of medical school to assess their opinions of the project’s effectiveness. Students indicated that participation in the project helped them feel more confident on exams, improved their ability to write higher-order, clinically based questions, and improved their ability to predict what types of questions would be used on school-administered exams. Participants ranked the crowdsourced practice quizzes as more useful than textbook practice questions and as useful as faculty-written practice quizzes, board question banks, and verbal quizzing in study groups in preparing for school-administered exams. Comparison of study participant course grades and medical-school grade point average suggested the practice quizzes may benefit lower-performing students more than higher-performing students.


Student-driven review Collaborative learning Crowdsourcing Practice questions Active learning 


Compliance with Ethical Standards

Conflict of Interest

The authors declare that they have no conflict of interest.

Supplementary material

40670_2017_462_MOESM1_ESM.pdf (154 kb)
ESM 1 (PDF 153 kb)


  1. 1.
    Evans MM. Student-written quiz questions: an active teaching-learning strategy to enhance engagement. Med-Surg Matters. 2011;20:10–1.Google Scholar
  2. 2.
    Bow HC, Dattilo JR, Jonas AM, Lehmann CU. A crowdsourcing model for creating preclinical medical education study tools. Acad Med. 2013;88:766–70.CrossRefGoogle Scholar
  3. 3.
    Walsh J, Harris B, Tayyaba S, Harris D, Smith P. Student-written single-best answer questions predict performance in finals. Clin Teach. 2015;12:1–5.CrossRefGoogle Scholar
  4. 4.
    Harris BHL, Walsh JL, Tayyaba S, Harris DA, Wilson DJ, Smith PE. A novel student-led approach to multiple-choice question generation and online database creation, with targeted clinician input. Teach. Learn. Med. 2015;27:182–8.CrossRefGoogle Scholar
  5. 5.
    Foos PW. Effects of student-written questions on student test performance. Teach Psychol. 1989;16:77–8.CrossRefGoogle Scholar
  6. 6.
    Giordano C, Hutchinson D, Peppler R. A predictive model for USMLE step 1 scores. Cureus. 2016;8:e769.Google Scholar
  7. 7.
    Vora A, Maltezos N, Alfonzo L, Hernandez N, Calix E, Fernandez MI. Predictors of scoring at least 600 on COMLEX-USA level 1: successful preparation strategies. J Am Osteopath Assoc. 2013;113:164–73.CrossRefGoogle Scholar
  8. 8.
    Kornell N, Son LK. Learners’ choices and beliefs about self-testing. Memory. 2009;17:493–501.CrossRefGoogle Scholar
  9. 9.
    McLeod PJ, Snell L. Student-generated MCQs. Medical Teacher. 1996;18:23.CrossRefGoogle Scholar
  10. 10.
    Augustin M. How to learn effectively in medical school: test yourself, learn actively, and repeat in intervals. Yale J. Biol. Med. 2014;87:207–12.Google Scholar
  11. 11.
    Koles PG, Stolfi A, Borges NJ, Nelson S, Parmelee DX. The impact of team-based learning on medical students’ academic performance. Acad Med. 2010;85:1739–45.CrossRefGoogle Scholar
  12. 12.
    Hassumani D, Cancellieri S, Boudakov I, Upadhya S, Sobering AK. Quiz discuss compare: using audience response devices to actively engage students. Medical Science Educator. 2015;25:299–302.CrossRefGoogle Scholar

Copyright information

© International Association of Medical Science Educators 2017

Authors and Affiliations

  1. 1.School of Osteopathic Medicine in ArizonaA.T. Still UniversityMesaUSA

Personalised recommendations