Curricular integration of virtual patients: a unifying perspective of medical teachers and students
Virtual Patients (VPs) may improve cognitive and behavioral skills better than traditional methods do. The aim of this paper was to investigate challenges faced by teachers and students in order to effectively implement VPs across undergraduate and postgraduate curricula. In addition, differences in student and teacher perceptions that could impact curricular integration of VPs were explored.
A two-phase descriptive study was performed: 1) evaluation of the VP design process and curricular integration, conducted upon academic medical teachers; 2) evaluation of learning and clinical reasoning experiences with VPs, from the students’ perspective.
The results of this study document high acceptance of VPs by both medical teachers and students (n = 252).VPs seem to fulfill most needs as set by course directors, while they satisfy student needs and create perceptions of improved knowledge and clinical skills reasoning.
Medical educators have encountered educational challenges upon transforming the curriculum. To develop VPs, academic institutions have to pay equal attention to the needs of potential adopters and VP authors. Strategic development and use of VPs may motivate more widespread integration of VPs and lead to a high quality medical education system.
KeywordsVirtual patients Medical curriculum Medical education
Aristotle University of Thessaloniki
electronic Virtual Patients
Massive Open Online Courses
Problem Based Learning
Statistical Package for the Social Sciences
Even though the rapid increase in medical information and the expectations for quality health care during the last decades have enhanced the complexity of medical decision-making, there has been a reduction of time for education  and strong concerns about the patients use as teaching subjects . Safer and more effective means are therefore needed to support the development of clinical reasoning skills required in medical education. Moreover, medical training has now become more student-centred  and more emphasis is given to active learning and clinical skills reasoning rather than passive knowledge acquisition and fruitless recall of information [4, 5, 6].
The rapid development of new reliable information technologies enabled the creation of contemporary learning activities that could not be previously achieved. These can now enhance effectively medical education and training . Under this perspective, Virtual Patients (VPs), often defined as “specific types of computer-based programs that simulates real-life clinical scenarios where learners emulate the roles of health care providers to obtain a history, conduct a physical exam, and make diagnostic and therapeutic decisions” , have been increasingly used as educational resources in many medical educational institutions . The main features of VP systems are that they provide practice in a safe and no patient risk environment and they can be repeatedly used by any clinical skills learner without regard to time and place .
These opportunities that VPs provide in modern medical education , in association with positive evaluation results of various studies that demonstrated that they may improve cognitive and behavioral skills better than traditional methods do , led to a wide trend towards VP creation and use among academic institutions . However, the successful integration and effective full adoption of VPs in medical curricula has not been easily implemented in a broad range of medical schools, since it hinges on the extent to which medical educators sufficiently consider curricular issues . Now that rigid educational programs give space to more flexible and adaptable ones, in which the medical teachers’ and students’ feedback at the same time, play an increasingly important role , changing the medical curriculum towards a thorough and consistent implementation of VP simulations remains a challenge .
The Medical School of Aristotle University of Thessaloniki (AUTH) has made remarkable efforts to improve medical education in the last few years, trying to assimilate new trends and modernize the curriculum. Part of this effort was initiated in the mEducator project (www.meducator.net) [17, 18] only to be materialized then in the ARIADNE project (http://vp.med.auth.gr/ariadne), which resulted in the development of a considerably extensive and open VP repository; the latter aimed at training students in applied knowledge, clinical reasoning and professional attitude, and led to the full incorporation of these newly created educational objects in Problem Based Learning (PBL) sessions in the medical curriculum, both undergraduate and postgraduate. Following the procedure of creation, implementation and incorporation of the VP cases in the curriculum, an effort for a comprehensive evaluation of various parameters of the VP design, use and integration process, from both educators’ and students’ perspective, aimed to add meaningful knowledge considering the full adoption of VPs.
Thus, the aim of this paper was to perform a both quantitative a qualitative research for the VP use and implementation across the medical curriculum. Concerning the quantitative approach, the purposes of the study was a) to measure the propensity of medical teachers and students toward the use of VPs in the medical curriculum and b) to measure the preferences of medical teachers and students concerning the way VPs should be utilized across their studies. At the same time, the qualitative evaluation performed in this study aimed to a) describe advantages and disadvantages in VP integration into the medical curriculum and b) to describe the experiences of both medical educators and students in adopting VP resources in their learning and training across the medical curriculum. This bilateral perspective could help in shaping new strategies to effectively integrate this unique type of educational resources in medical education, while addressing important questions on the optimal design and use of VPs. A well-designed curriculum integration of VPs will have the potential to generate medical students with professional knowledge, experiential learning and critical thinking.
Context of the study
The ARIADNE project team consisted of 34medical teachers (lecturers, professors and scientific associates of the Medical faculty), in collaboration with 5 members of the mEducator project and the Medical Education Informatics (medphys.med.auth.gr/mei) research team who, apart from the technical support of the system, undertook the responsibility of “training the trainers” or teacher training with respect to technical knowledge and skills required for VP authoring. The outcome of this effort was the creation of a repository of the first 35 VP cases in the Greek academia as well as the local Medical School. These VP cases were implemented through OpenLabyrinth, an open source on line activity modeling system that allows the design and implementation of interactive “game informed” educational activities . These cases were intended to be built around enquiry-based approaches to learning, something that was supported by the VP authoring system. Thus, a variety of features were available to the authors, such as, multiple nodes and links, avatars, media files, rules, info buttons, counters and skins, all these provided through a user friendly interface and a visual editor. Finally, depending on how familiar each member of the faculty was with modeling systems, each VP was created after 1 to 2 months’ effort. Open exploratory access to this VP repository was initially given to undergraduate medical students and subsequently, after positive preliminary feedback, the VP cases were formally incorporated in the medical curriculum as part of pilot small group of PBL sessions. At the same time, the repository was enriched by adding new cases, in an effort to include VPs applied to a wider variety of medical specialties. Today, the database counts some 59 VP cases.
Evaluating how medical teachers and students use VPs is crucial for the effective development of these educational resources . To explore medical students’ and teachers’ perception of VPs’ integration in medical curriculum, a descriptive study was designed and performed , as an attempt to explore and explain, while providing additional information, about VP design and implementation from both sides, medical students’ and teachers’ as well. The evaluation performed at the ARIADNE project included two parts: 1) the evaluation of the VP design process and curricular integration, conducted upon the medical teachers participating in the design and implementation of VPs and 2) the evaluation of the learning and clinical reasoning experiences with VPs, conducted upon students, using the 59 virtual patients that currently exist in the repository.
Approach and researcher characteristics
This evaluation aimed to include both quantitative and qualitative data, so as to form a mixed method approach that will provide answers in the specific research questions previously mentioned in the introduction. Specifically, as far as the quantitative approach is concerned, an effort for recording the medical teachers’ and students’ position and tension for the adoption of VPs was made and, at the same time, their preferences for the VPs’ best utilization as learning activities were registered. On the other hand, for the qualitative approach, content analysis was used as a method. Open-ended questions led to a wide variety of transcripts which had to be analyzed in a qualitative oriented way. Categories were not established before beginning the analysis but were allowed to emerge during analysis. Coding the data was the process of organizing the results in a comprehensible way. During the analysis, more coders were used to ensure the trustworthiness of the analysis. Medical teachers were asked to identify the advantages and the weaknesses of VP integration and describe their experiences and preferences with VPs. At the same time, medical students were asked to evaluate their learning and clinical reasoning experiences with VPs, so as the pros and cons of VPs to be highlighted. Moreover, both medical teachers and students were asked to provide us with their preliminary experiences for the expected VPs’ integration across the medical curriculum.
Concerning the main researchers, ED is a medical doctor with experience in medical educational simulations and IF is a specialist in healthcare management and informatics. Both ED and IF participated in the data collection and analysis and had no personal relationships with the medical teachers and students that took part in the study.
In total, 252 participants, both medical teachers and students, participated in the evaluation procedure of VPs’ curriculum integration.
Instruments and data collection
The study included the collection of quantitative and qualitative data, using two on line available questionnaires, for the medical teachers’ and students’ evaluation, accordingly. Data were collected between September 2017 and December 2017 using face-to-face groups.
The medical teachers’ questionnaire for the VPs creation, implementation and adoption
Are educational activities based on virtual patients more interesting than traditional ones?
Did the design process of a virtual patient increase your research interest for the clinical condition related to the case?
What are the advantages of the virtual patient design and implementation process and how do they enhance learning?
What are the weaknesses of the virtual patient design and implementation (or which parts can be improved to contribute more effectively to the educational process)?
Which part of the virtual patient design do you believe is more useful as an educational experience?
Do you think that the selection of multimedia material contributes, to the educational process? If yes, which way?
Set of Yes/No Questions
The design process of a virtual patient contributes to:
a. Clinical skills development through proper virtual patient management.
b. Clinical skills development through training in decision making.
c. Support of the educational experience, since it could be considered equal to training with real patients.
d. Increase of gaining knowledge.
e. Better memorization of key points.
f. Deeper knowledge of the disease.
What is the difficulty level of the virtual patient design?
1–5 (in ascending order)
What do you mostly remember from this activity?
Do you consider that the virtual patient design process corresponds to your IT level of knowledge?
Did the virtual patient design process increase the team spirit?
Do you think it would be possible to implement this method in other fields?
For the evaluation of students’ learning and clinical reasoning experiences with VPs, the validated eViP evaluation tool kit for use with VPs was used . This student questionnaire consists of 14 questions clustered into the following main categories: a) authenticity of patient encounter and consultation, b) professional approach in the consultation, c) coaching during consultation, d) learning effect, e) overall judgment, f) open-ended questions . Likert scale questions are used in this questionnaire with their statements based on attitudes and cognitive activities. Furthermore, a few questions were added, including those concerning demographic characteristics (sex and age group), the year of study, the title of VPs evaluated and finally, a multiple choice question referring to the integration of VPs into the medical curriculum, including the options: a) as an additional learning activity, b) as an additional tool for practice before the exams, c) as a tool for clinical skills acquisition before real clinical contact and d) as an assessment tool. This instrument was administered to medical students after they encountered a number of VPs.
The Bioethical Committee of the Aristotle University of Thessaloniki approved this study (reference no. 1/22-12-2011).
The on line questionnaire data were entered into a database and then imported into IBM SPSS Version 19.0 (SPSS, Inc., Chicago, IL, USA) for descriptive statistical analysis.
As far as the qualitative data of the study are concerned, the SRQR guidelines were followed, so as the results of the qualitative part of the study to be more easily accessible to readers when critically appraising, applying, and synthesizing study findings.
Data analysis took place at the same time with data collection. Identifiers were omitted to maintain anonymity and confidentiality. Transcripts were analysed using content analysis. A coding sheet was created following a discussion among the primary investigator and supervisors (PB and CH.). Transcripts were read carefully and a summary of meaning units was generated and reduced into codes. Codes were then transferred to the coding sheet, and similar codes were gathered under sub-categories. A category scheme was then developed to group similar sub-categories together. Finally, themes that connect the various categories were identified.
Credibility was enhanced by the heterogeneous sample and by performing member check, and using field notes. Dependability was established by having the primary investigator and two experienced researchers review the coding process and agree on the analysis. Confirmability was addressed through constant dialogue among the researchers. Finally, authenticity was ensured by using icebreakers to establish a trusting relationship with the participants and get them to openly discuss their experiences.
Medical teachers’ evaluation results
Medical teachers’ perceptions for VPs’ design, use and adoption in curriculum
The design process of a virtual patient contributes to:
Table N %
Deeper knowledge of the disease
Better memorization of key points.
Increase of gaining knowledge
Support of the educational experience, since it could be considered equal to training with real patients.
Clinical skills development through training in decision making.
Clinical skills development through proper virtual patient management.
Medical teachers’ views on the VP design process and implementation
Table N %
Do you consider that the virtual patient design process corresponds to your IT level of knowledge?
Did the virtual patient design process increase the team spirit?
Do you think it would be possible to implement this method in other fields?
Themes and Representative Quotations of Positive and Negative Medical Teachers’ Experiences with Virtual Patients
Examples of positive codes
Examples of negative codes
Major Theme (1) Educational aspects of VP use (159)
Subtheme (1a) Clinical Care of patient (34)
1.Clinical Efficiency (10)
“It makes the virtual visit go smoother…I take notes and prioritize knowledge… I don’t have to flip through a huge scenario” n = 8
“The doctor spends too much time” n = 2
2.Case review (24)
“I can go back and look at important test results” n = 23
“There are ECHO reports, but it seems like I don’t find where there are in the scenario” n = 1
Subtheme (1b) Learning effect of the VP (55)
1.Facilitation of knowledge (11)
“The case and virtual trainer was asking me questions to verify and make sure everything is correct” n = 10
If they used some graphs or charts, I might say that was more effective” n = 1
2.Medical history (23)
“I had easy access to the vp history at my convenience” n = 21
“There are inaccuracies in at each scenario node I go to, they’re not always updating it” n = 2
3.Assessment of knowledge (21)
“I think that learning with the virtual patients is important in order to do well in the final exam for this course” n = 17
“It does not make you feel secure enough” n = 4
Subtheme (1c) Information Access (40)
1.Accessibility of information (20)
“…with these records online I have easier access” n = 19
“Sometimes the computer doesn’t work and I can’t access information.” n = 1
2.Suitable information (20)
“Every node included information as in real life patients” n = 19
“Some links to nodes were linked to inappropriate information” n = 1
Subtheme (1d) Quality of educational resource (30)
1.Authenticity of patient encounter (16)
“While working on this case, it was like I had to make the same decisions a doctor would make” n = 15
“I didn’t feel like being a real the doctor caring for a real patient” n = 1
2.Professional approach (14)
“I was gathering the information I needed, to characterize the problem” n = 12
“It was difficult to think which findings supported or refuted each diagnosis” n = 2
Major Theme (2) Communication aspects of VP use (59)
Subtheme (2a) Students engagement (37)
1.Use of media material (21)
“Videos add realism in the scenario and makes you want to visit quickly the next step” n = 20
“Avatars make it seem fake…better with real patients” n = 1
2.Facilitate the user discussion (12)
“You can talk and look at results together in the computer…” n = 8
“Everybody may work alone in front of a PC” n = 4
3.Student questions (4)
“Students might have questions for the teacher that might forget, but going through the VP together may help them to remember their questions” n = 3
“They may read what’s on the screen and forget to say something” n = 1
Subtheme (2b) Student collaboration (22)
1.Ideas sharing (13)
“Students can discuss on several different decision pathways each scenario includes” n = 9
“VPs may not discuss if it used as a self learning process” n = 4
2.Social presence (9)
“You feel like part of a ‘community’ during the corresponding teaching events.” n = 6
“Someone may feel insecure to openly share shortcomings” n = 3
An important feature that helps in increasing motivation was reported to be the part of media resources, since they add extra value and interactivity to the clinical cases, resulting in more attractive and interesting learning scenarios to trainees. For example it was mentioned “These media files will make the VP very attractive to trainees! They will feel like playing a game with avatars”. Besides, multimedia material was mentioned to add realism to VPs and contribute to a more thorough presentation of clinical cases, leading to better memorization of the diagnostic process. Thus, the optimal use of media adds authenticity and better memorization of clinical conditions.
Another important issue that was highlighted on top of that, however, was that VP design is time and effort consuming and needs, even basic, IT knowledge and support. It was also sporadically mentioned were that VPs as educational objects lack the ability for real contact between instructor and learner and, as far as the design process is concerned, there is a need for a stock of media material for the proper VP creation, thereby indicating the need for VP repurposing and reusing.
Medical students’ evaluation results
The medical student population included both male (61.20%) and female (38.80%) participants.
Student answers concerning their opinion concerning the integration of VPs in the medical curriculum with regard to sex and year of study
Year of study
Would you like VPs to be integrated in the medical curriculum?
1st- 2nd year
Furthermore, male participants of the first 2 years of study rated their educational experience with VPs with a mean of 5.55 in a scale 1–6, while female students of the same years of study rated their educational experience with a mean of 3.08 in the same scale. Moreover, male and female postgraduate and PhD students rated their educational experience with about the same value that slightly exceeds 5.13. Similarly, males aged under 25 evaluated their experience with a mean of 5.33 and females aged under 25 with a mean of 3.86. These lead to the conclusion that male young students of the pre-clinical years of study show a significant preference in VPs as learning objects, in comparison to their female mates.
Going a step further, it can be easily seen from the results of all participants (Table 4) that students of the pre-clinical years show a high preference in the adoption of VPs as learning activities. That could be explained from the lack of any clinical contact with real patients in their two first years of study and their willingness to have early, even virtual, clinical encounters. At the same time, there is a decrease of interest for VPs’ curricular adoption in the next years of study, something that is reversed again in the last (6th) year of study. This is the time when medical students often desire to expand their clinical experience and practical skills acquisition, since they will soon be active members of the healthcare workforce.
Student preferences concerning the ways of integration of VPs in the medical curriculum
Additional learning activity
Additional tool for practice before exams
Tool for clinical skills acquisition before real clinical contact
With the increasingly widespread adoption of VPs, there exist potential pedagogic synergies to allow trainees the opportunity to practice in realistic and safe learning environments. The results of this study are consistent with findings from other studies of VP adoption  and even though the number of experimental studies investigating the utility of VPs is limited, these matching results are positive and encouraging .
Considering the likelihood that technology will grow increasingly sophisticated and costly, we have to be thoughtful about how limited, available resources are used, and we should strive in unison towards improving the education of our future physicians . The promise of VPs as a method of enhancing the process of clinical skills reasoning has greatly impacted health professions education. At the same time, the opposing forces of increased training expectations and reduced training resources increase the need for future VP developing institutions to consider the role of VPs in the educational armamentarium. Thus, since few academic institutions can afford to develop VP cases, one solution is the development of virtual online communities where resources are shared, repurposed and reused [18, 25].
In the light of our results concerning the VP design, medical teachers seem to be able to develop and edit highly interactive VP cases with comparatively little assistance from computer specialists. Additionally, the process of VP design and development itself provides them the opportunity of further deepening in clinical knowledge and clinical reasoning. The VP creation and implementation process in medical curriculum can also serve as a means for collaboration between medical teachers of the same or different medical specialties and contribute to sharing understanding in health care education.
In terms of the research questions of this study, as far as the propensity of medical teachers and students to use VPs and moreover the implementation and formal integration in the medical curriculum, current VPs seem to fulfill most needs from course directors and teachers from various educational disciplines and medical specialties, while they seem to satisfy student needs and perceptions of improved knowledge and clinical skills reasoning. At the same time, concerning the preferences of VP utilization, the virtual clinical encounters used in this study appear to be particularly well suited for learning and assessment purposes for medical students, who have had limited or no significant clinical contact. Therefore, medical teachers and students, as well, propose a strategic development and use of VPs in underrepresented topics, especially in pre-clinical medical education, since they may motivate a more widespread integration of VPs into medical education .
As far as the exploitation of the advantages and disadvantages of VP integration and user experience, the results of this study suggested that the VP learning effect, the contribution to the better clinical care, the better access and the quality of the education resources seem all to support the formal integration of these learning objects to the medical curriculum.
We have to mention that in our case, VP scenarios were not part of the core curriculum, but were actually used as supplementary materials to the formal curriculum. Maybe they would be regarded differently by faculty and learners if they were considered part of the core curriculum.
The creation of additional clinical competency cases for both preclinical and clinical years of study including questions and explanations tailored to the critical-thinking that would allow learners the opportunity to explore the consequences of clinical decisions are highly recommended from both medical teachers and students. In addition, wider development of VPs in other disciplines, such as acute care and surgery, would result in a comprehensive body of cases to complement the entire clinical curriculum. Such a development of the VP instruction model would encompass the progression dimension across a whole medical curriculum, where VPs are present in all curricular semesters in an effort to aid the integration of theory and practice aligned by findings in others studies .
This study indicates issues that are deemed highly important for the exploration of the VP usefulness in medical education when issues of development and implementation of VPs are considered. Medical educators are usually encountered with a plethora of educational challenges when asked to transform curricula, or develop PBL cases and courses, or promote independent and active learning. As new technology becomes more widely available for educational purposes, medical educators often take existing training material and simply transcribe it into the new technological medium [28, 29], without considering the yielding of insights upon effective repurposing and curricular incorporation of these educational resources. Recent studies have made efforts to focus on the successful systematic repurposing effort of VPs and their findings are deemed pivotal in an era where open educational resources are transferred to and shared among learners and educators, of various open repositories . Another perspective highlights the use and repurposing of Massive Open Online Courses (MOOCs) extended with VPs, an option that may foster medical skills such as decision making, according to recent studies’ results that have brought insights into the potential benefits, threats, and challenges of MOOOCs and VPs .
Efficient educational strategies including current trends in technology and curricula that improve the quality of the medical education system should be widely developed and thoroughly adopted, according to both medical teacher and student perceptions. This will be a very rewarding experience both for those who deliver these educational courses, as well as, for the recipients of such training. Effective teaching using VPs would be beneficial to be set and formally embedded in the medical curriculum. At the same time, a number of remaining issues regarding VPs design, authenticity and implementation need to be fulfilled, in order to reach the potential educational goals of such applications. That way, VPs’ integration in the medical schools, along the lines of innovation and continuous quality improvement and extensive use of analytics , are likely to further the medical school as a learning organization with the attendant benefits.
A part of this study included qualitative description. Qualitative description is often criticized for lacking rigour. For this reason, a number of strategies were employed to enhance trustworthiness. Moreover, sampling from a heterogeneous pool of participants (medical teachers of various specialties and medical students of various ages and years of studies) increases the risk for selection bias and makes the comparison of findings difficult.
We present the results of a combined evaluation of transforming the medical curriculum with VPs’ adoption from both medical teachers’ and students’ perspective. In the face of compelling evidence [13, 32, 33], like those arising from the current study, VPs are effective for teaching and assessment.
The results of this study document high acceptance of VPs by both medical teachers and students, since it is evident that they perceive VPs as an excellent learning tool in undergraduate and postgraduate curriculum. The content of these VP cases has already been repurposed and shared in different educational contexts aiming at a wider adoption of VPs’ integration in medical education .
At the same time, important questions that remain on the optimal design, use and integration of VPs should be addressed in order to adequately inform future development. Potential variations in VP design are practically limitless and more research is needed to inform instructional design and curricular integration, so as VPs to be effectively adapted to the needs of potential users and instructors . Future efforts may focus on defining new strategies to integrate traditional types of teaching with the use of VPs in both pre-clinical and clinical curricula. Research should focus on determining ideal topics and learning outcomes in VPs in medical education, identifying optimal exposure to these unique learning content items and addressing the limitations at the same time. Research should also infer if the resulting changes and techniques indeed improve the efficacy of students’ performance, in addition to determining whether VPs in education and assessment have a role to play in mitigating the real clinical skills needed for future doctors.
During the last few years, VPs have become more widely available and easier to create, driven both by student and teacher interest and by recognition of their pedagogic value . Under this perspective, further VP implementations at several medical schools in different universities should be planned to have their role in the curriculum defined and gather useful insights on the factors that make various types of VP curriculum implementations successful. The pace of technological development  and the drive to incorporate VP simulations into the curriculum threatens to out-strip our understanding of how they can be used most effectively. If we are to avoid this, we must proceed on a firm basis of an educationally sound designed  rigorous evaluation of learning cost-effectiveness, and, above all, provision of adequate training for teaching staff, so as to provide the potential for valid, cost-effective teaching and assessment of clinical skills of medical students. To this extent, this piece of work provides useful and unprecedented insights towards the success of such exercises by academic institutions [39, 40], since it provides a doubled-sided evidence (from both student and teacher perspectives) obtained from a piece-wise but pragmatic application of VP adoption within a medical curriculum. More insights from such exercises are expected in future years as institutions shift emphasis from traditional teaching to problem based learning encounters [41, 42].
We would like to thank the medical students from Aristotle University of Thessaloniki for participating in the research study.
ED made substantial contributions to conception and design, acquisition and interpretation of data, has been involved in drafting the manuscript and has given final approval of the version to be published. IF made substantial contributions to the acquisition, analysis and interpretation of data, has been involved in drafting the manuscript and has given final approval of the version to be published. CH made substantial contributions to conception and design, has revised critically the manuscript and has given final approval of the version to be published. PB made substantial contributions to conception and design, has been involved in revising the manuscript critically for important intellectual content and has given final approval of the version to be published.
The study was self funded by the Aristotle University of Thessaloniki.
Ethics approval and consent to participate
The Bioethical Committee of the Aristotle University of Thessaloniki approved this study (reference no. 1/22-12-2011). The participants were provided with written information on the purpose of the study. No written consent was needed: consent was implied by filling in the questionnaire.
Consent for publication
The authors declare that they have no competing interests.
- 6.Hege I, Kononowicz AA, Berman NB, Lenzer B, Kiesewetter J. Advancing clinical reasoning in virtual patients - development and application of a conceptual framework. GMS J med Educ. 2018;35(1):Doc12.Google Scholar
- 8.Association of American Medical Colleges (AAMC) 2007. Effective Use of Educational Technology in Medical Education. Colloquium on Educational Technology: Recommendations and Guidelines for Medical Educators. Retrieved January 8, 2017. Available from: https://www.ttuhsc.edu/som/curriculum/documents/ForOurTeachers/aamc_effective_use_of_educ_tech.pdf
- 9.Kononowicz A, Zary N, Edelbring S, Corral J, Heg I. 2015. Virtual patients - what are we talking about? A framework to classify the meanings of the term in healthcare education. BMC medical education 15:11. On line available from: http://www.biomedcentral.com/1472-6920/15/11
- 10.Zary N, Johnson G, Boberg J, Fors U. 2006. Development, implementation and pilot evaluation of a web-based virtual patient case simulation environment – web-SP. BMC medical education 6:10. On line available from: http://www.biomedcentral.com/1472-6920/6/10/
- 16.Kononowicz A, Woodham L, Georg C, Edelbring S. Cochrane database of systematic reviews, ISSN 1469-493X, E-ISSN 1469-493X, no 5, article id CD012194; 2016.Google Scholar
- 17.Bamidis P, Kaldoudi E, Pattichis C. 2009. mEducator: a best practice network for repurposing and sharing medical educational multi-type content leveraging knowledge for innovation. in Camarinha-Matos LM, Paraskakis I, Afsarmanesh H editors, Leveraging knowledge for innovation in collaborative networks. Berlin: Springer Berlin Heidelberg 2009. p.769—776.CrossRefGoogle Scholar
- 18.Nicolaidou I, Antoniades A, Mylläri J, Giordano D, Dafli E, Schizas C, Constantinos P, Nikolaidou M, Spachos D, Bamidis P. 2012. Scenario-based evaluation for user testing of medical educational content-sharing solutions. In proceedings of the 6th International Technology, Education and Development Conference, 5–7 March, 2012, Valencia, Spain, 2619–2626. ISBN: 978-84-615-5563-5.Google Scholar
- 19.OpenLabyrinth. Virtual scenarios and education research. Retrieved February 11, 2019. Available from: http://openlabyrinth.ca/
- 21.DePoy E & Gitlin L. 2013. Statistical analysis for experimental-type research. In: introduction to research. Understanding and applying multiple strategies. Gower J, Westbrook L (eds.). Mosby, Elsevier health sciences, Inc.: Missouri, USA.Google Scholar
- 22.eViP. Published evaluation instrument for Virtual Patients and for learning and teaching activities with Virtual Patients 2015. Retrieved September 15, 2017. Available from:http://www.virtualpatients.eu/wp-content/uploads/2009/06/evip_evaluation_tool_form1_student_questionnaire_VPs.pdf
- 27.Poulton T. 2015. Hot topics in eLearning and Distance Learning. In proceedings of the 2nd International Conference on Medical Education Informatics – MEI 2015, 18–20 June, 2015, Thessaloniki, Greece. On line available from: http://mei2015.camei-project.eu/content/hot-topics-elearning-and-distance-learning
- 40.Antoniades A, Nicolaidou I, Spachos D, Mylläri J, Giordano D, Dafli E, Mitsopoulou E, Schizas CN, Pattichis C, Nikolaidou M, Bamidis P. Medical content searching, retrieving, and sharing over the internet: lessons learned from the mEducator through a scenario-based evaluation. J Med Internet Res. 2015;17(10):e229.CrossRefGoogle Scholar
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.