Abstract
Background
Training next-generation personnel from small/medium enterprises (SMEs) is an urgent issue in promoting medical device research and development (R&D). Since 2014 we have engaged in governmentally funded human resource development program for medical/non-medical SMEs, and have assessed its effectiveness by analyzing self-evaluation of achievement level (SEAL) data obtained before and after the training course.
Methods
Human resource development experts interviewed 34 key opinion leaders with deep knowledge of medical device R&D from industry, government, and academia. The skills required for R&D personnel were written down, and a set of skills was created by making a greatest common measure in the list of common elements among them. Using that skill sets, skill evaluations were conducted on trainees at “Osaka University Training Course,” twice before participation and after completion of the entire program using SEAL assessment.
Results
There were 97 men and 25 women, with one-third in the’30 s. Among them, 61 participants (50%) were from R&D divisions, and 32 (26%) were from business/sales divisions. 94 (77%) were from medical SMEs, and 28 (23%) were from non-medical SMEs (new entry). After completing the training course, significant growth was observed in every item of both Soft and Hard skill sets. Especially in new entry SME members, a striking improvement was observed in practical medical knowledge to enhance communication with medical doctors (p < 0.0001).
Conclusion
Our training course, though 7-day-short in total, showed that both Soft and Hard skills could be improved in young medical/non-medical SME members. Further assessment is needed to establish the necessary skill sets for our future partners from industries, to foster the creation of innovative medical devices through med-tech collaboration.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Physicians identify almost all unmet needs in the clinical field, yet it’s the business professionals who actualize these needs into tangible research and development (R&D) endeavors in the medical devices [1,2,3,4,5]. The challenge? Most physicians aren’t entrenched in the design, manufacturing, or business aspects. Therefore, the industry’s answer has been to train “development personnel” adeptly for medical device R&D [6].
While global institutions like Stanford University’s Biodesign Program or Minnesota’s Medical Device Innovation Experience for Undergraduates (MDIEU) focus on intensive, prolonged courses [7,8,9], Japan has innovatively veered in different direction.
The Japan Agency for Medical Research and Development (AMED) launched “Human Resource Development Project” in 2014. We Osaka University, since its inception, has device our original course for personnel from small/medium enterprises (SMEs), conducting R&D skill mastery into mere weeks. Uniquely, no other course globally offers such a compact curriculum. Now, with our bespoke “skill evaluation system,” we’re set to validate this novel approach.
In our original training courses, we aimed to (1) identify essential skills for “development personnel” and establish a “skill evaluation system,” and (2) assess the effectiveness and improvement of our course through this system. Our study evaluates skill enhancement in our unique, concise training program.
Methods
Identification of required skill sets and establishment of a skills assessment system
In the early stage of the project (first or second year of the program), we first worked on the establishment of a skill evaluation system. Human resource development experts interviewed 34 key opinion leaders (KOLs) with deep knowledge of medical device R&D from industry, government, and academia (Table 1). This is separate from the participants who took part in the Osaka University Training Course. The skills required of medical device R&D personnel [10] were written down, and a set of skills was created by making a greatest common measure in the list of common elements among them (Fig. 1).
Skill assessment before/after the training course using a skill assessment system
To evaluate the efficacy of human resource development, we utilized the skill sets identified in Method 1, skill evaluations were conducted on participants at “Osaka University Training Course,” twice: before participation and after completion of the entire program, using a self-scoring system “self-evaluation of achievement level” (SEAL). To ensure consistency and enable a direct comparison of the participants’ skills before and after the training, the same questionnaire was used for both pre-training and post-training evaluations (Fig. 2).
Osaka University Training Course
This is a 7-day training course consisted of 4 programs: 2 days of seminars, 3 days of clinical immersion, 1 day of round table ideation workshop, and 1 day of interactive symposium.
Seminars
Faculty members gave lectures on broad topics, e.g., an overview of the medical device business, needs finding, regulatory processes, quality management system (QMS), marketing, and intellectual property (IP) issues. Active surgeons from Osaka University Hospital also talked about basic anatomy, some technical terms, and topic, e.g., the current situation of operating room (OR). We also organized “hands-on” seminars for attendees to touch actual medical devices (Fig. 3a).
Clinical immersion
Over a period of three days, segmented into morning and afternoon sessions, we embarked on a comprehensive hospital tour (Fig. 4). The participants were then allowed to go into deeper areas of the hospital, e.g., the backyard of the outpatient clinic, the endoscopy suite and its inventory area, examination rooms, and OR. With the collaboration of the subspecialty teams, we had the opportunity to observe cases in gastroenterological, obstetrics and gynecology, and pediatric surgery. Our exploration further led us to the radiology department, specifically the IVR center, and the emergency medical center. The primary focus of our tour was departments utilizing medical equipment. Care was taken to ensure our presence did not interfere with any ongoing treatments, and we endeavored to expose our participants to a wide array of medical scenarios. At the end of each immersion day, surgeons and attendees had a one-hour wrap-up session to discuss their insights and questions (Fig. 3b).
Round table ideation workshop
The trainees were divided into several teams based on their professions, age, gender, etc. This team division was carefully conducted under the supervision of the program director to create intragroup “diversity.” Each team was attended by one physician from Osaka University Hospital, and one professional facilitator. Raw ideas and rough insights were once spread and consolidated using the latest facilitation methodology (Fig. 3c).
Interactive symposium
The above achievements were presented by faculty members and participants at half-day symposia. A special session was programmed to discuss “how to facilitate the idea output process.” (Fig. 3d).
Evaluation of participant’s impressions
A structured questionnaire was provided to gauge the participant’s impression to each segment of the course: satisfaction, somewhat satisfied, somewhat dissatisfied, complain (Fig. 5).
Statistical analysis
The SEAL data were prospectively compiled and retrospectively analyzed. The statistical analyses were performed using the software package (JMP version 16.0.0, SAS, Cary, NC, USA). The results were presented as average ± standard deviation. Student’s t-test or paired-samples t-test were used to compare continuous variables, respectively. All values were two-tailed, and p values of < 0.05 were considered statistically significant.
Results
For the third through fifth years of the AMED training program, a total of 122 participants from 50 companies took part in the Osaka University Training Course, separate from the 34 key opinion leaders interviewed. The breakdown was 97 males and 25 females, 94 (77.0%) were in the medical field, 28 (23.0%) were non-medical (new entry). 12 (9.8%) were in management, 61 (50.0%) were in development, 20 (16.4%) were in sales divisions, and 29 (23.8%) were in other industries (Fig. 2).
Identification of required skill sets and establishment of a skills assessment system
As a result of interviews with 34 KOLs and data analysis, a total of 138 skills were listed and 36 of them were determined to be essential skill sets as common denominators. These skills were divided into two subsets: 11 “Hard skills” that could be mastered through classroom lectures, books, video materials, etc., and 25 “Soft skills” that are difficult to master through classroom lectures and books, such as communication skills with doctors and leadership skills within a team, and can be improved mainly through experience (Table 2).
Skill assessment before/after the training course using a skill assessment system
Table 3 show how each skill item changed before and after the course. Both the overall score, Soft skills and Hard skills showed significant improvement after completion of the entire program compared to before participating in the course. Each subgroup also showed significant improvement after completion of the entire program compared to before participating in the course (Table 3).
Evaluation of participant’s impressions
Figure 6 presents the aggregated feedback from participants across the seminar, clinical immersion, and needs assessment sessions. The data reveals that about 70% of participants expressed satisfaction with both the seminar and clinical immersion, while an additional 30% indicated they were somewhat satisfied. For the needs assessment session, satisfaction was even higher, with approximately 80% of participants expressing satisfaction and 20% being somewhat satisfied. These results underscore the overall positive reception and effectiveness of the training modules.
Discussion
The starting point for medical device R&D is the medical field, and for this reason it is believed that physicians occupy an important position as a main player, but in reality, the role played by industry personnel is no less significant. What is especially needed are industry personnel who have a common language with physicians and can discuss issues on an equal footing. In the real world, there is a big gap between doctors and industry people. Industry people tend to take doctors at their word and accept without questioning [11]. They are unable to actively express their opinions and tend to be passive in discussions with doctors, who are medical professionals [12]. As a result, they are often greatly influenced by the opinions of physicians and sometimes mislead. It goes without saying that in order for both sides to be able to have fair discussions on an equal footing as much as possible, it is necessary for physicians to be “more accommodating to the industry side,” but industry people must also master basic medical knowledge (Hard skills) and acquire the Soft skills to communicate with physicians as professionals or specialists.
The gap that hinders the R&D of medical devices is not limited to the gap between physicians and industry people, but actually exists within their companies as well. Even within the companies, there is often a lack of communication between designers/engineers working in the design/development divisions and the business people in charge of commercialization. In other words, there are often cases where the development side lacks understanding of regulations and the commercialization process, and the business side lacks sufficient understanding of the true significance of the developed product. The business people who lead medical device R&D need not only knowledge of regulations, QMS and IPs (Hard skills), but also Soft skills are required, such as coordinating opinions, exercising leadership, and coordinating with physicians across gaps in job types and divisions within the company or development team to which they belong.
Until now, there has been a vague understanding that industry personnel engaged in medical device R&D are required to have these skills, which are classified as Hard skills and Soft skills, but the specifics of the skill sets had not been clarified. We succeeded for the first time in “visualizing” the contents of this “invisible” skill set, and in constructing a “skill evaluation system” based on these skills. Using this system, we have also demonstrated for the first time that both Hard and Soft skills can be improved through an intensive program that combines seminars, group learning, and presentations with clinical practice at its core, even in a very short period of time (one week in total).
Although our training course was extremely short, it was reasonably effective. What was particularly unexpected was that not only Hard skills but also Soft skills improved in a short period of time. The reasons for this can be attributed to the following: (1) about half of the course (3 days) was devoted to clinical immersion, during which participants were closely followed by physicians from several departments, allowing them to focus on observing and thinking about the field from their own perspective; (2) physicians were always present during programs other than training and always engaged in close dialogue with the participants, which allowed them to engage in discussions without hesitation; (3) the course was designed to be a “hands-on” experience for the participants. (4) The latest design thinking process was introduced in the ideation workshop so that participants could experience the diffusion and convergence process of ideas under the supervision of a professional facilitator. This helped them to develop confidence in their ability to carry out the mission of developing medical devices, which seemed to be a high hurdle to overcome. (5) To improve Hard skills, an original glossary of medical terminology was created and video materials (e-learning) were produced for quick learning, so that busy industry people could complete the course without losing motivation.
Industry people engaged in the R&D of medical devices should make every effort to improve these Hard and Soft skills to narrow the gap with physicians as much as possible. Our study suggests that a very short “human resource development course” for this purpose would be reasonably effective. But is it enough? Of course not. Doctors must also be more accessible to the industry side. In some cases, it may be effective for physicians to enter the industry side (become an industry person). In fact, in Europe and the States, human resources are highly mobile, and there are many cases of physicians taking the lead in development at medical device manufacturers and other companies. There are also many doctors who start up their own businesses. In Japan, on the other hand, doctors live only in the medical world, while business people live only in the corporate world, and there is almost no interaction between the two. This rigid situation (low mobility of human resources) may be one of the reasons for the 1 trillion yen excess of imports of medical devices in Japan.
Now, whether or not our human resource development course was truly effective for medical device R&D, should be judged not only by whether or not the participants' skills improved, but also by whether or not a new medical device R&D project was actually started and, by extension, whether or not a real medical device was completed and released to the market (implemented in society) [13]. In reality, it is not easy to judge these true outcomes of this project, since these processes require a long period of in-depth follow-up to confirm the results. We were not able to confirm such a long-term process in this case. It is thought that it may have been possible to identify, albeit indirectly, what skills were acquired through SEAL. However, it is impossible to know whether human resources were truly developed. Skills may have been improved, but it is not clear whether those skills really contributed/lead to medical device R&D. However, several companies that participated in our course have confirmed that they have started medical device R&D in collaboration with universities, launched in-house development projects, and so on. We believe that the course we have established is not only improving the skills of individuals, but is also promoting medical device R&D itself.
There are several limitations in our study. First, we have not been able to evaluate the validity of the skill evaluation system itself. Although KOLs of medical device R&D in Japan participated in the composition of the skill assessment system, we have not been able to evaluate its validity. The second is that the scoring of the skill assessment was self-scoring (SEAL). Although skill assessments should ideally be administered by others, many of the content was difficult or virtually impossible for others to assess. Therefore, self-assessment was employed in this study. In the future, the development of a scoring system by a third party will be required. The third is that our study is retrospective. We examined the assessment of whether the skills were improved backward rather than forward looking. Lastly, our course was free as it was an AMED-subsidized project. We anticipated the possibility that free of charge would lead to a bias against participants, resulting in lax evaluations and motivation. In the future, the issue will be how similar courses are evaluated by participants in self-sustaining projects that charge a certain participation fee. We have clarified our data presentation for transparency and highlighted our study's unique advantages. However, we acknowledge the limitations, especially the reliance on self-assessment. While our study provides evidence of skill enhancement through consistent pre- and post-training evaluations using the same questionnaire, we recognize the potential limitations and biases that might arise from self-assessments. Future iterations of this research could benefit from incorporating diverse assessment tools to provide a more comprehensive understanding of the skills acquired and areas of improvement.
Conclusion
We have successfully implemented a very short training program for industry personnel who will engage in medical device R&D. Though 1-week short, our program showed reasonable effectiveness in improving their skills. While our findings suggest the effectiveness of our ultra-short training program, we recommend future studies to incorporate detailed pre-and-post training surveys to further validate and understand the nuances of human resource development in the context of medical device R&D. Similar efforts need to be further utilized to promote medical device R&D in the future.
References
Ni Q, Pu Y (2009) Career development of biomedical engineers in medical device industry. Annu Int Conf IEEE Eng Med Biol Soc 2009:149–150
Privitera MB, Design M, Johnson J (2009) Interconnections of basic science research and product development in medical device design. Annu Int Conf IEEE Eng Med Biol Soc 2009:5595–5598
Jenkins KJ, Beekman RH, Vitale MG, Hennrikus WL, Minich LL, Ackerman MJ, Berger S et al (2017) Off-label use of medical devices in children. Pediatrics. https://doi.org/10.1542/peds.2016-3439
Antonini M-J, Plana D, Srinivasan S, Atta L, Achanta A, Yang H, Cramer AK, Freake J, Sinha MS, Yu SH et al (2021) A crisis-responsive framework for medical device development applied to the COVID-19 pandemic. Front Digit Health. https://doi.org/10.3389/fdgth.2021.617106
Dimitri P, Pignataro V, Lupo M, Bonifazi D, Henke M, Musazzi UM, Ernst F, Minghetti P, Redaelli DF, Antimisiaris SG et al (2021) Medical device development for children and young people-reviewing the challenges and opportunities. Pharmaceutics. https://doi.org/10.3390/pharmaceutics13122178
Schwartz JG, Kumar UN, Azagury DE, Brinton TJ, Yock PG (2016) Needs-based innovation in cardiovascular medicine: the stanford biodesign process. JACC Basic Transl Sci 1(6):541–547
Yock PG, Zenios S, Makower J, Brinton TJ, Kumar UN, Watkins FTJ, Denend L, Krummel TM, Krihera CQ (2015) Biodesign: the process of innovating medical technologies, 2nd edn. Cambridge University Press, Cambridge
Wall J, Wynne E, Krummel T (2015) Biodesign process and culture to enable pediatric medical technology innovation. Semin Pediatr Surg 24(3):102–106
Yock PG, Brinton TJ, Zenios SA (2011) Teaching biomedical technology innovation as a discipline. Sci Transl Med 3(92):92cm18
Krishnan S (2013) Promoting interdisciplinary project-based learning to build the skill sets for research and development of medical devices in academia. Annu Int Conf IEEE Eng Med Biol Soc 2013:3142–3145
Kampfrath T, Cotten SW (2013) The new collaborative path in medical device development: the medical device innovation consortium. Clin Biochem 46(15):1320–1322
Linehan JH, Chaney A (2010) Academic/industry challenges for medical device development. Sci Transl Med 2(63):63mr66
Eberhardt AW, Johnson OL, Kirkland WB, Dobbs JH, Moradi LG (2016) Team-based development of medical devices: an engineering-business collaborative. J Biomech Eng 138(7):0708031–0708035
Acknowledgements
The work was presented at the 31st International Congress of the European Association for Endoscopic Surgery (EAES) in Rome, Italy, June 22nd, 2023. The authors thank everyone who were involved in our program.
Funding
Open access funding provided by Osaka University. This work was partially supported by MHLW Research on Development of New Medical Devices Program Grant Number JPJ002986, 2014. This research is also supported by the Japan Agency for Medical Research and Development (AMED) under the Project to Build Foundations to Support and Incentivize Development of Medical Devices Made in Japan (JP15hk202001j0002), 2015–2018 and Support Program on Collaborative Innovation Networks for Medical Device (JP19hk0402013j0001), 2019–2023.
Author information
Authors and Affiliations
Contributions
KN conceived and designed the study. YT and YU conducted data collection and wrote the initial draft of the manuscript. KN contributed to data interpretation and critical manuscript revision for important intellectual content. All the authors (YT, YU, TK, MS, TH, MH, HE, YD and KN) have read and approved the final version of the manuscript and have agreed to the accountability of all aspects of the study, ensuring that any queries related to the accuracy or integrity of any part of the work are answerable.
Corresponding author
Ethics declarations
Disclosures
All the authors (Yumi Tsugita, Yuki Ushimaru, Takamitsu Kato, Motoki Sasaki, Taishi Hata, Makoto Hosaka, Hidetoshi Eguchi, Yuichiro Doki and Kiyokazu Nakajima) declare that we received no compensation for this research and certify that there are no conflicts of interest. However, it should be noted that some authors are affiliated with the institution that provides the course and have had roles in teaching or development of the course. We assure that this did not influence our study’s findings.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Tsugita, Y., Ushimaru, Y., Kato, T. et al. Efficacy of human resource development program for young industry personnel who will be involved in future medical device development. Surg Endosc 37, 9633–9642 (2023). https://doi.org/10.1007/s00464-023-10474-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00464-023-10474-3