Development of a Scale for Measuring Students’ Attitudes Towards Learning Professional (i.e., Soft) Skills
Employers lament that science graduates, particularly engineering students, lack professional skills, despite increasing emphasis on teaching professional skills in their curriculum. Using the Theory of Planned Behavior as an overarching framework, one explanation for skill development gaps may be students’ attitude towards learning professional skills. Our study purpose was to create a scale that accurately and consistently measures engineering students’ attitudes towards learning professional skills. To create the scale, we used a rigorous measurement development methodology, beginning with survey item generation and critical review by subject matter experts. Data from a sample of 534 engineering college students were split into two sets to provide (1) a development sample upon which exploratory factor analyses and parallel analyses were conducted to form the initial scale, and (2) a confirmatory sample whereby we verified the scale structure and obtained initial validity evidence for distinct dimensions. A five-factor scale of 25 items for assessing engineering students’ attitudes towards learning professional skills (ATLPS) obtained high-reliability estimates. Validity evidence supported five distinct dimensions in leadership in teams, communication, civic and public engagement, cultural adaptability, and innovation. The ATLPS can be used to facilitate improvements in engineering education and research by understanding students’ attitudes towards learning professional skills. Furthermore, researchers can expand the scale to include additional dimensions of professionalism and modify items to fit STEM disciplines where professional skill training is essential.
KeywordsAttitudes Professional skills Scale development STEM Engineering
We would like to thank Alma Rosales and Alistair Cook for their early contributions to portions of this project, as well as Tom Siller and Anthony Maciejewski for suggestions on earlier versions of this manuscript.
This work was supported in part by the National Science Foundation, Engineering Education and Centers, under Grant EEC-1519438.
- American Educational Research Association, American Psychological Association, and National Council on Measurement in Education (US) (2014). Standards for educational & psychological testing.Google Scholar
- American Society for Engineering Education (2013). Transforming undergraduate education in engineering: Phase I: Synthesizing and integrating industry perspectives. Retrieved from https://www.asee.org/TUEE_PhaseI_WorkshopReport.pdf.
- Areni, C. S., & Lutz, R. J. (1988). The role of argument quality in the Elaboration Likelihood Model. Advances in Consumer Research, 15(1), 197–203.Google Scholar
- Baytiyeh, H., & Naja, M. K. (2010). Impact of college learning on engineering career practice. ASEE/IEEE Frontiers in Education Conference in Washington, D.C. https://doi.org/10.1109/FIE.2010.5673241
- Besterfield-Sacre, M., Atman, C. J., & Shuman, L. J. (1998). Engineering student attitudes assessment. Journal of Engineering Education, 87(2), 133–141. https://doi.org/10.1002/j.2168-9830.1998.tb00333.x.CrossRefGoogle Scholar
- Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York: Guilford Press.Google Scholar
- Chiang, F.-K., Wuttke, H., Knauf, R., Sun, C.-S., & Tso, T.-C. (2009). Students’ attitudes toward using innovative information technology for learning based on theory of planned behavior. International Journal of Advanced Corporate Learning, 2(4), 9–14. https://doi.org/10.3991/ijac.v2i4.969.Google Scholar
- Cialdini, R. B., Petty, R. E., & Cacioppo, J. T. (1981). Attitude and attitude change. Annual Review of Psychology, 32, 357–404. https://doi.org/10.1146/annurev.ps.32.020181.002041.CrossRefGoogle Scholar
- Conway, J. M. (2002). Method variance and method bias in industrial and organizational psychology. In S. G. Rogelberg (Ed.), Handbook of research methods in industrial and organizational psychology (pp. 344–365). Malden: Blackwell Publishing.Google Scholar
- Crawford, A. V., Green, S. B., Levy, R., Lo, W., Scott, L., Svetina, D., & Thompson, M. S. (2010). Evaluation of parallel analysis methods for determining the number of factors. Educational and Psychological Measurement, 70(6), 885–901. https://doi.org/10.1177/0013164410379332.CrossRefGoogle Scholar
- Davidson, R. J., Gray, J. A., Lazarus, R., Rothbart, M. K., & Ekman, P. (1994). How do individuals differ in emotion-related activity? In P. Ekman & R. J. Davidson (Eds.), The nature of emotion: fundamental questions (pp. 319–343). New York: Oxford University Press.Google Scholar
- DeVellis, R. F. (2012). Scale development. United States: SAGE Publications, Inc.Google Scholar
- Dillman, D. A., Smyth, J. D., & Christian, L. M. (2014). Internet, phone, mail, and mixed-mode surveys: The tailored design method, 4th Edition. John Wiley & Sons, Inc.Google Scholar
- Fisher, D. (2014). Fostering 21 st century skills in engineering undergraduates through co-curricular involvement. Presented at the annual conference for the American Society of Engineering Education in Indianapolis.Google Scholar
- Ford, J. K., MacCallum, R. C., & Tait, M. (1986). The application of exploratory factor analysis in applied psychology: a critical review and analysis. Personnel Psychology, 39(2), 291–314. https://doi.org/10.1111/j.1744-6570.1986.tb00583.x.CrossRefGoogle Scholar
- Forman, S. M., & Freeman, S. F. (2013). The unwritten syllabus: It’s not just equations—student thoughts on professional skills. Presented at the 120th ASEE Annual Conference & Exposition in Atlanta, Georgia.Google Scholar
- Fredrickson, B. L., Cohn, M. A., Coffey, K. A., Pek, J., & Finkel, S. M. (2008). Open hearts build lives: positive emotions, induced through loving-kindness meditation, build consequential personal resources. Journal of Personality and Social Psychology, 95(5), 1045–1062. https://doi.org/10.1037/a0013262.CrossRefGoogle Scholar
- Garland, R. (1991). The mid-point on a rating scale: is it desirable? Marketing Bulletin, 2, 66–71.Google Scholar
- Green, S. B., Levy, R., Thompson, M. S., Lu, M., & Lo, W. (2012). A proposed solution to the problem with using completely random data to assess the number of factors with parallel analysis. Educational and Psychological Measurement, 72(3), 357–374. https://doi.org/10.1177/0013164411422252.CrossRefGoogle Scholar
- Jaschik, S. (2015). Well-prepared in their own eyes. Retrieved from https://www.insidehighered.com/news/2015/01/20/study-finds-big-gaps-between-student-and-employer-perceptions.
- Kok, B. E., Coffey, K. A., Cohn, M. A., Catalino, L. I., Vacharkulksemsuk, T., Algoe, S. B., Brantley, M., & Fredrickson, B. L. (2013). How positive emotions build physical health: perceived positive social connections account for the upward spiral between positive emotions and vagal tone. Psychological Science, 24(7), 1123–1132. https://doi.org/10.1177/0956797612470827.CrossRefGoogle Scholar
- Muthén, L. K., & Muthén, B. O. (1998-2010). Mplus user’s guide (Sixth ed.). Los Angeles: Muthén & Muthén.Google Scholar
- Nguyen, D. Q. (1998). The essential skills and attributes of an engineer: a comparative study of academics, industry personnel, and engineering students. Global Journal of Engineering Education, 2(1), 65–74.Google Scholar
- Petty, R. E., & Cacioppo, J. T. (1981). Attitudes and persuasion: classic and contemporary approaches. Dubuque: Brown.Google Scholar
- Rees, C., Sheard, C., & Davies, S. (2002). The development of a scale to measure medical students' attitudes towards communication skills learning: the Communication Skills Attitude Scale (CSAS). Medical Education, 36(2), 141–147. https://doi.org/10.1046/j.1365-2923.2002.01072.x.CrossRefGoogle Scholar
- Royal Academy of Engineering (2015). Engineering for a successful nation. Retrieved from http://www.raeng.org.uk/publications/reports/engineering-for-a-successful-nation.
- Schumann, D. W., Kotowski, M. R., Ahn, H.-Y., & Haugtvedt, C. (2012). The elaboration likelihood model: a 30-year review. In S. Rodgers & E. Thorson (Eds.), Advertising theory (pp. 51–68). NY: Routledge.Google Scholar
- Shuman, L. J., Besterfield-Sacre, M., & McGourty, J. (2005). The ABET “professional skills”—can they be taught? Can they be assessed? Journal of Engineering Education, 94(1), 41–55. https://doi.org/10.1002/j.2168-9830.2005.tb00828.x.CrossRefGoogle Scholar
- Stevens, J. (1996). Applied multivariate statistics for the social sciences (3rd ed.). Mahwah: Lawrence Erlbaum.Google Scholar
- Winters, K. E., Matushovich, H. M, Brunhaver, S., Chen, H. L., Yasuhara, K., & Sheppard, S. (2013). From freshman engineering students to practicing professionals: Changes in beliefs about important skills over time. Presented at the 120th ASEE Annual Conference & Exposition in Atlanta, Georgia.Google Scholar