Abstract
Assessment is one of the most important parts of the education system. The effectiveness of teaching and learning needs to be assessed so that all parties involved in this system can be improved. When “Assessment” is powered with technology and named as “E Assessment”, generating the data to make the necessary improvements in education gets easier. However, as is the case in other fields, technology brings risks and challenges along with its indispensable benefits. This paper provides insights about success factors that are extracted from the literature and validated through a Delphi study. With the participation of eleven experts in two iterative rounds, in addition to the success factors, practicable solutions to achieve success are also collected. The decision makers who plan the implementation and administration processes of E Assessment can consider the proposed key success factors and the practicable solutions when allocating resources.
Chapter PDF
Similar content being viewed by others
References
Bennett, R.E., Goodman, M., Hessinger, J., et al.: Using multimedia in large-scale computer-based testing programs. Computers in Human Behavior 15(3), 283–294 (1999)
Bridgeman, B.: Experiences from Large-Scale Computer-Based Testing in the USA. In: Scheuermann, F., Björnsson, J. (eds.), Reykjavik, Iceland, pp. 39–44 (2009)
JISC: Effective Assessment in a Digital Age: A guide to technology-enhanced assessment and feedback. Joint Information Systems Committee (2010)
Martinot, M.J.: Examinations in Dutch secondary education - Experiences with CitoTester as a platform for Computer-based testing. In: Scheuermann, F., Pereira, A. (eds.), Ispra, Italy, pp. 49–52 (2008)
Fluck, A., Pullen, D., Harper, C.: Case study of a computer based examination system 25(4), 509–523 (2009)
Scheuermann, F., Björnsson, J. (eds.): The Transition to Computer-Based Assessment: New Approaches to Skills Assessment and Implications for Large-scale Testing. Joint Research Centre, Italy (2009)
NC: Transitioning to Online Assessment in North Carolina. The North Carolina State Board of Education, NC (2010)
Conole, G., Warburton, B.: A review of computer-assisted assessment. ALT-J 13(1), 17–31 (2011)
Ripley, M.: Transformational Computer-based Testing. In: Scheuermann, F., Björnsson, J. (eds.), Reykjavik, Iceland (2009)
Okoli, C., Pawlowski, S.D.: The Delphi method as a research tool: An example, design considerations and applications. Information & Management 42(1), 15–29 (2004)
Linstone, H.A., Turoff, M., Helmer, O.: The Delphi method: Techniques and applications. Addison-Wesley (1975)
Brancheau, J.C., Janz, B.D., Wetherbe, J.C.: Key issues in information systems management: 1994–95 SIM Delphi results. MIS Quarterly 20(2), 225–242 (1996)
Schmidt, R., Lyytinen, K., Keil, M., Cule, P.: Identifying software project risks: An international Delphi study. Journal of Management Information Systems 17(4), 5–36 (2001)
Schmidt, R.: Managing Delphi Surveys Using Nonparametric Statistical Techniques. Decision Sciences 28(3), 763–774 (1997)
Dalkey, N.: An Experimental Study of Group Opinion: Delphi Method. Futures, 408–426 (1969)
Holey, E.A., Feeley, J.L., Dixon, J., Whittaker, V.J.: An exploration of the use of simple statistics to measure consensus and stability in Delphi studies. BMC Medical Research Methodology 7(52) (2007)
Dajani, J.S., Sincoff, M.Z., Talley, W.K.: Stability and Agreement Criteria for the Termination of Delphi Studies. Technological Forecasting and Social Change 13, 83–90 (1979)
Greatorex, J., Dexter, T.: An accessible analytical approach for investigating what happens between the rounds of a Delphi study. Journal of Advanced Nursing 32(4), 1016–1024 (2000)
Lewins, A., Silver, C.: Using Software in Qualitative Research. A Step-by-Step Guide. Sage Publications, London (2007)
Kondracki, N.L., Wellman, N.S., Amundson, D.: Content Analysis: Review of Methods and Their Applications in Nutrition Education. Department of Health and Human Services, Washington, DC (2002)
Zakrzewski, S., Steven, C.: A Model for Computer-based Assessment: The catherine wheel principle. Assessment & Evaluation in Higher Education 25(2), 201–215 (2011)
Pearson Assessment: Considerations for Next-Generation Assessments: A Roadmap to 2014 (2010)
Buzzetto-More, N.A., Alade, A.J.: Best Practices in E-Assessment. Journal of Information Technology Education 5, 251–269 (2006)
Sandene, B., Horkay, N., Bennett, R.E., et al.: Online Assessment in Mathematics and Writing: Reports from the NAEP Technology-Based Assessment Project. U.S. Department of Education, National Center for Education Statistics. U.S. Government Printing Office, Washington, DC (2005)
Brown, S., Bull, J., Race, P.: Computer-Assisted Assessment in Higher Education. Kogan Page, London (1999)
NQC: E-Assessment guidelines for the VET sector. National Quality Council (2011)
ITC: International Guidelines on Computer-Based and Internet Delivered Testing. The Council of the International Test Commission (2005)
Schaffhauser, D.: High-Stakes Online Testing: Coming Soon! T.H.E. Journal 38(6), 28–40 (2011)
Mass: Final Report of the Spring 2011 MEPA Online Test Administration. Massachusetts Department of Elementary and Secondary Education (2011)
Ryssevik, J.: Large-scale Computer-based Testing of Foreign Language Competences across Europe. In: Scheuermann, F., Björnsson, J. (eds.), Reykjavik, Iceland, pp. 57–62 (2009)
Haldane, S.: Delivery Platforms for National and International Computer-based Surveys: History, issues and current status. In: Scheuermann, F., Björnsson, J. (eds.), Reykjavik, Iceland, pp. 63–67 (2009)
Parshall, C.G., Spray, J.A., Kalohn, J.C., Davey, T.: Practical considerations in computer-based testing. Springer, New York (2002)
Levin, D., Fletcher, G., Chau, Y.: Technology Requirements for Large-Scale Computer-based and Online Assessment: Current Status and Issues. State Educational Technology Directors Association (2011)
Bartram, D.: Available Guidelines and Standards for Psychometric Tests and Test Users. In: Scheuermann, F., Pereira, A. (eds.), Ispra, Italy, pp. 37–48 (2008)
Van Lent, G.: Risks and Benefits of CBT versus PBT in High-Stakes Testing Introducing key concerns and decision making aspects for educational authorities. In: Scheuermann, F., Björnsson, J. (eds.), Reykjavik, Iceland, pp. 83–91 (2009)
JISC: e-Assessment glossary (Extended). Technical report. Joint Information Systems Committee e-Administration (2006)
JISC: Effective practice with e-Assessment: An overview of technologies, policies and practice in further and higher education. Technical report. Joint Information Systems Committee (2007)
Ripley, M.: Review of advanced e-Assessment techniques (RAeAT) final report. Technical report. Joint Information Systems Committee (2009)
Sim, G., Holifield, P., Brown, M.: Implementation of computer assisted assessment: lessons from the literature. ALT-J 12(3), 215–229 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 IFIP International Federation for Information Processing
About this paper
Cite this paper
Tanrikulu, E. (2013). What Needs to Be Done for Successful E Assessment Implementations?. In: Passey, D., Breiter, A., Visscher, A. (eds) Next Generation of Information Technology in Educational Management. ITEM 2012. IFIP Advances in Information and Communication Technology, vol 400. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38411-0_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-38411-0_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-38410-3
Online ISBN: 978-3-642-38411-0
eBook Packages: Computer ScienceComputer Science (R0)