Framework for Evaluation of Programming Language Examinations

  • Himani MittalEmail author
  • Syamala Devi Mandalika
Part of the SpringerBriefs in Applied Sciences and Technology book series (BRIEFSAPPLSCIENCES)


Recent advancements in the field of e-learning and virtual learning have changed the face of education. An important part of learning process is evaluation of student learning through examinations. This paper suggests a framework for evaluation of computer science practical examinations. The framework is implemented using Java programming language and many open source tools and libraries. The developed framework performs evaluation in four steps. The first step is compiler output interpretation in which the false errors generated by compiler are eliminated and only actual errors are reported. In the second step, unit testing of compiled programs is done. In third step, software metrics like lines of code, lines of comment, McCabe’s cyclomatic complexity, and number of modules are calculated for the programs. Finally, the semantic similarity of student programs is checked against the model program. The implemented framework is tested on student programs, and the accuracy of results is satisfactory. This framework will be helpful in efficiently evaluating student programs in practical examinations. It works for C, C++, and Java programming languages.


Practical evaluation Java C++ Program evaluation 


  1. 1.
    Jackson D, Usher M (1997) Grading Student Programs using ASSYST. In: Proceedings of the 28th SIGCSE technical symposium pp 335–339. doi: 10.1145/268084.268210
  2. 2.
    Daly C (1999) RoboProf and an introductory computer programming course. In: Proceedings of the 4th annual SIGCSE/SIGCUE on innovation and technology in computer science education, Krakow, pp 155–158, 27–30 June 1999. doi: 10.1145/384267.305904
  3. 3.
  4. 4.
    Leal JP, Silva F (2003) Mooshak: a web-based multi-site programming contest system. J Software—Pract Experience 33(6):567–581. doi: 10.1002/spe.522 CrossRefGoogle Scholar
  5. 5.
    García-Mateos G, Fernández-Alemán JL (2009) A course on algorithms and data structures using on-line judging. In: Proceedings of the 14th annual ACM SIGCSE conference on innovation and technology in computer science education 41(3):45–49. doi: 10.1145/1505496.1562897
  6. 6.
    Montoya-Dato FJ, Fernández-Alemán JL, García-Mateos G (2009) An experience on Ada programming using on-line judging. In: Proceedings 14th international conference on reliable software technologies, pp 75–89. doi:10.1007/ 978-3-642-01924-16Google Scholar
  7. 7.
    Douce et al (2005) A technical perspective on ASAP—automated system for assessment of programming. In: Proceedings of the 9th computer assisted assessment conferenceGoogle Scholar
  8. 8.
    Mandal AK, Mandal C, Reade CMP (2006) Architecture of an Automatic program evaluation system. In: Proceedings of CSIEGoogle Scholar
  9. 9.
    Raadt M, Dekeyser S, Lee TY (2007) A student employing peer review and enhanced computer assisted assessment of querying skills. Inform Educ 6(1):163–178Google Scholar
  10. 10.
    Zhang G, Ke H (2010) SQL paperless examination system design. In: 2010 Second international conference on computer modeling and simulation, IEEE, 3:475–478. doi: 10.1109/ICCMS.2010.468
  11. 11.
    Farrow M, King PJB (2008) Experiences with online programming examinations. IEEE Trans Educ 51(2):251CrossRefGoogle Scholar
  12. 12.
    Skupas B (2010) Feedback improvement in automatic program evaluation systems. Inform Educ 9(2):229–237Google Scholar
  13. 13.
    Fernández Alemán JL (2011) Automated assessment in a programming tools course. IEEE Trans Educ 54(4):576–581CrossRefGoogle Scholar
  14. 14.
    Zhenming Y, Liang Z, Guohua Z (2003) A novel web-based online examination system for computer science education. In: Proceedings of international conference on frontiers in education, IEEE, New YorkGoogle Scholar
  15. 15.
    Zhang L, Zhuang YT, Yuan ZM, Zhan GH (2006) A web-based examination and evaluation system for computer education. In: proceedings of the sixth international conference on advanced learning technologies, IEEE, New YorkGoogle Scholar
  16. 16.
    Hollingsworth J (1960) Automatic graders for programming classes. Commun ACM 3(10):528–529. doi: 10.1145/367415.367422 CrossRefGoogle Scholar
  17. 17.
    English J (2004) Automated assessment of GUI programs using JEWL. In: Proceedings of the 9th annual SIGCSE conference on innovation and technology in computer science education. pp 131–141Google Scholar
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.

Copyright information

© The Author(s) 2015

Authors and Affiliations

  1. 1.Department of Computer Science and ApplicationsPanjab UniversityChandigarhIndia

Personalised recommendations