State-of-the-Art of Assessment in Tunisia: The Case of Testing Listening Comprehension
As part of their prerequisite for any hallmark form of accountability, language tests are designed and administered to spur learning outcomes that would serve the educational needs of any nation. This article investigated language assessment in Tunisia by focusing on the testing of listening comprehension. SPSS and FACETS quantitative analyses of test scores of an achievement examination among 646 test-takers suggested that students had a very low language ability and that the nine raters who graded this exam were harshly and subjectively biased toward the nature of the exam tasks, thus showing a fuzzy idea of the construct of listening comprehension. This was conducive to irrelevant assessment results which, in fact, put into questions the testability of the exam items. Implications of the results were considered and recommendations to further investigate assessment in this context were also discussed.
KeywordsListening Assessment Ability Fuzzy construct Bias Irrelevance
I would like to thank the following people for their unconditional help and cooperation at the time of data collection: Aicha Graja, Faten Belhaj, Faten Houioui, Hajer Mami, Hedia Oueslati, Rim Drira, Rim Zaoui, Safia Sahli, and Selma Ben Mrad. I, however, remain responsible for the contents of this work.
- Anckar, J. (2011). Assessing foreign language listening comprehension by means of the multiple-choice format: Processes and products. Jyväskylä: University of Jyväskylä.Google Scholar
- Association of Language Testers in Europe (ALTE). (2001). Glossary. Retrieved from http://www.alte.org/glossary/index.cfm (April 2018).
- Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice: Designing and developing useful language tests. Oxford: Oxford University Press.Google Scholar
- Brown, H. D., & Abeywickrama, P. (2004). Language assessment: Principles and classroom practices. White Plains, NY: Pearson Education.Google Scholar
- Chniti, Y. (2018). Testing grammar in an EFL context. In S. Hidri (Ed.), Revisiting the assessment of second language abilities: From theory to practice (pp. 310–327). Basel: Springer.Google Scholar
- Common European Framework of Reference. (2016). Retrieved from https://www.coe.int/en/web/common-european-framework-reference-languages/listening-comprehension/-/asset_publisher/FuTcPrtvIAwm/content/bifie-salzbourg-english-listening-2?inheritRedirect=false.
- Davidson, F. (1991). Statistical support for training ESL composition rating. In L. Hamp-Lyons (Ed.), Assessing second language writing in academic context (pp. 155–164). Norwood, NJ: Ablex.Google Scholar
- Flowerdew, J. (1994). Research of relevance to second language lecture comprehension—An overview. In J. Flowerdew (Ed.), Academic listening: Research perspectives (pp. 7–29). Cambridge: Cambridge University Press.Google Scholar
- Freedle, R. & Kostin, I. (1996). The prediction of TOEFL listening comprehension item difficulty for mini-talk passages: Implications for construct validity (TOEFL Research Report 56). Princeton, NJ: Educational Testing Service. http://dx.doi.org/10.1002/j.2333-8504.1996.tb01707.x.
- Hidri, S. (2013). The effectiveness of assessment of learning and assessment for learning in eliciting valid inferences on the test-takers’ listening comprehension ability. In Article published in the Proceedings of the 2013 Nile TESOL Conference Revolutionizing TESOL: Techniques and Strategies (pp. 1–25). Egypt: The American University of Cairo. https://docs.google.com/file/d/0B6bmHwcjFuVYX2FJZTFndGF0QzA/edit.
- Hidri, S. (2015). Conceptions of assessment: Investigating what assessment means to secondary and university teachers. Arab Journal of Applied Linguistics, 1(1), 19–43.Google Scholar
- Hidri, S. (2018a). Revisiting the assessment of second language abilities: From theory to practice. Basel: Springer.Google Scholar
- Hidri, S. (2018b). Introduction: State of the art of assessing second language abilities. In S. Hidri (Ed.), Revisiting the assessment of second language abilities: From theory to practice (pp. 1–19). Basel: Springer.Google Scholar
- Hidri, S. (2018c). Assessing spoken language ability: A many-Facet Rasch analysis. In S. Hidri (Ed.), Revisiting the assessment of second language abilities: From theory to practice (pp. 23–48). Basel: Springer.Google Scholar
- Inan-Karagul, B., & Yuksel, D. (2018). Self-assessment in listening. In J. I. Liontas (Ed.), The TESOL Encyclopedia of English Language Teaching (pp. 1–7). Wiley. https://doi.org/10.1002/9781118784235.eelt0256.
- Jenkins, J., & Leung, C. (2014). English as a Lingua Franca. In A. J. Kunnan (Ed.), The companion to language assessment (pp. 1–10). Wiley. https://doi.org/10.1002/9781118411360.wbcla047.
- Mattoussi, Y. (2018). Testing usefulness of reading comprehension exams among first year students of English at the tertiary level in Tunisia. In S. Hidri (Ed.), Revisiting the assessment of second language abilities: From theory to practice (pp. 265–288). Springer International Publishing AG.CrossRefGoogle Scholar
- McNamara, T. (1996). Measuring second language performance. London: Longman.Google Scholar
- Naimi, Y. (2018). Teachers’ conceptions of assessment in an ESP context. In S. Hidri (Ed.), Revisiting the assessment of second language abilities: From theory to practice (pp. 174–194). Springer International Publishing AG.Google Scholar
- Ross, J. A. (2006). The reliability, validity and utility of self-assessment. Practical Assessment Research & Evaluation, 11(10), 1–13.Google Scholar
- Shohamy, E. (1991). The power of tests: A critical perspective on the uses of language tests. London: Longman.Google Scholar
- Song, X. (2005). Language learner strategy use and English proficiency on the Michigan English Language Assessment Battery. Spaan Fellow Working Papers in Second or Foreign Language Assessment, 3, 1–23.Google Scholar