A Review of the Validity and Reliability of Chinese Oral Test in the Past Two Decades
Keywords:
Chinese Oral Test, Validity Analysis, Reliability Assessment, Literature ReviewAbstract
With the growing demand for teaching and assessment of Chinese as a Second Language, oral proficiency testing has received heightened attention as a key component affecting educational quality. Oral Chinese Test of international Chinese education is becoming more and more important nowadays due to the implementation of the Chinese Proficiency Grading Standards for International Chinese Education. This paper reviews the literature on Chinese oral proficiency testing research since the beginning of the 21st century, analyzing the dynamics and progress of validity and reliability studies within this domain. The study selects relevant literature from authoritative databases for analysis and uses a literature review method to organize and assess the scientific rigor and reliability of various oral proficiency tests. The results indicate that while Chinese oral proficiency testing has progressively refined its scoring systems and criteria based on the principles of comprehensiveness and communicativeness, there remains room for improvement in the practical operation regarding validity and reliability. Further optimization is needed through diversified research methodologies. The paper suggests that future research should delve into the scope of applicability, evaluation standards, and technical support of Chinese oral proficiency testing to enhance its overall quality.
References
Bachman, L. F., & Palmer A.S. (2010). Language Assessment in Practice (2nd ed.). Oxford University Press.
Chai, S. S. (2003). The theoretical analysis and experimental research of rater reliability of Chinese oral proficiency test. Language Teaching and Linguistic Studies, (04), 69-77. (In Chinese)
Chai, S. S., & Wang, Y. Q. (2019). Review of validity research based on Journal of Language Testing during 2008 to 2018. Examinations Research, (05), 60-67. (In Chinese)
Gao, H. Y., & Liu, F., & Ji, H. Q. (2013). Construct validity in language testing: Development contribution and challenges. Journal of Northeast Normal University (Philosophy and Social Sciences), (05), 135-138. (In Chinese)
Graesser, A. C., McNamara, D. S., & Kulikowich, J. M. (2004). Coh-Metrix: Analysis of text on cohesion and language use. Discourse Processes, 37(2), 91-112.
Hu, H. (2016). Rethinking Chinese oral proficiency assessment: A review of test design and validity. Journal of Language Testing and Assessment, 22(3), 35-49.
Huang, Q., & Wang, H. (2019). Research on the reliability and validity of automatic oral test by machine. Modern Educational Technology, 29(09), 59-65. (In Chinese)
Kane, M. (2013). Validiting the tnterpretations and users of test scores. Journal of Educational Measurement, (50), 1-73.
Li, X. Q., & Li, J. H. (2014). Validity analysis of spoken Chinese test. Chinese Teaching in the World, (01), 103-112. (In Chinese)
Li, Y. H. (2016). The relationship between reliability and validity of language test. Journal of Jiangsu Normal University (Philosophy and Social Sciences Edition), (05), 88-92. (In Chinese)
Lu, X. (2014). Speech recognition technologies and their implications for language testing. Language Testing, 31(3), 345-367.
McNamara, T. (2000). Language Testing. Oxford University Press.
Phakiti, A. (2008). Construct validation of Bachman and Palmer's strategic competence model over time in EFL reading tests. Language, (25), 237-272.
Wang, J. M. (2002). A study of the scoring of three types of oral test items. Chinese Teaching in the World, (04), 63-77+3. (In Chinese)
Wang, T. Y. (2016). A study on the influencing factors of construct validity in language testing. Course Education Research, (23), 25-26. (In Chinese)
Weir, C. J. (2005). Language Testing and Validation: An Evidence Based Approach. Palgrave: Macmillan.
Xu, X. Y. (2005). On Chinese oral test. Journal of Yunnan Normal University (Teaching & Studying Chinese as a Foreign Language Edition), (05), 39-45. (In Chinese)
Xu, Y. C., & Liang, X. J. (2020). A research on the validity and reliability of the oral Chinese test for international students. Journal of Changchun Education Institute, (05), 29-35. (In Chinese)
Yang, H. Y. (2009). Fourteen Lectures on Teaching Listening and Speaking in Teaching Chinese as a Foreign Language. Peking University Press.
Yang, Q. (2020). A Comparative Study of Chinese Oral Communication Strategies Between African Students and Japanese and Korean Students. Shanghai Normal University. (In Chinese)
Zhai, Y. (2012). On the evaluation criteria for Chinese oral achievement test. Teaching Chinese to Speakers of Other Languages Studies, (01), 42-50. (In Chinese)
Zhang, F. F. (2007). Research on score reliability of spoken Chinese test. Sun Yatsen University Forum, (11), 175-176. (In Chinese)
Zhang, K. (2004). Measurement is a component of a scientific theory: A restudy of construct validity. Journal of Yunnan Normal University (Teaching & Studying Chinese as a Foreign Language Edition), 02(05), 39-45. (In Chinese)
Zhang, Q. (2019). Research and reflection on the validity of oral tests in Chinese as a foreign language class. Occupation, (06), 86-87. (In Chinese)
Zhao, Q. F. (2011). A study of the criterion-related validity of the item different combinations of spoken test of HSK (advanced). Journal of China Examinations, (09), 16-21. (In Chinese)
Zhao, Q. F. (2012). On the reliability in spoken test of advanced Chinese proficiency test and implications for teaching. Chinese Language Learning, (05), 89-94. (In Chinese)
Zhao, S. M. (1999). The discussion on the validity of oral proficiency test scores. Journal of Mongolia Normal University (Philosophy and Social Sciences), 28(06), 125-129. (In Chinese)
Zhou, Z. H. (2009). Reliability and validity of second language testing. Journal of Language and Literature Studies, (19), 154-155. (In Chinese)
Zou, S. (2003). The reciprocal relationship between language curriculum and language test. Foreign Language World, 98(06), 71-78, (In Chinese)
