Yang Yue

Graduate School, Emilio Aguinaldo College, Manila, Philippines

DOI : https://doi.org/10.47191/ijsshr/v7-i09-65

Google Scholar Download Pdf
ABSTRACT

The English proficiency of Chinese college students varies in different regions and majors. For college students, it’s of great importance to know their strengths and weaknesses in the process of language learning and to have targeted practice . For language teachers, it is quite significant to identify the problems and needs of students in English learning, to adjust the teaching methods and contents and to improve the teaching effect. At the same time, the feedback of the test results can also promote the school’s attention to and investment i n English teaching and promote the in depth reform of English teaching. In this procedure, a comprehensive English test is an effective way. This study describes developing and validating a comprehensive English test for sophomore students at Shenyang Univ ersity of Chemistry and Technology in Liaoning, China. The test is designed to assess students' English proficiency upon completing the "New Century College English Reading" course. The research employed a mixed methods approach, combining qualitative meth ods for test development and expert review with quantitative methods for statistical validation. The test development process included content analysis of course materials, creation of test specifications aligned with course objectives, and item writi ng. T he test covers four key language domains: listening, reading, translation, and writing. Validation is conducted through expert r eview using a content, construct, and face validity checklist. Five experienced English language teaching and assessment experts evaluated the test using a 15 item checklist with a 5 point Likert scale. Results showed high overall validity, with mean scores above 4.0 for content validity, construct validity, and face validity, indicating strong agreement among experts on the test' s validation. While the study provides strong evidence for the test's validity, limitations include the sample size and geographic scope. Future research directions include longitudinal studies to assess predictive validity and cross regional validation to evaluate the test's applicability across China's educational contexts. This study contributes to English language assessment in Chines e higher education in Liaoning province. It provides a validated tool that aligns closely with curriculum objectives and a ddresses the need for comprehensive language proficiency evaluation.

KEYWORDS:

development, validity, testing, language proficiency, assessment

REFERENCES
1) Bachman, L. F., & Palmer, A. S. (2023). Language assessment in practice: Developing language tests and justifying their use in the real world. Oxford University Press. a. https://www.cambridge.org/core/books/4AE3A5C2D692E20CBC61F3D6F66AFBB6

2) Brown, H. D., & Abeywickrama, P. (2020). Language assessment: Principles and classroom practices (3rd ed.). Pearson Education. https://higher-education/program/ PGM2487474

3) Chapelle, C. A. (2012). Validity argument for language assessment: The framework is simple... Language Testing, 29(1), 19-27.https://doi.org/10.1177/0265532211417211

4) Chalhoub-Deville, M., & O'Sullivan, B. (2020). Validity: Theoretical development and integrated arguments. Equinox. https://www.equinoxpub.com/home/validity- theoretical-development-integrated-arguments/

5) Chen, L., Wang, X., & Zhang, Y. (2023). Developing effective English language assessment tools in Chinese higher education. Journal of Language Testing in Asia, 13(2), 45-62. https://doi.org/10.1186/s40468-023-00214-8

6) Chen, L., & Liu, J. (2019). Validating a standardized test of English language proficiency for Chinese university students. Language Testing in Asia, 9(1), 1-15. https://doi.org/10.1186/s40468-019-0086-7

7) Cheng, L., & Curtis, A. (2004). Washback or backwash: A review of the impact of testing on teaching and learning. In L. Cheng, Y. Watanabe, & A. Curtis (Eds.), Washback in language testing, Lawrence Erlbaum Associates. https://www.routledge. com/Washback-in-Language-Testing-Research-Contexts-and-Methods/Cheng-Watanabe-Curtis/p/book/9780805839388

8) Cheng, L., & Fox, J. (2023). Assessment in the language classroom: Teachers supporting student learning (2nd ed.). Palgrave Macmillan. https://link.springer.com /book/10.1007/978-3-031-12335-8

9) Grabe, W., & Stoller, F. L. (2020). Teaching and researching reading (3rd ed.). Routledge. https://www.routledge.com/Teaching-and-Researching-Reading/Grabe-Stoller/p/book/9781138310230

10) Green, A. (2021). Exploring language assessment and testing: Language in action (2nd ed.). Routledge. https://doi.org/10.1080/15434303.2021.1904905

11) Huang, Y. (2021). English for academic purposes in Chinese higher education: Challenges and opportunities. Journal of English for Academic Purposes, 52, 100998. https://doi.org/10.1016/j.jeap.2021.100998

12) Kunnan, A. J. (2018). Evaluating language assessments. Routledge. https://doi.org/10.1080/15434303.2017.1421956

13) Jin, Y., & Fan, J. (2021). The English proficiency of college students in China: Characterization and implications. Journal of Multilingual and Multicultural Development, 42(7), 685-698. https://doi.org/10.1080/01434632.2019.1681227

14) Li, J., & Zhang, Y. (2021). English language education policy in China: A historical overview. Language Teaching Research, 25(6), 972-990.

15) Li, X., Wang, L., & Chen, Y. (2023). Expert judgment in language test validation: A case study of a university English proficiency test in China. Language Testing, 40(1), 97-120.

16) Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741-749. a. https://doi.org/10.1207/s15326977ea0203_1

17) Nevo, B. (1985). Face validity revisited. Journal of Educational Measurement, 22(4), 287-293. a. https://doi.org/10.1177/014662168500900307

18) O'Sullivan, B., & Weir, C. J. (2021). Language testing and validation: An evidence-based approach (2nd ed.). Palgrave Macmillan. https://link.springer.com/book/10.1057/978-1-137-48447-2

19) Purpura, J. E., & Evan, C. (2021). Learning-oriented assessment in language classrooms: Using assessment to gauge and promote language learning. Routledge. https://www.routledge.com/Purpura-Evan/p/book/9781138589889

20) Purpura, J. E. (2016). Second and foreign language assessment. The Modern Language Journal, 100(S1), 190-208. https://doi.org/10.1111/modl.12308

21) Qin, X & Zhang, (2020). New century college English-An integrated English course IV. ISBN 978-7-5446-3443-4

22) Sireci, S., & Faulkner-Bond, M. (2014). Validity evidence based on test content. Psicothema, 26(1), 100-107. https://doi.org/10.1016/j.edurev.2013.11.003

23) Wagner, E. (2022). Assessing listening. In C. A. Chapelle (Ed.), The encyclopedia of applied linguistics (pp. 1-7). Wiley. https://doi.org/10.1080/15434303.2021.1998047

24) Wang, H., Smyth, R., & Cheng, Z. (2020). The economic returns to proficiency in English in China. China Economic Review, 59, 101368. https://doi.org/10.1016/j.chieco.2019.101368

25) Weir, C. J. (2005). Language testing and validation: An evidence-based approach. Palgrave Macmillan. https://link.springer.com/book/10.1057/9780230514577

26) Winke, P., & Lim, H. (2019). The effects of test preparation on second-language performance: A meta-analysis. Applied Linguistics, 40(2), 330-351. https://doi.org/10.1093/applin/amx051

27) Wu, J., & Li, X. (2021). Assessing English language proficiency in Chinese higher education: A comparative study of testing systems. Language Testing, 38(4), 583-605. https://doi.org/10.1177/0265532220981251

28) Yang, Y., Zhang, L., & Chen, X. (2022). The impact of formative assessment on EFL learners' motivation and achievement in Chinese universities. Studies in Educational Evaluation, 72, 101133. a. https://doi.org/10.1016/j.stueduc.2022.101133

29) Zhang, R., & Zou, D. (2021). Types, purposes, and effectiveness of state-of-the-art technologies for second and foreign language learning. Journal of Computer Assisted Learning, 37(2), 423-440. https://doi.org/10.1111/jcal.12490

30) Zhang, X. (2022). Assessment practices in Chinese university English programs: Challenges and innovations. Assessment & Evaluation in Higher Education, 47(3), 456-470. https://doi.org/10.1080/02602938.2021.1888075

31) Zhao, W., & Cai, Y. (2023). Developing EAP assessments for Chinese university students: Balancing local needs and global standards. Journal of English for Academic Purposes, 61, 101190. https://doi.org/10.1016/j.jeap.2022.101190

Volume 07 Issue 09 september 2024