Validity Argument in Language Testing
Case Studies of Validation Research

With examples of validation studies, this book demonstrates how to design research investigating the validity of language tests.

Carol A. Chapelle (Edited by), Erik Voss (Edited by)

9781108484022, Cambridge University Press

Hardback, published 21 January 2021

320 pages
23 x 15 x 2.5 cm, 0.67 kg

'This volume provides important insights into the utility of an argument-based approach to validity. Case studies representing a range of tests, contexts and validation methods provide fertile ground to explore the benefits, and limits, of an argument-based approach. This collection will appeal to anyone keen to learn about the application of validity theory in concrete language testing situations.' Luke Harding, Professor in English Language and Linguistics, Lancaster University

Language tests play pivotal roles in education, research on learning, and gate-keeping decisions. The central concern for language testing professionals is how to investigate whether or not tests are appropriate for their intended purposes. This book introduces an argument-based validity framework to help with the design of research that investigates the validity of language test interpretation and use. The book presents the principal concepts and technical terms, then shows how they can be implemented successfully in practice through a variety of validation studies. It also demonstrates how argument-based validity intersects with technology in language testing research and highlights the use of validity argument for identifying research questions and interpreting the results of validation research. Use of the framework helps researchers in language testing to communicate clearly and consistently about technical issues with each other and with researchers of other types of tests.

1. Introduction to Validity Argument in Language Testing and Assessment Carol A. Chapelle, Erik Voss
2. Understanding Argument-based Validity in Language Testing Carol A. Chapelle, Hye-won Lee
3. A Systematic Review of Argument-based Validation Studies in the Field of Language Testing (2000–2018) Ahmet Dursun, Zhi Li
4. Domain Definition Inference for a Virtual Interactive Aviation English Test (VIAET) for Military Air Traffic Controllers Moonyoung Park
5. Support for the Evaluation Inference: Investigating Conditions for Rating Responses on a Test of Academic Oral Language Hyejin Yang
6. Generalization Inference for a Computer-mediated Graphic-prompt Writing Test for ESL Placement YunDeok Choi
7. The Telephone Standard Speaking Test: an Outside Evaluator's Investigation of a Rebuttal to the Generalization Inference Rie Koizumi
8. The Explanation Inference for a Test of Academic English Collocational Ability Erik Voss
9. Extrapolation of the Meaning of Grades on Writing Tasks in an ESL Writing Class to Success on Tasks in University Courses Jooyoung Lee
10. Justifying the Interpretation and Use of an ESL Writing Final Examination Heesung Jun
11. An Argument for Use of a Test of Productive Grammatical Ability for Placement into Writing Classes Yoo-Ree Chung
12. Investigating the Consequences of an ESL Placement Test Zhi Li
13. Validation Research and its Limits Carol A. Chapelle, Erik Voss.

Subject Areas: Examinations & assessment [JNKD], Language teaching & learning [other than ELT CJ], Linguistics [CF]