The validation of assessment for learning audit instrument: A mixed methods approach

Research output: Contribution to journalArticle

Abstract

The CEFR-aligned curriculum promotes integration in the implementation of Assessment for Learning (AfL) by English language teachers in primary schools. This paper depicts the mixed methods pilot and validation of the Assessment for Learning Audit Instrument (AfLAi) for the purpose of examining the use and understanding of AfL among the teachers in primary schools. In Phase 1, three subject matter experts were consulted, and nine English language teachers provided consensual validation. In Phase 2, 53 English language teachers responded to the adapted instrument. AfLAi was further discussed with the validators in Phase 3. This procedure was adapted from Phase 8 of the Instrument Development and Construct Validation mixed research techniques. Among the emerging themes were on language correction, item/instrument difficulty, and useful items. The quantitative data was compared with the scales from the original authors regarding the four key strategies of AfL in AfLAi: Sharing Learning Intentions and Success Criteria, Questions and Classroom Discussions, Feedback and Peer- A nd Self-Assessment. Based on the mixed data arranged in a joint display, some parts in the items were adapted to accommodate the local context. Among the findings were (i) the key strategy known as Learning Intentions in AfLAi was not applicable in the target context, and (ii) some examples in the items needed to be changed to fit the Malaysian syllabus. The implications of this pilot study and validation process included 16 changes in the instrument and the translation of the instrument into Bahasa Melayu.

Original languageEnglish
Pages (from-to)209-226
Number of pages18
Journal3L: Language, Linguistics, Literature
Volume25
Issue number4
DOIs
Publication statusPublished - 1 Jan 2019

Fingerprint

audit
learning
English language
teacher
primary school
Mixed Methods
Audit
syllabus
self-assessment
research method
expert
curriculum
classroom
language

Keywords

  • Assessment for Learning
  • Audit instrument
  • English language teachers
  • Mixed methods
  • Primary school

ASJC Scopus subject areas

  • Language and Linguistics
  • Linguistics and Language
  • Literature and Literary Theory

Cite this

The validation of assessment for learning audit instrument : A mixed methods approach. / Mohamed, Mazidah; Aziz, Mohd Sallehhudin Abd; Ismail, Kemboja.

In: 3L: Language, Linguistics, Literature, Vol. 25, No. 4, 01.01.2019, p. 209-226.

Research output: Contribution to journalArticle

@article{a34efd47ca994e21beb76cd0707e541f,
title = "The validation of assessment for learning audit instrument: A mixed methods approach",
abstract = "The CEFR-aligned curriculum promotes integration in the implementation of Assessment for Learning (AfL) by English language teachers in primary schools. This paper depicts the mixed methods pilot and validation of the Assessment for Learning Audit Instrument (AfLAi) for the purpose of examining the use and understanding of AfL among the teachers in primary schools. In Phase 1, three subject matter experts were consulted, and nine English language teachers provided consensual validation. In Phase 2, 53 English language teachers responded to the adapted instrument. AfLAi was further discussed with the validators in Phase 3. This procedure was adapted from Phase 8 of the Instrument Development and Construct Validation mixed research techniques. Among the emerging themes were on language correction, item/instrument difficulty, and useful items. The quantitative data was compared with the scales from the original authors regarding the four key strategies of AfL in AfLAi: Sharing Learning Intentions and Success Criteria, Questions and Classroom Discussions, Feedback and Peer- A nd Self-Assessment. Based on the mixed data arranged in a joint display, some parts in the items were adapted to accommodate the local context. Among the findings were (i) the key strategy known as Learning Intentions in AfLAi was not applicable in the target context, and (ii) some examples in the items needed to be changed to fit the Malaysian syllabus. The implications of this pilot study and validation process included 16 changes in the instrument and the translation of the instrument into Bahasa Melayu.",
keywords = "Assessment for Learning, Audit instrument, English language teachers, Mixed methods, Primary school",
author = "Mazidah Mohamed and Aziz, {Mohd Sallehhudin Abd} and Kemboja Ismail",
year = "2019",
month = "1",
day = "1",
doi = "10.17576/3L-2019-2504-13",
language = "English",
volume = "25",
pages = "209--226",
journal = "3L: Language, Linguistics, Literature",
issn = "0128-5157",
publisher = "Penerbit Universiti Kebangsaan Malaysia",
number = "4",

}

TY - JOUR

T1 - The validation of assessment for learning audit instrument

T2 - A mixed methods approach

AU - Mohamed, Mazidah

AU - Aziz, Mohd Sallehhudin Abd

AU - Ismail, Kemboja

PY - 2019/1/1

Y1 - 2019/1/1

N2 - The CEFR-aligned curriculum promotes integration in the implementation of Assessment for Learning (AfL) by English language teachers in primary schools. This paper depicts the mixed methods pilot and validation of the Assessment for Learning Audit Instrument (AfLAi) for the purpose of examining the use and understanding of AfL among the teachers in primary schools. In Phase 1, three subject matter experts were consulted, and nine English language teachers provided consensual validation. In Phase 2, 53 English language teachers responded to the adapted instrument. AfLAi was further discussed with the validators in Phase 3. This procedure was adapted from Phase 8 of the Instrument Development and Construct Validation mixed research techniques. Among the emerging themes were on language correction, item/instrument difficulty, and useful items. The quantitative data was compared with the scales from the original authors regarding the four key strategies of AfL in AfLAi: Sharing Learning Intentions and Success Criteria, Questions and Classroom Discussions, Feedback and Peer- A nd Self-Assessment. Based on the mixed data arranged in a joint display, some parts in the items were adapted to accommodate the local context. Among the findings were (i) the key strategy known as Learning Intentions in AfLAi was not applicable in the target context, and (ii) some examples in the items needed to be changed to fit the Malaysian syllabus. The implications of this pilot study and validation process included 16 changes in the instrument and the translation of the instrument into Bahasa Melayu.

AB - The CEFR-aligned curriculum promotes integration in the implementation of Assessment for Learning (AfL) by English language teachers in primary schools. This paper depicts the mixed methods pilot and validation of the Assessment for Learning Audit Instrument (AfLAi) for the purpose of examining the use and understanding of AfL among the teachers in primary schools. In Phase 1, three subject matter experts were consulted, and nine English language teachers provided consensual validation. In Phase 2, 53 English language teachers responded to the adapted instrument. AfLAi was further discussed with the validators in Phase 3. This procedure was adapted from Phase 8 of the Instrument Development and Construct Validation mixed research techniques. Among the emerging themes were on language correction, item/instrument difficulty, and useful items. The quantitative data was compared with the scales from the original authors regarding the four key strategies of AfL in AfLAi: Sharing Learning Intentions and Success Criteria, Questions and Classroom Discussions, Feedback and Peer- A nd Self-Assessment. Based on the mixed data arranged in a joint display, some parts in the items were adapted to accommodate the local context. Among the findings were (i) the key strategy known as Learning Intentions in AfLAi was not applicable in the target context, and (ii) some examples in the items needed to be changed to fit the Malaysian syllabus. The implications of this pilot study and validation process included 16 changes in the instrument and the translation of the instrument into Bahasa Melayu.

KW - Assessment for Learning

KW - Audit instrument

KW - English language teachers

KW - Mixed methods

KW - Primary school

UR - http://www.scopus.com/inward/record.url?scp=85077755855&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85077755855&partnerID=8YFLogxK

U2 - 10.17576/3L-2019-2504-13

DO - 10.17576/3L-2019-2504-13

M3 - Article

AN - SCOPUS:85077755855

VL - 25

SP - 209

EP - 226

JO - 3L: Language, Linguistics, Literature

JF - 3L: Language, Linguistics, Literature

SN - 0128-5157

IS - 4

ER -