Learning with multi-representational texts in a second language

An eye-tracking investigation

Mohd Jaafar Nurjanah, Shaaron E. Ainsworth, Walter J.B. van Heuven

Research output: Contribution to journalConference article

Abstract

Integrating verbal and pictorial information is fundamental in learning multi-representational materials and is reported to correlate with various positive outcomes of learning. To investigate how non-native English readers engage with multi-representational texts, the eye movements of 32 university students were examined while they read a multi-representational text in their second language (L2). The role of prior knowledge, L2 vocabulary knowledge and L2 reading comprehension ability was also investigated. No significant correlations emerged between eye-movement patterns and individual differences but there were significant correlations between eye-movement patterns and learning outcome. This study found partial support that greater integrations between text and pictures by non-native English readers was associated with a better learning outcome. Text-dominant processing and text-guided integrative processing appear to be equally important when reading multi-representational texts in the L2.

Original languageEnglish
Pages (from-to)969-972
Number of pages4
JournalProceedings of International Conference of the Learning Sciences, ICLS
Volume2
Issue number2018-June
Publication statusPublished - 1 Jan 2018
Externally publishedYes
Event13th International Conference of the Learning Sciences, ICLS 2018: Rethinking Learning in the Digital Age: Making the Learning Sciences Count - London, United Kingdom
Duration: 23 Jun 201827 Jun 2018

Fingerprint

Eye movements
language
Text processing
learning
text processing
Students
Processing
vocabulary
comprehension
university
ability
knowledge
student

Keywords

  • Eye-movements
  • Integrative processing
  • Learning from text
  • Multi-representational learning
  • Reading in a second language

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Education

Cite this

Learning with multi-representational texts in a second language : An eye-tracking investigation. / Nurjanah, Mohd Jaafar; Ainsworth, Shaaron E.; van Heuven, Walter J.B.

In: Proceedings of International Conference of the Learning Sciences, ICLS, Vol. 2, No. 2018-June, 01.01.2018, p. 969-972.

Research output: Contribution to journalConference article

@article{a17bdd13527b422f8d4b03c0016cbb97,
title = "Learning with multi-representational texts in a second language: An eye-tracking investigation",
abstract = "Integrating verbal and pictorial information is fundamental in learning multi-representational materials and is reported to correlate with various positive outcomes of learning. To investigate how non-native English readers engage with multi-representational texts, the eye movements of 32 university students were examined while they read a multi-representational text in their second language (L2). The role of prior knowledge, L2 vocabulary knowledge and L2 reading comprehension ability was also investigated. No significant correlations emerged between eye-movement patterns and individual differences but there were significant correlations between eye-movement patterns and learning outcome. This study found partial support that greater integrations between text and pictures by non-native English readers was associated with a better learning outcome. Text-dominant processing and text-guided integrative processing appear to be equally important when reading multi-representational texts in the L2.",
keywords = "Eye-movements, Integrative processing, Learning from text, Multi-representational learning, Reading in a second language",
author = "Nurjanah, {Mohd Jaafar} and Ainsworth, {Shaaron E.} and {van Heuven}, {Walter J.B.}",
year = "2018",
month = "1",
day = "1",
language = "English",
volume = "2",
pages = "969--972",
journal = "Proceedings of International Conference of the Learning Sciences, ICLS",
issn = "1814-9316",
publisher = "International Society of the Learning Sciences",
number = "2018-June",

}

TY - JOUR

T1 - Learning with multi-representational texts in a second language

T2 - An eye-tracking investigation

AU - Nurjanah, Mohd Jaafar

AU - Ainsworth, Shaaron E.

AU - van Heuven, Walter J.B.

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Integrating verbal and pictorial information is fundamental in learning multi-representational materials and is reported to correlate with various positive outcomes of learning. To investigate how non-native English readers engage with multi-representational texts, the eye movements of 32 university students were examined while they read a multi-representational text in their second language (L2). The role of prior knowledge, L2 vocabulary knowledge and L2 reading comprehension ability was also investigated. No significant correlations emerged between eye-movement patterns and individual differences but there were significant correlations between eye-movement patterns and learning outcome. This study found partial support that greater integrations between text and pictures by non-native English readers was associated with a better learning outcome. Text-dominant processing and text-guided integrative processing appear to be equally important when reading multi-representational texts in the L2.

AB - Integrating verbal and pictorial information is fundamental in learning multi-representational materials and is reported to correlate with various positive outcomes of learning. To investigate how non-native English readers engage with multi-representational texts, the eye movements of 32 university students were examined while they read a multi-representational text in their second language (L2). The role of prior knowledge, L2 vocabulary knowledge and L2 reading comprehension ability was also investigated. No significant correlations emerged between eye-movement patterns and individual differences but there were significant correlations between eye-movement patterns and learning outcome. This study found partial support that greater integrations between text and pictures by non-native English readers was associated with a better learning outcome. Text-dominant processing and text-guided integrative processing appear to be equally important when reading multi-representational texts in the L2.

KW - Eye-movements

KW - Integrative processing

KW - Learning from text

KW - Multi-representational learning

KW - Reading in a second language

UR - http://www.scopus.com/inward/record.url?scp=85053859913&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85053859913&partnerID=8YFLogxK

M3 - Conference article

VL - 2

SP - 969

EP - 972

JO - Proceedings of International Conference of the Learning Sciences, ICLS

JF - Proceedings of International Conference of the Learning Sciences, ICLS

SN - 1814-9316

IS - 2018-June

ER -