Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood

Research output: Journal contributionsJournal articlesResearchpeer-review

Standard

Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood. / Steffan, Adrian; Zimmer, Lucie; Arias-Trejo, Natalia et al.
In: Infancy, Vol. 29, No. 1, 01.01.2024, p. 31-55.

Research output: Journal contributionsJournal articlesResearchpeer-review

Harvard

Steffan, A, Zimmer, L, Arias-Trejo, N, Bohn, M, Dal Ben, R, Flores-Coronado, MA, Franchin, L, Garbisch, I, Grosse Wiesmann, C, Hamlin, K, Havron, N, Hay, JF, Hermansen, TK, Jakobsen, KV, Kalinke, S, Ko, ES, Kulke, L, Mayor, J, Meristo, M, Moreau, D, Mun, S, Prein, J, Rakoczy, H, Rothmaler, K, Santos Oliveira, D, Simpson, EA, Sirois, S, Smith, ES, Strid, K, Tebbe, AL, Thiele, M, Yuen, F & Schuwerk, T 2024, 'Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood', Infancy, vol. 29, no. 1, pp. 31-55. https://doi.org/10.1111/infa.12564, https://doi.org/10.31234/osf.io/7924h

APA

Steffan, A., Zimmer, L., Arias-Trejo, N., Bohn, M., Dal Ben, R., Flores-Coronado, M. A., Franchin, L., Garbisch, I., Grosse Wiesmann, C., Hamlin, K., Havron, N., Hay, J. F., Hermansen, T. K., Jakobsen, K. V., Kalinke, S., Ko, E. S., Kulke, L., Mayor, J., Meristo, M., ... Schuwerk, T. (2024). Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood. Infancy, 29(1), 31-55. https://doi.org/10.1111/infa.12564, https://doi.org/10.31234/osf.io/7924h

Vancouver

Steffan A, Zimmer L, Arias-Trejo N, Bohn M, Dal Ben R, Flores-Coronado MA et al. Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood. Infancy. 2024 Jan 1;29(1):31-55. Epub 2023 Oct 18. doi: 10.1111/infa.12564, 10.31234/osf.io/7924h

Bibtex

@article{be037aa7eb0944f49f4839c4ab2d7832,
title = "Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood",
abstract = "Measuring eye movements remotely via the participant's webcam promises to be an attractive methodological addition to in-person eye-tracking in the lab. However, there is a lack of systematic research comparing remote web-based eye-tracking with in-lab eye-tracking in young children. We report a multi-lab study that compared these two measures in an anticipatory looking task with toddlers using WebGazer.js and jsPsych. Results of our remotely tested sample of 18-27-month-old toddlers (N = 125) revealed that web-based eye-tracking successfully captured goal-based action predictions, although the proportion of the goal-directed anticipatory looking was lower compared to the in-lab sample (N = 70). As expected, attrition rate was substantially higher in the web-based (42%) than the in-lab sample (10%). Excluding trials based on visual inspection of the match of time-locked gaze coordinates and the participant's webcam video overlayed on the stimuli was an important preprocessing step to reduce noise in the data. We discuss the use of this remote web-based method in comparison with other current methodological innovations. Our study demonstrates that remote web-based eye-tracking can be a useful tool for testing toddlers, facilitating recruitment of larger and more diverse samples; a caveat to consider is the larger drop-out rate.",
keywords = "Psychology, Anticipatory looking, Eye-tracking, Method Validation, Toddlers, Web-based eye-tracking",
author = "Adrian Steffan and Lucie Zimmer and Natalia Arias-Trejo and Manuel Bohn and {Dal Ben}, Rodrigo and Flores-Coronado, {Marco A.} and Laura Franchin and Isa Garbisch and {Grosse Wiesmann}, Charlotte and Kiley Hamlin and Naomi Havron and Hay, {Jessica F.} and Hermansen, {Tone K.} and Jakobsen, {Krisztina V.} and Steven Kalinke and Ko, {Eon Suk} and Louisa Kulke and Julien Mayor and Marek Meristo and David Moreau and Seongmin Mun and Julia Prein and Hannes Rakoczy and Katrin Rothmaler and {Santos Oliveira}, Daniela and Simpson, {Elizabeth A.} and Sylvain Sirois and Smith, {Eleanor S.} and Karin Strid and Tebbe, {Anna Lena} and Maleen Thiele and Francis Yuen and Tobias Schuwerk",
note = "Publisher Copyright: {\textcopyright} 2023 The Authors. Infancy published by Wiley Periodicals LLC on behalf of International Congress of Infant Studies.",
year = "2024",
month = jan,
day = "1",
doi = "10.1111/infa.12564",
language = "English",
volume = "29",
pages = "31--55",
journal = "Infancy",
issn = "1525-0008",
publisher = "Wiley-Blackwell Publishing, Inc.",
number = "1",

}

RIS

TY - JOUR

T1 - Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood

AU - Steffan, Adrian

AU - Zimmer, Lucie

AU - Arias-Trejo, Natalia

AU - Bohn, Manuel

AU - Dal Ben, Rodrigo

AU - Flores-Coronado, Marco A.

AU - Franchin, Laura

AU - Garbisch, Isa

AU - Grosse Wiesmann, Charlotte

AU - Hamlin, Kiley

AU - Havron, Naomi

AU - Hay, Jessica F.

AU - Hermansen, Tone K.

AU - Jakobsen, Krisztina V.

AU - Kalinke, Steven

AU - Ko, Eon Suk

AU - Kulke, Louisa

AU - Mayor, Julien

AU - Meristo, Marek

AU - Moreau, David

AU - Mun, Seongmin

AU - Prein, Julia

AU - Rakoczy, Hannes

AU - Rothmaler, Katrin

AU - Santos Oliveira, Daniela

AU - Simpson, Elizabeth A.

AU - Sirois, Sylvain

AU - Smith, Eleanor S.

AU - Strid, Karin

AU - Tebbe, Anna Lena

AU - Thiele, Maleen

AU - Yuen, Francis

AU - Schuwerk, Tobias

N1 - Publisher Copyright: © 2023 The Authors. Infancy published by Wiley Periodicals LLC on behalf of International Congress of Infant Studies.

PY - 2024/1/1

Y1 - 2024/1/1

N2 - Measuring eye movements remotely via the participant's webcam promises to be an attractive methodological addition to in-person eye-tracking in the lab. However, there is a lack of systematic research comparing remote web-based eye-tracking with in-lab eye-tracking in young children. We report a multi-lab study that compared these two measures in an anticipatory looking task with toddlers using WebGazer.js and jsPsych. Results of our remotely tested sample of 18-27-month-old toddlers (N = 125) revealed that web-based eye-tracking successfully captured goal-based action predictions, although the proportion of the goal-directed anticipatory looking was lower compared to the in-lab sample (N = 70). As expected, attrition rate was substantially higher in the web-based (42%) than the in-lab sample (10%). Excluding trials based on visual inspection of the match of time-locked gaze coordinates and the participant's webcam video overlayed on the stimuli was an important preprocessing step to reduce noise in the data. We discuss the use of this remote web-based method in comparison with other current methodological innovations. Our study demonstrates that remote web-based eye-tracking can be a useful tool for testing toddlers, facilitating recruitment of larger and more diverse samples; a caveat to consider is the larger drop-out rate.

AB - Measuring eye movements remotely via the participant's webcam promises to be an attractive methodological addition to in-person eye-tracking in the lab. However, there is a lack of systematic research comparing remote web-based eye-tracking with in-lab eye-tracking in young children. We report a multi-lab study that compared these two measures in an anticipatory looking task with toddlers using WebGazer.js and jsPsych. Results of our remotely tested sample of 18-27-month-old toddlers (N = 125) revealed that web-based eye-tracking successfully captured goal-based action predictions, although the proportion of the goal-directed anticipatory looking was lower compared to the in-lab sample (N = 70). As expected, attrition rate was substantially higher in the web-based (42%) than the in-lab sample (10%). Excluding trials based on visual inspection of the match of time-locked gaze coordinates and the participant's webcam video overlayed on the stimuli was an important preprocessing step to reduce noise in the data. We discuss the use of this remote web-based method in comparison with other current methodological innovations. Our study demonstrates that remote web-based eye-tracking can be a useful tool for testing toddlers, facilitating recruitment of larger and more diverse samples; a caveat to consider is the larger drop-out rate.

KW - Psychology

KW - Anticipatory looking

KW - Eye-tracking

KW - Method Validation

KW - Toddlers

KW - Web-based eye-tracking

UR - http://www.scopus.com/inward/record.url?scp=85174228178&partnerID=8YFLogxK

U2 - 10.1111/infa.12564

DO - 10.1111/infa.12564

M3 - Journal articles

C2 - 37850726

VL - 29

SP - 31

EP - 55

JO - Infancy

JF - Infancy

SN - 1525-0008

IS - 1

ER -

Recently viewed

Activities

  1. The Linguistic Complexity of Test Items: Differential Effects for Students With Low and High Language Proficiency
  2. Towards a fully-automated adaptive e-learning environment: A predictive model for difficulty generating factors in gap-filling activities that target English tense-aspect-mood
  3. Digital Abstraction at the Interface between Electronic Media Arts and Data Visualization
  4. Co-Supervisor for the Dissertation "The effects of forest structural element retention on insect communities"
  5. Presentation of the paper entitled "Soft Optimal Computing to Identify Surface Roughness in Manufacturing using a Monotonic Regressor"
  6. Co-supervisor of the dissertation "Diversity and functions of plant-insect interactions along a forest retention gradient"
  7. Uncertainty and Subjectivity in Provenance Linked Open Data
  8. Placemaking today: integrating place-oriented thinking into cultural policy frameworks
  9. From Archives to Activism: Using Data to Challenge Structures in Art Collections
  10. Explicit References in Chat-Based CSCL: Do They Faciliate Global Text Processing?
  11. International Symposium on Multiscale Computational Analysis of Complex Materials
  12. Explaining primary school teachers’ usage of digital learning data: A mixed method study
  13. Mediating Atmospheres: Apprehending the Intersections of Data, Memory and Space
  14. Experiences with applying for and managing large DFG projects
  15. Implementing Sustainability Strategies Through Accounting Controls: An Exploration of Practices in Seven Multinational Corporations
  16. LC-MS identification of the photo-transformation products of desipramine with studying the effect of different environmental variables on the kinetics of their formation
  17. Transformations 2017
  18. Blogs in the Foreign Language Classroom
  19. Employer Longevity Readiness Index Workshop: Session 2: How do you build a longevity readiness Index?
  20. Field Experimentation in Governance Research. Early insights from researching the effectiveness of public participation in implementing the EU Floods Directive
  21. Provenance as (Linked) Data

Publications

  1. An Orthogonal Wavelet Denoising Algorithm for Surface Images of Atomic Force Microscopy
  2. Data-driven and physics-based modelling of process behaviour and deposit geometry for friction surfacing
  3. Teaching methods for modelling problems and students’ task-specific enjoyment, value, interest and self-efficacy expectations
  4. Self-regulation in error management training: emotion control and metacognition as mediators of performance effects
  5. Spaces for challenging experiences, indeterminacy, and experimentation
  6. Teachers’ use of data from digital learning platforms for instructional design
  7. Second language learners' performance in mathematics
  8. More input, better output
  9. How Much Home Office is Ideal? A Multi-Perspective Algorithm
  10. Passive Peak Voltage Sensor for Multiple Sending Coils Inductive Power Transmission System
  11. Top-down contingent attentional capture during feed-forward visual processing
  12. Effectiveness of a Web-Based Cognitive Behavioural Intervention for Subthreshold Depression
  13. Primary Side Circuit Design of a Multi-coil Inductive System for Powering Wireless Sensors
  14. Biodegradation screening of chemicals in an artificial matrix simulating the water-sediment interface
  15. Promising practices for dealing with complexity in research for development
  16. A Framework for Applying Natural Language Processing in Digital Health Interventions
  17. Enhancing EFL classroom instruction via the FeedBook: effects on language development and communicative language use.
  18. Internet and computer based interventions for cannabis use
  19. Web-scale extension of RDF knowledge bases from templated websites
  20. Active learning for network intrusion detection
  21. Global Finite-Time Stabilization of Planar Linear Systems With Actuator Saturation
  22. Simple saturated PID control for fast transient of motion systems
  23. Embarrassment as a public vs. private emotion and symbolic coping behaviour
  24. Adaptive control of the nonlinear dynamic behavior of the cantilever-sample system of an atomic force microscope
  25. Transductive support vector machines for structured variables
  26. »HOW TO MAKE YOUR OWN SAMPLES«
  27. E-stability and stability of adaptive learning in models with private information