Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood

Research output: Journal contributionsJournal articlesResearchpeer-review

Standard

Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood. / Steffan, Adrian; Zimmer, Lucie; Arias-Trejo, Natalia et al.
In: Infancy, Vol. 29, No. 1, 01.01.2024, p. 31-55.

Research output: Journal contributionsJournal articlesResearchpeer-review

Harvard

Steffan, A, Zimmer, L, Arias-Trejo, N, Bohn, M, Dal Ben, R, Flores-Coronado, MA, Franchin, L, Garbisch, I, Grosse Wiesmann, C, Hamlin, K, Havron, N, Hay, JF, Hermansen, TK, Jakobsen, KV, Kalinke, S, Ko, ES, Kulke, L, Mayor, J, Meristo, M, Moreau, D, Mun, S, Prein, J, Rakoczy, H, Rothmaler, K, Santos Oliveira, D, Simpson, EA, Sirois, S, Smith, ES, Strid, K, Tebbe, AL, Thiele, M, Yuen, F & Schuwerk, T 2024, 'Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood', Infancy, vol. 29, no. 1, pp. 31-55. https://doi.org/10.1111/infa.12564, https://doi.org/10.31234/osf.io/7924h

APA

Steffan, A., Zimmer, L., Arias-Trejo, N., Bohn, M., Dal Ben, R., Flores-Coronado, M. A., Franchin, L., Garbisch, I., Grosse Wiesmann, C., Hamlin, K., Havron, N., Hay, J. F., Hermansen, T. K., Jakobsen, K. V., Kalinke, S., Ko, E. S., Kulke, L., Mayor, J., Meristo, M., ... Schuwerk, T. (2024). Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood. Infancy, 29(1), 31-55. https://doi.org/10.1111/infa.12564, https://doi.org/10.31234/osf.io/7924h

Vancouver

Steffan A, Zimmer L, Arias-Trejo N, Bohn M, Dal Ben R, Flores-Coronado MA et al. Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood. Infancy. 2024 Jan 1;29(1):31-55. Epub 2023 Oct 18. doi: 10.1111/infa.12564, 10.31234/osf.io/7924h

Bibtex

@article{be037aa7eb0944f49f4839c4ab2d7832,
title = "Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood",
abstract = "Measuring eye movements remotely via the participant's webcam promises to be an attractive methodological addition to in-person eye-tracking in the lab. However, there is a lack of systematic research comparing remote web-based eye-tracking with in-lab eye-tracking in young children. We report a multi-lab study that compared these two measures in an anticipatory looking task with toddlers using WebGazer.js and jsPsych. Results of our remotely tested sample of 18-27-month-old toddlers (N = 125) revealed that web-based eye-tracking successfully captured goal-based action predictions, although the proportion of the goal-directed anticipatory looking was lower compared to the in-lab sample (N = 70). As expected, attrition rate was substantially higher in the web-based (42%) than the in-lab sample (10%). Excluding trials based on visual inspection of the match of time-locked gaze coordinates and the participant's webcam video overlayed on the stimuli was an important preprocessing step to reduce noise in the data. We discuss the use of this remote web-based method in comparison with other current methodological innovations. Our study demonstrates that remote web-based eye-tracking can be a useful tool for testing toddlers, facilitating recruitment of larger and more diverse samples; a caveat to consider is the larger drop-out rate.",
keywords = "Psychology, Anticipatory looking, Eye-tracking, Method Validation, Toddlers, Web-based eye-tracking",
author = "Adrian Steffan and Lucie Zimmer and Natalia Arias-Trejo and Manuel Bohn and {Dal Ben}, Rodrigo and Flores-Coronado, {Marco A.} and Laura Franchin and Isa Garbisch and {Grosse Wiesmann}, Charlotte and Kiley Hamlin and Naomi Havron and Hay, {Jessica F.} and Hermansen, {Tone K.} and Jakobsen, {Krisztina V.} and Steven Kalinke and Ko, {Eon Suk} and Louisa Kulke and Julien Mayor and Marek Meristo and David Moreau and Seongmin Mun and Julia Prein and Hannes Rakoczy and Katrin Rothmaler and {Santos Oliveira}, Daniela and Simpson, {Elizabeth A.} and Sylvain Sirois and Smith, {Eleanor S.} and Karin Strid and Tebbe, {Anna Lena} and Maleen Thiele and Francis Yuen and Tobias Schuwerk",
note = "Publisher Copyright: {\textcopyright} 2023 The Authors. Infancy published by Wiley Periodicals LLC on behalf of International Congress of Infant Studies.",
year = "2024",
month = jan,
day = "1",
doi = "10.1111/infa.12564",
language = "English",
volume = "29",
pages = "31--55",
journal = "Infancy",
issn = "1525-0008",
publisher = "Wiley-Blackwell Publishing, Inc.",
number = "1",

}

RIS

TY - JOUR

T1 - Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood

AU - Steffan, Adrian

AU - Zimmer, Lucie

AU - Arias-Trejo, Natalia

AU - Bohn, Manuel

AU - Dal Ben, Rodrigo

AU - Flores-Coronado, Marco A.

AU - Franchin, Laura

AU - Garbisch, Isa

AU - Grosse Wiesmann, Charlotte

AU - Hamlin, Kiley

AU - Havron, Naomi

AU - Hay, Jessica F.

AU - Hermansen, Tone K.

AU - Jakobsen, Krisztina V.

AU - Kalinke, Steven

AU - Ko, Eon Suk

AU - Kulke, Louisa

AU - Mayor, Julien

AU - Meristo, Marek

AU - Moreau, David

AU - Mun, Seongmin

AU - Prein, Julia

AU - Rakoczy, Hannes

AU - Rothmaler, Katrin

AU - Santos Oliveira, Daniela

AU - Simpson, Elizabeth A.

AU - Sirois, Sylvain

AU - Smith, Eleanor S.

AU - Strid, Karin

AU - Tebbe, Anna Lena

AU - Thiele, Maleen

AU - Yuen, Francis

AU - Schuwerk, Tobias

N1 - Publisher Copyright: © 2023 The Authors. Infancy published by Wiley Periodicals LLC on behalf of International Congress of Infant Studies.

PY - 2024/1/1

Y1 - 2024/1/1

N2 - Measuring eye movements remotely via the participant's webcam promises to be an attractive methodological addition to in-person eye-tracking in the lab. However, there is a lack of systematic research comparing remote web-based eye-tracking with in-lab eye-tracking in young children. We report a multi-lab study that compared these two measures in an anticipatory looking task with toddlers using WebGazer.js and jsPsych. Results of our remotely tested sample of 18-27-month-old toddlers (N = 125) revealed that web-based eye-tracking successfully captured goal-based action predictions, although the proportion of the goal-directed anticipatory looking was lower compared to the in-lab sample (N = 70). As expected, attrition rate was substantially higher in the web-based (42%) than the in-lab sample (10%). Excluding trials based on visual inspection of the match of time-locked gaze coordinates and the participant's webcam video overlayed on the stimuli was an important preprocessing step to reduce noise in the data. We discuss the use of this remote web-based method in comparison with other current methodological innovations. Our study demonstrates that remote web-based eye-tracking can be a useful tool for testing toddlers, facilitating recruitment of larger and more diverse samples; a caveat to consider is the larger drop-out rate.

AB - Measuring eye movements remotely via the participant's webcam promises to be an attractive methodological addition to in-person eye-tracking in the lab. However, there is a lack of systematic research comparing remote web-based eye-tracking with in-lab eye-tracking in young children. We report a multi-lab study that compared these two measures in an anticipatory looking task with toddlers using WebGazer.js and jsPsych. Results of our remotely tested sample of 18-27-month-old toddlers (N = 125) revealed that web-based eye-tracking successfully captured goal-based action predictions, although the proportion of the goal-directed anticipatory looking was lower compared to the in-lab sample (N = 70). As expected, attrition rate was substantially higher in the web-based (42%) than the in-lab sample (10%). Excluding trials based on visual inspection of the match of time-locked gaze coordinates and the participant's webcam video overlayed on the stimuli was an important preprocessing step to reduce noise in the data. We discuss the use of this remote web-based method in comparison with other current methodological innovations. Our study demonstrates that remote web-based eye-tracking can be a useful tool for testing toddlers, facilitating recruitment of larger and more diverse samples; a caveat to consider is the larger drop-out rate.

KW - Psychology

KW - Anticipatory looking

KW - Eye-tracking

KW - Method Validation

KW - Toddlers

KW - Web-based eye-tracking

UR - http://www.scopus.com/inward/record.url?scp=85174228178&partnerID=8YFLogxK

U2 - 10.1111/infa.12564

DO - 10.1111/infa.12564

M3 - Journal articles

C2 - 37850726

VL - 29

SP - 31

EP - 55

JO - Infancy

JF - Infancy

SN - 1525-0008

IS - 1

ER -

Recently viewed

Activities

  1. GET.ON PAPP: Feasibility of a mobile application for panic with and without agoraphobia
  2. The 22nd International Semantic Web Conference (ISWC 2023)
  3. Towards a fully-automated adaptive e-learning environment: A predictive model for difficulty generating factors in gap-filling activities that target English tense-aspect-mood
  4. The Irish English discourse marker sure at the semantics/pragmatics interface
  5. Zombieland: Agent-based Computer Simulation
  6. Between Connections and Knowledge: An Approach to Culture through Graph Theory and Complex Systems
  7. Co-supervisor of the dissertation "Diversity and functions of plant-insect interactions along a forest retention gradient"
  8. From Podcast to Simulation Projects - Web 2.0 Projects in the Secondary EFL Classroom
  9. Global Platform Companies in Local Fields between Disruption and Integration
  10. Uncertainty and Subjectivity in Provenance Linked Open Data
  11. Interstitial spaces as garbage cans of field transformation where problems and solutions meet: the case of blockchain and music cross-fertilization
  12. Placemaking today: integrating place-oriented thinking into cultural policy frameworks
  13. Dynamical systems methods in fluid mechanics
  14. Lagrangian aspects of turbulent superstructures: numerical analysis of long-term dynamics and transport properties
  15. Continuous Innovation through Modular Upgradeability: How Software Upgrades Affect Consumer Product Valuations
  16. Princeton University
  17. Field Experimentation in Governance Research. Early insights from researching the effectiveness of public participation in implementing the EU Floods Directive
  18. Creating Third Spaces for Transdisciplinary Research
  19. From Archives to Activism: Using Data to Challenge Structures in Art Collections
  20. Concurrent Reconceptualization of Concurrent Sourcing
  21. Challenging the functionality of audits: Examining the bureaucratization of risks with Franz Kafka
  22. Explicit References in Chat-Based CSCL: Do They Faciliate Global Text Processing?

Publications

  1. An Orthogonal Wavelet Denoising Algorithm for Surface Images of Atomic Force Microscopy
  2. A Multilevel Inverter Bridge Control Structure with Energy Storage Using Model Predictive Control for Flat Systems
  3. Mirrored piezo servo hydraulic actuators for use in camless combustion engines and its Control with mirrored inputs and MPC
  4. Data-driven and physics-based modelling of process behaviour and deposit geometry for friction surfacing
  5. Competing Vegetation Structure Indices for Estimating Spatial Constrains in Carabid Abundance Patterns in Chinese Grasslands Reveal Complex Scale and Habitat Patterns
  6. Teaching methods for modelling problems and students’ task-specific enjoyment, value, interest and self-efficacy expectations
  7. Digging into the roots
  8. Using transition management concepts for the evaluation of intersecting policy domains ('grand challenges')
  9. Commitment to grand challenges in fluid forms of organizing
  10. Resource extraction technologies - is a more responsible path of development possible?
  11. Using augmented video to test in-car user experiences of context analog HUDs
  12. Teachers’ use of data from digital learning platforms for instructional design
  13. Modeling Conditional Dependencies in Multiagent Trajectories
  14. Second language learners' performance in mathematics
  15. Acceleration of material-dominated calculations via phase-space simplicial subdivision and interpolation
  16. Sliding mode and model predictive control for inverse pendulum
  17. Factor structure and measurement invariance of the Students’ Self-report Checklist of Social and Learning Behaviour (SSL)
  18. Model predictive control for switching gain adaptation in a sliding mode controller of a DC drive with nonlinear friction
  19. Mechanism of dynamic recrystallization and evolution of texture in the hot working domains of the processing map for Mg-4Al-2Ba-2Ca Alloy
  20. More input, better output
  21. A comparison of ML, WLSMV and Bayesian methods for multilevel structural equation models in small samples: A simulation study
  22. Optimizing price levels in e-commerce applications with respect to customer lifetime values
  23. Passive Peak Voltage Sensor for Multiple Sending Coils Inductive Power Transmission System
  24. Dynamic environment modelling and prediction for autonomous systems
  25. Emergency detection based on probabilistic modeling in AAL-environments
  26. Top-down contingent attentional capture during feed-forward visual processing