Computer Vision for Analyzing Children’s Lived Experiences

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

Children’s social and physical environment plays a significant role in their cognitive development. Therefore, children’s lived experiences are important to developmental psychologists. The traditional way of studying everyday experiences has become a bottleneck because it relies on short recordings and manual coding. Designing a non-invasive child-friendly recording setup and automating the coding process can potentially improve the research standards by allowing researchers to study longer and more diverse aspects of experience. We leverage modern computer vision tools and techniques to address this problem. We present a simple and non-invasive video recording setup and collect egocentric data from children. We test the state-of-the-art object detectors and observe that egocentric videos from children are a challenging problem, indicated by the low mean Average Precision of state-of-the-art. The performance of these object detectors can be improved through fine-tuning. Once accurate object detection has been achieved, other questions, such as human-object interaction and scene understanding, can be answered. Developing an automatic processing pipeline may provide an important tool for developmental psychologists to study variation in everyday experience.

Original languageEnglish
Title of host publicationIntelligent Systems and Applications - Proceedings of the 2023 Intelligent Systems Conference IntelliSys Volume 2
EditorsKohei Arai
Number of pages8
Place of PublicationCham
PublisherSpringer Science and Business Media Deutschland GmbH
Publication date2024
Pages376-383
ISBN (print)978-3-031-47723-2
ISBN (electronic)978-3-031-47724-9
DOIs
Publication statusPublished - 2024
EventIntelligent Systems Conference, IntelliSys 2023 - Amsterdam, Netherlands
Duration: 07.09.202308.09.2023

Bibliographical note

Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

    Research areas

  • Cognitive development, Egocentric computer vision, Object detection
  • Psychology