Challenges and pitfalls of designing, conducting, and evaluating web-based interventions

Activity: Talk or presentationConference PresentationsResearch

Dorota Reis - Speaker

Dirk Lehr - Speaker

Henning Freund - Speaker

Tanja Lischetzke - Speaker

    Main Abstract Content: State of the art: With the emergence of web-based interventions in the field ofOrganizational Behavior, we have to pay attention to methodological challenges and pitfalls ofdesigning, conducting, and evaluating intervention studies. Issues of appropriate design andadequate evaluation should be considered essential for both effectiveness of the intervention androbustness of the findings.Contributions: Based on our pre-registered study with a randomized controlled design (N=62), wedemonstrate challenges concerning the design of an intervention aiming to reduce perseverativethinking as the primary outcome in employees. Also, we report issues related to the recruitment andcompliance of participants. We show how researcher degrees of freedom, exploratory as opposed toconfirmatory analyses, (unintentional) p-hacking, and reporting bias might threaten the robustnessand replicability of our findings and bloat effect sizes.Research/Practical Implications: Given that web-based interventions are promising and cost-effective approaches to fostering occupational health, we need to ensure that the implementedprograms do not fail to come up to expectations raised by the research.Value: In this presentation, based on real study and data we demonstrate the most vulnerable pointsin the design and evaluation of intervention studies and suggest alternative strategies that might helpto enhance the quality of intervention research.
    17.05.201720.05.2017

    Event

    European Association of Work and Organizational Psychology - EAWOP 2017: Enabling Change through Work and Organizational Psychology

    17.05.1720.05.17

    Dublin, Ireland

    Event: Conference

    Documents

    Recently viewed

    Publications

    1. Investigation and modeling of the material behavior due to evolving dislocation microstructures in fcc and bcc metals
    2. Teachers’ use of data from digital learning platforms for instructional design
    3. Towards an open question answering architecture
    4. Who can nudge for sustainable development? How nudge source renders dynamic norms (in-)effective in eliciting sustainable behavior
    5. Deterministic Pod Repositioning in Robotic Mobile Fulfillment Systems
    6. Public Value: rethinking value creation
    7. Personalization strategies in digital mental health interventions: a systematic review and conceptual framework for depressive symptoms
    8. Intelligence assessment with computer simulations
    9. Within-individual leaf trait variation increases with phenotypic integration in a subtropical tree diversity experiment
    10. Recontextualizing Anthropomorphic Metaphors in Organization Studies
    11. Development and characterisation of a new interface for coupling capillary LC with collision-cell ICPMS and its application for phosphorylation profiling of tryptic protein digests
    12. Complementing AAI at the meso level
    13. A Preregistered Test of Competing Theories to Explain Ego Depletion Effects Using Psychophysiological Indicators of Mental Effort
    14. A web- And mobile-based intervention for comorbid, recurrent depression in patients with chronic back pain on sick leave (get.back)
    15. How to Communicate Science to the Public?
    16. Differentiating Different Types of Cognitive Load
    17. It's not regular TV
    18. How development leads to democracy
    19. Missiology: An Introduction to the Foundations, History, and Strategies of World Missions
    20. Implementation of EU labour law directives by way of national collective agreements
    21. Labelling Sustainable Software Products and Websites
    22. Editorial message
    23. Sense of Place in Spatial Planning
    24. Pragmatic Competence in EIL
    25. Toward a Framework for University-Based Entrepreneurial Ecosystems and Human Capital Development in Sub-Saharan Africa
    26. Case study analysis of laser-assisted Low-Cost Automation assembly
    27. Impact of an acceptance facilitating intervention on diabetes patients' acceptance of Internet-based interventions for depression
    28. Über Dieter Roth
    29. Corrigendum to “Rethinking economic practices and values as assemblages of more-than-human relations” [Ecological Economics 211 (2023) 107866]
    30. Hacking Crowdfunding
    31. Friction hysteresis compensation using phase correction of periodic trajectories
    32. Wasted compliance strategies? The policy-making styles of Hungary and Poland in the implementation of European environmental directives