Challenges and pitfalls of designing, conducting, and evaluating web-based interventions

Activity: Talk or presentationConference PresentationsResearch

Dorota Reis - Speaker

Dirk Lehr - Speaker

Henning Freund - Speaker

Tanja Lischetzke - Speaker

    Main Abstract Content: State of the art: With the emergence of web-based interventions in the field ofOrganizational Behavior, we have to pay attention to methodological challenges and pitfalls ofdesigning, conducting, and evaluating intervention studies. Issues of appropriate design andadequate evaluation should be considered essential for both effectiveness of the intervention androbustness of the findings.Contributions: Based on our pre-registered study with a randomized controlled design (N=62), wedemonstrate challenges concerning the design of an intervention aiming to reduce perseverativethinking as the primary outcome in employees. Also, we report issues related to the recruitment andcompliance of participants. We show how researcher degrees of freedom, exploratory as opposed toconfirmatory analyses, (unintentional) p-hacking, and reporting bias might threaten the robustnessand replicability of our findings and bloat effect sizes.Research/Practical Implications: Given that web-based interventions are promising and cost-effective approaches to fostering occupational health, we need to ensure that the implementedprograms do not fail to come up to expectations raised by the research.Value: In this presentation, based on real study and data we demonstrate the most vulnerable pointsin the design and evaluation of intervention studies and suggest alternative strategies that might helpto enhance the quality of intervention research.
    17.05.201720.05.2017

    Event

    European Association of Work and Organizational Psychology - EAWOP 2017: Enabling Change through Work and Organizational Psychology

    17.05.1720.05.17

    Dublin, Ireland

    Event: Conference

    Documents

    Recently viewed

    Publications

    1. Binary Random Nets I
    2. Using learning protocols for knowledge acquisition and problem solving with individual and group incentives
    3. Homogenization modeling of thin-layer-type microstructures
    4. Closed-loop control of product geometry by using an artificial neural network in incremental sheet forming with active medium
    5. Performance and Comfort when Using Motion-Controlled Tools in Complex Tasks
    6. A simple fuzzy controller for robot manipulators with bounded inputs
    7. Microstructural development of as-cast AM50 during Constrained Friction Processing: grain refinement and influence of process parameters
    8. Latent structure perceptron with feature induction for unrestricted coreference resolution
    9. A change of values is in the air
    10. Analysis of Complexity Reduction in Kalman Filters Through Decoupling Control With Chattered Inputs in PMSM
    11. Volume of Imbalance Container Prediction using Kalman Filter and Long Short-Term Memory
    12. Improving short-term academic performance in the flipped classroom using dynamic geometry software
    13. A two-stage Kalman estimator for motion control using model predictive strategy
    14. A reference architecture for the integration of EMIS and ERP-Systems
    15. How to support teachers to give feedback to modelling tasks effectively? Results from a teacher-training-study in the Co²CA project
    16. Interrogating the Phenomenon of Suffering and Smiling by Nigerians: A Mixed Methods Study
    17. In situ synchrotron diffraction of the solidification of Mg4Y3Nd
    18. Stakeholder involvement for Water Framework Directive implementation in Germany
    19. Front in the mouth, front in the word
    20. Old Wine in New Bottles? The Case of Self-compassion and Neuroticism
    21. Die Liebe der Soziologie
    22. Antigott
    23. The use of force against terrorists
    24. Geometrical Accuracy in Two-Stage Incremental Sheet Forming with Active Medium
    25. Komparative studier i børnelitterature
    26. (Un)sichtbare Botschaften
    27. Multimodality in Strategy-as-Practice Research
    28. The Good have a Website