Using a Longitudinal Mixed-Methods Approach in HESD Research: Reflections on Pitfalls and Added Value

Activity: Talk or presentationConference PresentationsResearch

Anna Sundermann - Speaker

Daniel Fischer - Coauthor

    The year 2015 marks the end of the UN Decade of Education for Sustainable Development (UNDESD) and the beginning of the UN Global Action Programme (GAP). UNESCO’s final report on the UNDESD (2014) acknowledges that significant achievements have been made between 2005 and 2014 in multiplying universities’ contributions to advancing sustainable development. A priority area of action for the next five years in the UN GAP will be to embrace ESD more holistically in higher education institutions (HEIs). With regard to curriculum reform, it is suggested to implement sustainable development as a “learning outcome and lifelong orientation across all fields of study” (UNESCO 2014, 127). While there is an ample account of practical initiatives to implement ESD into university curricula and study programs, it is at the same time contested that research on Higher Education for Sustainable Development (HESD) is dominated by case studies (Corcoran et al. 2004) and that with regard to learning processes “ESD remains poorly researched and weakly evidenced” (Tilbury 2011, 9). Against this backdrop, research is called for that is able to employ more comprehensive approaches by combining or integrating different research traditions and by extending the snapshot scope of short-term studies (Barth 2015, Reid & Scott 2013). Mixed-methods and longitudinal research designs have the potential to overcome the aforementioned shortcomings. However, they do not yet feature prominently in (H)ESD research (Reid & Scott 2006, Barth & Rieckmann 2013).This paper aims to contribute to the debate about the requirements, potential risks and benefits using of mixed-methods and longitudinal research designs in (H)ESD research. It introduces and discusses the longitudinal mixed-methods design of a study that is currently being implemented at Leuphana University Lüneburg in Northern Germany (2012-2016). Sustainability is a key overall education objective at Leuphana University, an example of this being an extensive module on sustainability that is delivered to all students of the first semester as a compulsory part of the curriculum, independent of their future academic specialization (Michelsen 2013). The overall objective of the study was to explore what and how students learn related to sustainable development from 1st semester to graduation, and in how far these learning processes and outcomes are influenced by the university’s curricular offers. The design of the study that this paper draws on involves three cohorts of students (commencing 2012, 2013 and 2014) as well as an external comparison group from other universities. Data is assessed several times during the course of their studies (before and after semester one, in semester four and six) by means of online questionnaires and focus groups interviews.MethodThe methodological analysis and discussion of the study design in this paper builds on some conceptual distinctions and differentiations made in the mixed methods discourse. Exemplary key questions in this respect are (Bergman 2010, Jäger-Erben et al. 2012, Johnson et al. 2007): - What objectives are pursued with mixing methods? (e.g. complementarity, extension, validation) - On which levels and with what weight are the different methods interlinked? (e.g. multi method, integration,triangulation) - What concepts does the study focus on and how do they relate to the different methods used? - How are quantitative and qualitative methods integrated? (e.g. common research questions, sample generation, data collection and analysis, interpretation and findings) - How are quantitative and qualitative methods sequenced? (e.g. preliminary study model, generalization study model, triangulation study model) In the light of these questions the paper provides a discussion of the study design to state how it increases the level of integration. For each question practical guidance and potential pitfalls will be outlined. Where appropriate, the approach of the study to realize existing research standards is critically reflected. As a result the paper contributes to the debate on quality criteria for mixed-method research.Expected OutcomesExpected outcomes exist in three different respects. Firstly, the methodological reflections on the design of the longitudinal mixed-methods study are informed and guided by a heuristic set of key questions that refer to different approaches to and traditions of mixed-methods research. This heuristic set of key questions marks an outcome itself that can be of potential value also to other researchers in the field. Secondly, reflections on a methodological level are also help to further elucidate and specify the contributions that the study can make not only in comparison with existing studies on student learning in HEIs, but also with regard to advancing more comprehensive study and research designs in the field. Thirdly, and finally, the reflective exercise and methodological discussion will hopefully stimulate more intense discussion and possibly new perspectives for comparative research on pitfalls in designing and applying a longitudinal mixed-methods approach and additional values that it can possibly add to the evidence base within the broader ESD research community.ReferencesBarth, M. & Rieckmann, M. (2013). Current trends and approaches in research in Higher Education for Sustainable Development – an international literature review from 1992-2012. Paper presented at ERSCP-EMSU 2013, Istanbul. Barth, M. (2015). Implementing sustainability in higher education: Learning in an age of transformation. London: Routledge. Bergman, M. M. (2010). On Concepts and Paradigms in Mixed Methods Research. Journal of Mixed Methods Research, 4(3), 171–175. Corcoran, P. B. et al. (2004). Case studies, make‐your‐case studies, and case stories: a critique of case‐study methodology in sustainability in higher education. Environmental Education Research, 10(1), 7–21. Jäger-Erben, M. et al. (2012). Using ‘mixed methods’ in sustainable consumption research: approaches, challenges and added value. In R. Defila, A. Di Giulio, & R. Kaufmann-Hayoz (Eds.), The Nature of Sustainable Consumption and How to Achieve it. (pp. 143–159). München: Oekom. Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A. (2007). Toward a Definition of Mixed Methods Research. Journal of Mixed Methods Research, 1(2), 112–133. Michelsen, G. (2013). Sustainable development as a challenge for undergraduate students: the module "Science bears responsibility" in the Leuphana bachelor's programme: Commentary on "a case study of teaching social responsibility to doctoral students in the climate sciences". Science and engineering ethics, 19(4), 1505–1511. Reid, A., & Scott, W. R. (2006). Researching education and the environment: retrospect and prospect. Environmental Education Research, 12(3-4), 571–587. Reid, A., & Scott, W. R. (2013). Identifying Needs in Environmental Education Research. In R. B. Stevenson, M. Brody, J. Dillon, & A. E. J. Wals (Eds.), International handbook of research on environmental education (pp. 518–528). New York: Routledge. Tilbury, D. (2011). Education for Sustainable Development: An Expert Review of Processes and Learning. Paris: UNESCO UNESCO (2014). Shaping the Future We Want: UN Decade of Education for Sustainable Development (2005-2014): Final Report. DESD Monitoring and Evaluation. Paris: UNESCO Publishing.
    08.09.2015

    Event

    European Conference on Educational Research - ECER 2015: Education and Transition - Contributions from Educational Research

    07.09.1511.09.15

    Budapest, Hungary

    Event: Conference

    Recently viewed

    Publications

    1. Dispatching rule selection with Gaussian processes
    2. Unidimensional and Multidimensional Methods for Recurrence Quantification Analysis with crqa
    3. Optimizing sampling of flying insects using a modified window trap
    4. Finding Similar Movements in Positional Data Streams
    5. Exploration strategies, performance, and error consequences when learning a complex computer task
    6. The Use of Genetic Algorithm for PID Controller Auto-Tuning in ARM CORTEX M4 Platform
    7. Lyapunov stability analysis to set up a PI controller for a mass flow system in case of a non-saturating input
    8. Empowering materials processing and performance from data and AI
    9. Multidimensional Cross-Recurrence Quantification Analysis (MdCRQA)–A Method for Quantifying Correlation between Multivariate Time-Series
    10. Changing the Administration from within:
    11. Using cross-recurrence quantification analysis to compute similarity measures for time series of unequal length with applications to sleep stage analysis
    12. Using Decision Trees and Reinforcement Learning for the Dynamic Adjustment of Composite Sequencing Rules in a Flexible Manufacturing System
    13. On the Functional Controllability Using a Geometric Approach together with a Decoupled MPC for Motion Control in Robotino
    14. On the Power and Performance of a Doubly Latent Residual Approach to Explain Latent Specific Factors in Multilevel-Bifactor-(S-1) Models
    15. The role of learners’ memory in app-based language instruction: the case of Duolingo.
    16. Using learning protocols for knowledge acquisition and problem solving with individual and group incentives
    17. Hierarchical trait filtering at different spatial scales determines beetle assemblages in deadwood
    18. Improving short-term academic performance in the flipped classroom using dynamic geometry software
    19. A model predictive control for an aggregate actuator with a self-tuning initial condition procedure in combustion engines
    20. An extended analytical approach to evaluating monotonic functions of fuzzy numbers
    21. FaST: A linear time stack trace alignment heuristic for crash report deduplication
    22. A computational study of a model of single-crystal strain-gradient viscoplasticity with an interactive hardening relation
    23. Predicting the Difficulty of Exercise Items for Dynamic Difficulty Adaptation in Adaptive Language Tutoring
    24. Lyapunov Convergence Analysis for Asymptotic Tracking Using Forward and Backward Euler Approximation of Discrete Differential Equations
    25. Distinguishing state variability from trait change in longitudinal data
    26. Return of Fibonacci random walks
    27. A Switching Cascade Sliding PID-PID Controllers Combined with a Feedforward and an MPC for an Actuator in Camless Internal Combustion Engines
    28. Appendix A: Design, implementation, and analysis of the iGOES project
    29. Evaluation of Time/Phase Parameters in Frequency Measurements for Inertial Navigation Systems
    30. Investigation and modeling of the material behavior due to evolving dislocation microstructures in fcc and bcc metals
    31. Dynamic environment modelling and prediction for autonomous systems
    32. An expert-based reference list of variables for characterizing and monitoring social-ecological systems
    33. Towards a Bayesian Student Model for Detecting Decimal Misconceptions
    34. Considerations on efficient touch interfaces - How display size influences the performance in an applied pointing task
    35. For a return to the forgotten formula: 'Data 1 + Data 2 > Data 1'
    36. Efficient and accurate ℓ p-norm multiple kernel learning