Avoiding algorithm errors in textual analysis: A guide to selecting software, and a research agenda toward generative artificial intelligence

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

The use of textual analysis is expanding in organizational research, yet software packages vary in their compatibility with complex constructs. This study helps researchers select suitable tools by focusing on phrase-based dictionary methods. We empirically evaluate four software packages—LIWC, DICTION, CAT Scanner, and a custom Python tool—using the complex construct of value-based management as a test case. The analysis shows that software from the same methodological family produces highly consistent results, while popular but mismatched tools yield significant errors such as miscounted phrases. Based on this, we develop a structured selection guideline that links construct features with software capabilities. The framework enhances construct validity, supports methodological transparency, and is applicable across disciplines. Finally, we position the approach as a bridge to AI-enabled textual analysis, including prompt-based workflows, reinforcing the continued need for theory-grounded construct design.

Original languageEnglish
Article number115571
JournalJournal of Business Research
Volume199
Number of pages9
ISSN0148-2963
DOIs
Publication statusPublished - 10.2025

Bibliographical note

Publisher Copyright:
© 2025 The Authors

    Research areas

  • Algorithm error, Generative AI, Large language models, Reliability, Software selection, Textual analysis, Validity, Value-based management
  • Management studies

Recently viewed

Activities

  1. Detection of tactical patterns using semi-supervised graph neural networks
  2. Design of small touch screen interfaces for older users: The impact of screen size, task difficulty and task complexity
  3. Computer Simulations in Design. How Social Media meet Computational Methods in Design Processes
  4. Ant colony optimization algorithm and artificial immune system applied to a robot route
  5. Data-efficient Pattern Detection in Elite Soccer
  6. Institutional Proxy Representatives of Future Generations: A Comparative Analysis of Types and Design Features
  7. A sufficient asymptotic stability condition in generalised model predictive control to avoid input saturation
  8. Revisiting the concept of the script in institutional theory
  9. Design of controllers applied to autonomous unmanned aerial vehicles using software in the loop
  10. Detection time analysis of propulsion system fault effects in a hexacopter
  11. Sino-German Summer School on Design and data analysis of biodiversity-ecosystem functioning experiments 2011
  12. „Regional Conflicts & Contested Spatial Identities in the Digital Sphere”
  13. International Conference of Computational Methods in Engineering Science - Chair of Session III
  14. Structured Prediction in Social Contexts
  15. Plenary Speaker at the 2022 5th IEEE International Conference on Information Communication and Signal Processing (ICICSP 2022). Plenary entitled "Soft Optimal Computing Techniques to Identify and Control Surface Roughness in Manufacturing".
  16. Types of institutional proxy representatives for future generations in democracies: A comparative empirical analysis
  17. Self-tuning of a kalman filter applied in a DC drive and in a kalman-based sensor
  18. Required Task Interdependence - Daily Hassle or Uplift?
  19. Optimal scheduling for Automated Guided Vehicles (AGV) in blocking job-shops
  20. MDPI AG (Verlag)
  21. 13th CIRP Conference on INTELLIGENT COMPUTATION IN MANUFACTURING ENGINEERING - CIRP ICME ’19
  22. Dominicus Noll

Publications

  1. Avoiding algorithm errors in textual analysis
  2. Neural network-based adaptive fault-tolerant control for strict-feedback nonlinear systems with input dead zone and saturation
  3. A transfer operator based computational study of mixing processes in open flow systems
  4. Cross-document coreference resolution using latent features
  5. On the Decoupling and Output Functional Controllability of Robotic Manipulation
  6. Promising practices for dealing with complexity in research for development
  7. A new way of assessing the interaction of a metallic phase precursor with a modified oxide support substrate as a source of information for predicting metal dispersion
  8. Advances in Dynamics, Optimization and Computation
  9. Mostly harmless econometrics? Statistical paradigms in the ‘top five’ from 2000 to 2018
  10. Guest Editors' Introduction
  11. Combining fusion-based and solid-state additive manufacturing
  12. When it really counts
  13. Bed-Sharing in Couples Is Associated With Increased and Stabilized REM Sleep and Sleep-Stage Synchronization
  14. Wozu in Tönen denken?
  15. An optimal minimum phase approximating PD regulator for robust control of a throttle plate
  16. Frame Diffusion
  17. If you call for frameworks in sustainability management... editorial to the special issue
  18. Learning Online: A Comparison of Different Media Types
  19. Dealing with inclusion–teachers’ assessment of internal and external resources
  20. Learning Analytics and Personalized Learning
  21. Continental mapping of forest ecosystem functions reveals a high but unrealised potential for forest multifunctionality.
  22. Along the Path of the Pine, the Parrot, and the Tortoise