Avoiding algorithm errors in textual analysis: A guide to selecting software, and a research agenda toward generative artificial intelligence

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

The use of textual analysis is expanding in organizational research, yet software packages vary in their compatibility with complex constructs. This study helps researchers select suitable tools by focusing on phrase-based dictionary methods. We empirically evaluate four software packages—LIWC, DICTION, CAT Scanner, and a custom Python tool—using the complex construct of value-based management as a test case. The analysis shows that software from the same methodological family produces highly consistent results, while popular but mismatched tools yield significant errors such as miscounted phrases. Based on this, we develop a structured selection guideline that links construct features with software capabilities. The framework enhances construct validity, supports methodological transparency, and is applicable across disciplines. Finally, we position the approach as a bridge to AI-enabled textual analysis, including prompt-based workflows, reinforcing the continued need for theory-grounded construct design.

Original languageEnglish
Article number115571
JournalJournal of Business Research
Volume199
Number of pages9
ISSN0148-2963
DOIs
Publication statusPublished - 10.2025

Bibliographical note

Publisher Copyright:
© 2025 The Authors

    Research areas

  • Algorithm error, Generative AI, Large language models, Reliability, Software selection, Textual analysis, Validity, Value-based management
  • Management studies

Recently viewed

Publications

  1. Supporting the Decision of the Order Processing Strategy by Using Logistic Models
  2. Sliding-Mode-Based Input-Output Linearization of a Peltier Element for Ice Clamping Using a State and Disturbance Observer
  3. Effects Of Different Order Processing Strategies On Operating Curves Of Logistic Models
  4. Circular Scanning Resolution Improvement by its Velocity Close Loop Control
  5. Development and application of a laboratory flux measurement system (LFMS) for the investigation of the kinetics of mercury emissions from soils
  6. An optimal minimum phase approximating PD regulator for robust control of a throttle plate
  7. MOLGEN-QSPR, a software package for the study of quantitative structure-property relationships.
  8. Planning for Sea Spaces I
  9. INVENTORY REDUCTION BY MODERN TECHNIQUES OF DYNAMIC REPLENISHMENT OF MATERIALS AVAILABILITY IN MANUFACTURING - PRACTICAL EXAMPLE FROM THE AUTOMOTIVE INDUSTRY
  10. “We cannot escape this”
  11. Development and validation of a measurement instrument for physical activity-related health literacy (PA-HL)
  12. Coupling stakeholder assessments of ecosystem services with biophysical ecosystem properties reveals importance of social contexts
  13. Call for Submissions Business Ethics Quarterly Special Issue on
  14. "Welch’ eine arme Sau"
  15. Polarisierung von Einkommen und Vermögen
  16. On Puppets, Dolls, and Harlequins: Textile Constellations between Emma Kunz and Eva Aeppli
  17. §4 Nr. 3 Mitbewerberschutz
  18. We´ve Been Here Before
  19. Seven Building Blocks for an Intergenerationally Just Democracy
  20. The Sweet Temptation of Corruption
  21. Outcome expectations and work design characteristics in post-retirement work planning