Avoiding Algorithm Error in Computer-Aided Text Analyses: Selecting Text Analysis Software

Research output: Journal contributionsConference abstract in journalResearchpeer-review

Standard

Avoiding Algorithm Error in Computer-Aided Text Analyses: Selecting Text Analysis Software. / Wobst, Janice; Lueg, Rainer.
In: Academy of Management Proceedings, Vol. 2022, No. 1, 01.08.2022.

Research output: Journal contributionsConference abstract in journalResearchpeer-review

Harvard

APA

Vancouver

Bibtex

@article{b2aff5492ec948e39934ea1f38e67892,
title = "Avoiding Algorithm Error in Computer-Aided Text Analyses: Selecting Text Analysis Software",
abstract = "The use of computer-aided text analysis as a tool to quantify qualitative information continues to grow in management research. Academia increasingly develops guiding principles that aid scholars in addressing reliability and validity issues. However, there is little guidance in selecting a proper software solution that aligns the features of the software with the features of the underlying construct. Further guidelines are particularly relevant because computer-aided text analysis is highly software dependent. This paper demonstrates a systematic software selection process using two illustrative constructs: a theoretically complex construct (value- based management sophistication) and a more straightforward construct (firm{\textquoteright}s future orientation). The paper develops generalizable principles for selecting proper software solutions. After reviewing relevant literature, this paper compares the algorithmic proximity of frequently applied software solutions in management research, performing analysis of variance and convergent validity analysis. The results demonstrate that the algorithmic performance depends on the construct type. The analysis of variance indicates statistically significant differences in mean values between various software solutions. However, these differences do not lead to substantial deviations in convergent validity results between the applied software solutions. This paper contributes to the literature by assisting scholars in choosing a proper software solution when conducting computer-aided text analysis.",
keywords = "Management studies",
author = "Janice Wobst and Rainer Lueg",
year = "2022",
month = aug,
day = "1",
doi = "10.5465/AMBPP.2022.10504abstract",
language = "English",
volume = "2022",
journal = "Academy of Management Proceedings",
issn = "0065-0668",
publisher = "Academy of Management (Briarcliff Manor, NY) ",
number = "1",
note = "82nd Annual Meeting of the Academy of Management - AOM 2022 : Creating a Better World Together, AOM 2022 ; Conference date: 05-08-2022 Through 09-08-2022",
url = "https://2022.aom.org/, https://aom.org/events/event-detail/2022/08/05/higher-logic-calendar/the-82nd-annual-meeting-of-the-academy-of-management",

}

RIS

TY - JOUR

T1 - Avoiding Algorithm Error in Computer-Aided Text Analyses

T2 - 82nd Annual Meeting of the Academy of Management - AOM 2022

AU - Wobst, Janice

AU - Lueg, Rainer

N1 - Conference code: 82

PY - 2022/8/1

Y1 - 2022/8/1

N2 - The use of computer-aided text analysis as a tool to quantify qualitative information continues to grow in management research. Academia increasingly develops guiding principles that aid scholars in addressing reliability and validity issues. However, there is little guidance in selecting a proper software solution that aligns the features of the software with the features of the underlying construct. Further guidelines are particularly relevant because computer-aided text analysis is highly software dependent. This paper demonstrates a systematic software selection process using two illustrative constructs: a theoretically complex construct (value- based management sophistication) and a more straightforward construct (firm’s future orientation). The paper develops generalizable principles for selecting proper software solutions. After reviewing relevant literature, this paper compares the algorithmic proximity of frequently applied software solutions in management research, performing analysis of variance and convergent validity analysis. The results demonstrate that the algorithmic performance depends on the construct type. The analysis of variance indicates statistically significant differences in mean values between various software solutions. However, these differences do not lead to substantial deviations in convergent validity results between the applied software solutions. This paper contributes to the literature by assisting scholars in choosing a proper software solution when conducting computer-aided text analysis.

AB - The use of computer-aided text analysis as a tool to quantify qualitative information continues to grow in management research. Academia increasingly develops guiding principles that aid scholars in addressing reliability and validity issues. However, there is little guidance in selecting a proper software solution that aligns the features of the software with the features of the underlying construct. Further guidelines are particularly relevant because computer-aided text analysis is highly software dependent. This paper demonstrates a systematic software selection process using two illustrative constructs: a theoretically complex construct (value- based management sophistication) and a more straightforward construct (firm’s future orientation). The paper develops generalizable principles for selecting proper software solutions. After reviewing relevant literature, this paper compares the algorithmic proximity of frequently applied software solutions in management research, performing analysis of variance and convergent validity analysis. The results demonstrate that the algorithmic performance depends on the construct type. The analysis of variance indicates statistically significant differences in mean values between various software solutions. However, these differences do not lead to substantial deviations in convergent validity results between the applied software solutions. This paper contributes to the literature by assisting scholars in choosing a proper software solution when conducting computer-aided text analysis.

KW - Management studies

UR - https://www.mendeley.com/catalogue/b0111894-6344-37b7-8715-2fcc9981fbb5/

U2 - 10.5465/AMBPP.2022.10504abstract

DO - 10.5465/AMBPP.2022.10504abstract

M3 - Conference abstract in journal

VL - 2022

JO - Academy of Management Proceedings

JF - Academy of Management Proceedings

SN - 0065-0668

IS - 1

Y2 - 5 August 2022 through 9 August 2022

ER -

Recently viewed

Publications

  1. Database Publishing Without Databases
  2. Agile knowledge graph testing with TESTaLOD
  3. How to get really smart: Modeling retest and training effects in ability testing using computer-generated figural matrix items
  4. Semi-supervised learning for structured output variables
  5. Evolutionary generation of dispatching rule sets for complex dynamic scheduling problems
  6. Different complex word problems require different combinations of cognitive skills
  7. Simultaneous Constrained Adaptive Item Selection for Group-Based Testing
  8. Noise Detection for Biosignals Using an Orthogonal Wavelet Packet Tree Denoising Algorithm
  9. Applying Bayesian Parameter Estimation to A/B Tests in e-Business Applications
  10. Problem structuring for transitions
  11. Diffusion-driven microstructure evolution in OpenCalphad
  12. How to combine collaboration scripts and heuristic worked examples to foster mathematical argumentation - when working memory matters
  13. An Improved Approach to the Semi-Process-Oriented Implementation of Standardised ERP-Systems
  14. Global temporal typing patterns in foreign language writing
  15. Gain Scheduling Controller for Improving Level Control Performance
  16. Retest effects in matrix test performance
  17. Anatomy of Haar Wavelet Filter and Its Implementation for Signal Processing
  18. Template-based Question Answering using Recursive Neural Networks
  19. Sequencing and fading worked examples and collaboration scripts to foster mathematical argumentation - working memory capacity matters for fading
  20. Four Methods to Distinguish between Fractal Dimensions in Time Series through Recurrence Quantification Analysis