Stressing the Relevance of Differentiating between Systematic and Random Measurement Errors in Ultrasound Muscle Thickness Diagnostics

Research output: Journal contributionsJournal articlesResearchpeer-review

Standard

Stressing the Relevance of Differentiating between Systematic and Random Measurement Errors in Ultrasound Muscle Thickness Diagnostics. / Lohmann, Lars Hubertus; Hillebrecht, Martin; Schiemann, Stephan et al.
In: Sports Medicine - Open, Vol. 10, No. 1, 89, 12.2024.

Research output: Journal contributionsJournal articlesResearchpeer-review

Harvard

APA

Vancouver

Bibtex

@article{fb64762d470048e4adfd99c67d0d5a06,
title = "Stressing the Relevance of Differentiating between Systematic and Random Measurement Errors in Ultrasound Muscle Thickness Diagnostics",
abstract = "Background: The majority of studies that explore changes in musculature following resistance training interventions or examine atrophy due to immobilization or sarcopenia use ultrasound imaging. While most studies assume acceptable to excellent reliability, there seems to be unawareness of the existing absolute measurement errors. As early as 1998, methodological research addressed a collective unawareness of the random measurement error and its practical indications. Referring to available methodological approaches, within this work, we point out the limited value of focusing on relative, correlation-based reliability indices for the interpretability in scientific research but also for clinical application by assessing 1,512 muscle thickness values from more than 400 ultrasound images. To account for intra- and inter-day repeatability, data were collected on two consecutive days within four testing sessions. Commonly-stated reliability values (ICC, CV, SEM and MDC) were calculated, while evidence-based agreement analyses were applied to provide the accompanied systematic and random measurement error. Results: While ICCs in the range of 0.832 to 0.998 are in accordance with the available literature, the mean absolute percentage error ranges from 1.34 to 20.38% and the mean systematic bias from 0.78 to 4.01 mm (all p ≤ 0.013), depending on the measurement time points chosen for data processing. Conclusions: In accordance with prior literature, a more cautious interpretation of relative reliability values should be based on included systematic and random absolute measurement scattering. Lastly, this paper discusses the rationale for including different measurement error statistics when determining the validity of pre-post changes, thus, accounting for the certainty of evidence.",
keywords = "Expected effect, Mean absolute percentage error, Reliability, Training intervention studies, Ultrasound, Physical education and sports",
author = "Lohmann, {Lars Hubertus} and Martin Hillebrecht and Stephan Schiemann and Konstantin Warneke",
note = "Publisher Copyright: {\textcopyright} The Author(s) 2024.",
year = "2024",
month = dec,
doi = "10.1186/s40798-024-00755-z",
language = "English",
volume = "10",
journal = "Sports Medicine - Open",
issn = "2199-1170",
publisher = "SpringerOpen",
number = "1",

}

RIS

TY - JOUR

T1 - Stressing the Relevance of Differentiating between Systematic and Random Measurement Errors in Ultrasound Muscle Thickness Diagnostics

AU - Lohmann, Lars Hubertus

AU - Hillebrecht, Martin

AU - Schiemann, Stephan

AU - Warneke, Konstantin

N1 - Publisher Copyright: © The Author(s) 2024.

PY - 2024/12

Y1 - 2024/12

N2 - Background: The majority of studies that explore changes in musculature following resistance training interventions or examine atrophy due to immobilization or sarcopenia use ultrasound imaging. While most studies assume acceptable to excellent reliability, there seems to be unawareness of the existing absolute measurement errors. As early as 1998, methodological research addressed a collective unawareness of the random measurement error and its practical indications. Referring to available methodological approaches, within this work, we point out the limited value of focusing on relative, correlation-based reliability indices for the interpretability in scientific research but also for clinical application by assessing 1,512 muscle thickness values from more than 400 ultrasound images. To account for intra- and inter-day repeatability, data were collected on two consecutive days within four testing sessions. Commonly-stated reliability values (ICC, CV, SEM and MDC) were calculated, while evidence-based agreement analyses were applied to provide the accompanied systematic and random measurement error. Results: While ICCs in the range of 0.832 to 0.998 are in accordance with the available literature, the mean absolute percentage error ranges from 1.34 to 20.38% and the mean systematic bias from 0.78 to 4.01 mm (all p ≤ 0.013), depending on the measurement time points chosen for data processing. Conclusions: In accordance with prior literature, a more cautious interpretation of relative reliability values should be based on included systematic and random absolute measurement scattering. Lastly, this paper discusses the rationale for including different measurement error statistics when determining the validity of pre-post changes, thus, accounting for the certainty of evidence.

AB - Background: The majority of studies that explore changes in musculature following resistance training interventions or examine atrophy due to immobilization or sarcopenia use ultrasound imaging. While most studies assume acceptable to excellent reliability, there seems to be unawareness of the existing absolute measurement errors. As early as 1998, methodological research addressed a collective unawareness of the random measurement error and its practical indications. Referring to available methodological approaches, within this work, we point out the limited value of focusing on relative, correlation-based reliability indices for the interpretability in scientific research but also for clinical application by assessing 1,512 muscle thickness values from more than 400 ultrasound images. To account for intra- and inter-day repeatability, data were collected on two consecutive days within four testing sessions. Commonly-stated reliability values (ICC, CV, SEM and MDC) were calculated, while evidence-based agreement analyses were applied to provide the accompanied systematic and random measurement error. Results: While ICCs in the range of 0.832 to 0.998 are in accordance with the available literature, the mean absolute percentage error ranges from 1.34 to 20.38% and the mean systematic bias from 0.78 to 4.01 mm (all p ≤ 0.013), depending on the measurement time points chosen for data processing. Conclusions: In accordance with prior literature, a more cautious interpretation of relative reliability values should be based on included systematic and random absolute measurement scattering. Lastly, this paper discusses the rationale for including different measurement error statistics when determining the validity of pre-post changes, thus, accounting for the certainty of evidence.

KW - Expected effect

KW - Mean absolute percentage error

KW - Reliability

KW - Training intervention studies

KW - Ultrasound

KW - Physical education and sports

UR - http://www.scopus.com/inward/record.url?scp=85201409538&partnerID=8YFLogxK

UR - https://www.mendeley.com/catalogue/cf13e1f2-b434-3026-b9c6-b07fb58e8b47/

U2 - 10.1186/s40798-024-00755-z

DO - 10.1186/s40798-024-00755-z

M3 - Journal articles

C2 - 39147945

AN - SCOPUS:85201409538

VL - 10

JO - Sports Medicine - Open

JF - Sports Medicine - Open

SN - 2199-1170

IS - 1

M1 - 89

ER -

Recently viewed

Publications

  1. A Fictional Risk Narrative and Its Potential for Social Resonance: Reception of Barbara Kingsolver’s Flight Behavior in Reviews and Reading Groups
  2. The influence of sustainability knowledge and attitude on sustainable intention and behaviour of Malaysian and Indonesian undergraduate students
  3. Use of lignins from sugarcane bagasse for assembling microparticles loaded with Azadirachta indica extracts for use as neem-based organic insecticides
  4. Identification of floodplain contamination hot spots by reconstructing Elbe river pollution load history and high flood sediment distribution during inundation.
  5. Nachhaltigkeitsmanagement im Wandel der Zeit: Vom (gestrigen) betrieblichen Umweltschutz zur angestrebten (zukünftigen) unternehmerischen Nachhaltigkeitstransformation
  6. Relationen der Auflösung sind Relationen der Konstituierung – zur Individuation und zum Verhältnis von Transindividuellem und Interindividuellem nach Gilbert Simondon
  7. Wolfgang Sander: Politik entdecken - Freiheit leben: Didaktische Grundlagen politischer Bildung. 2., vollst. überarbeitete und erweit. Auflage, Wochenschau Verlag: Schwalbach/Ts. 2007
  8. Triphenylzinn in Gewässern Niedersachsens – Betrachtung der Kompartimente Wasser, Schwebstoff, Sediment und aquatische Organismen – sowie ein Vergleich zu Butylzinnverbindungen
  9. Emily, Herring, Kevin Matthew, Jones, Konstantin, Kiprijanov, Laura, Sellers. The past, present, and future of integrated history and philosophy of science. London, England: Routledge, 2019.