Watch out, pothole! Featuring Road Damage Detection in an End-to-end System for Autonomous Driving

Felix Kortmann; Pascal Faßmeyer; Burkhardt Funk; Paul Drews

doi:10.1016/j.datak.2022.102091

Watch out, pothole! Featuring Road Damage Detection in an End-to-end System for Autonomous Driving

Research output: Journal contributions › Journal articles › Research › peer-review

Standard

Watch out, pothole! Featuring Road Damage Detection in an End-to-end System for Autonomous Driving. / Kortmann, Felix ; Faßmeyer, Pascal ; Funk, Burkhardt et al.
In: Data and Knowledge Engineering, Vol. 142, 102091, 01.11.2022.

Research output: Journal contributions › Journal articles › Research › peer-review

Bibtex

@article{085cab1e109d4c658131e3c97b82d76a,

title = "Watch out, pothole! Featuring Road Damage Detection in an End-to-end System for Autonomous Driving",

abstract = "While autonomous driving technology made significant progress in the last decade, road damage detection as a relevant challenge for ensuring safety and comfort is still under development. This paper addresses the lack of algorithms for detecting road damages that meet autonomous driving systems{\textquoteright} requirements. We investigate the environmental perception systems{\textquoteright} architecture and current algorithm designs for road damage detection. Based on the autonomous driving architecture, we develop an end-to-end concept that leverages data from low-cost pre-installed sensors for real-time road damage and damage severity detection as well as cloud- and crowd-based HD Feature Maps to share information across vehicles. In a design science research approach, we develop three artifacts in three iterations of expert workshops and design cycles: the end-to-end concept featuring road damages in the system architecture and two lightweight deep neural networks, one for detecting road damages and another for detecting their severity as the central components of the system. The research design draws on new self-labeled automotive-grade images from front-facing cameras in the vehicle and interdisciplinary literature regarding autonomous driving architecture and the design of deep neural networks. The road damage detection algorithm delivers cutting-edge performance while being lightweight compared to the winners of the IEEE Global Road Damage Detection Challenge 2020, which makes it applicable in autonomous vehicles. The road damage severity algorithm is a promising approach, delivering superior results compared to a baseline model. The end-to-end concept is developed and evaluated with experts of the autonomous driving application domain.",

keywords = "Informatics, Business informatics, Autonomous driving architecture, Computer vision, Road damage detection, Road damage severity",

author = "Felix Kortmann and Pascal Fa{\ss}meyer and Burkhardt Funk and Paul Drews",

note = "Publisher Copyright: {\textcopyright} 2022 Elsevier B.V.",

year = "2022",

month = nov,

day = "1",

doi = "10.1016/j.datak.2022.102091",

language = "English",

volume = "142",

journal = "Data and Knowledge Engineering",

issn = "0169-023X",

publisher = "Elsevier B.V.",

}

RIS

TY - JOUR

T1 - Watch out, pothole! Featuring Road Damage Detection in an End-to-end System for Autonomous Driving

AU - Kortmann, Felix

AU - Faßmeyer, Pascal

AU - Funk, Burkhardt

AU - Drews, Paul

PY - 2022/11/1

Y1 - 2022/11/1

N2 - While autonomous driving technology made significant progress in the last decade, road damage detection as a relevant challenge for ensuring safety and comfort is still under development. This paper addresses the lack of algorithms for detecting road damages that meet autonomous driving systems’ requirements. We investigate the environmental perception systems’ architecture and current algorithm designs for road damage detection. Based on the autonomous driving architecture, we develop an end-to-end concept that leverages data from low-cost pre-installed sensors for real-time road damage and damage severity detection as well as cloud- and crowd-based HD Feature Maps to share information across vehicles. In a design science research approach, we develop three artifacts in three iterations of expert workshops and design cycles: the end-to-end concept featuring road damages in the system architecture and two lightweight deep neural networks, one for detecting road damages and another for detecting their severity as the central components of the system. The research design draws on new self-labeled automotive-grade images from front-facing cameras in the vehicle and interdisciplinary literature regarding autonomous driving architecture and the design of deep neural networks. The road damage detection algorithm delivers cutting-edge performance while being lightweight compared to the winners of the IEEE Global Road Damage Detection Challenge 2020, which makes it applicable in autonomous vehicles. The road damage severity algorithm is a promising approach, delivering superior results compared to a baseline model. The end-to-end concept is developed and evaluated with experts of the autonomous driving application domain.

AB - While autonomous driving technology made significant progress in the last decade, road damage detection as a relevant challenge for ensuring safety and comfort is still under development. This paper addresses the lack of algorithms for detecting road damages that meet autonomous driving systems’ requirements. We investigate the environmental perception systems’ architecture and current algorithm designs for road damage detection. Based on the autonomous driving architecture, we develop an end-to-end concept that leverages data from low-cost pre-installed sensors for real-time road damage and damage severity detection as well as cloud- and crowd-based HD Feature Maps to share information across vehicles. In a design science research approach, we develop three artifacts in three iterations of expert workshops and design cycles: the end-to-end concept featuring road damages in the system architecture and two lightweight deep neural networks, one for detecting road damages and another for detecting their severity as the central components of the system. The research design draws on new self-labeled automotive-grade images from front-facing cameras in the vehicle and interdisciplinary literature regarding autonomous driving architecture and the design of deep neural networks. The road damage detection algorithm delivers cutting-edge performance while being lightweight compared to the winners of the IEEE Global Road Damage Detection Challenge 2020, which makes it applicable in autonomous vehicles. The road damage severity algorithm is a promising approach, delivering superior results compared to a baseline model. The end-to-end concept is developed and evaluated with experts of the autonomous driving application domain.

KW - Informatics

KW - Business informatics

KW - Autonomous driving architecture

KW - Computer vision

KW - Road damage detection

KW - Road damage severity

UR - http://www.scopus.com/inward/record.url?scp=85140312732&partnerID=8YFLogxK

UR - https://www.mendeley.com/catalogue/809783fd-897a-3069-be9b-ccf1be61f7b0/

U2 - 10.1016/j.datak.2022.102091

DO - 10.1016/j.datak.2022.102091

M3 - Journal articles

VL - 142

JO - Data and Knowledge Engineering

JF - Data and Knowledge Engineering

SN - 0169-023X

M1 - 102091

ER -