Key indicators to assess the performance of LiDAR-based perception algorithms: a literature review
Mostra el registre complet Registre parcial de l'ítem
- dc.contributor.author Karri, Chiranjeevi
- dc.contributor.author Machado da Silva, José
- dc.contributor.author Velhote Correia, Miguel
- dc.date.accessioned 2025-04-28T06:24:04Z
- dc.date.available 2025-04-28T06:24:04Z
- dc.date.issued 2023
- dc.description.abstract Perception algorithms are essential for autonomous or semi-autonomous vehicles to perceive the semantics of their surroundings, including object detection, panoptic segmentation, and tracking. Decision-making in case of safety-critical situations, like autonomous emergency braking and collision avoidance, relies on the outputs of these algorithms. This makes it essential to correctly assess such perception systems before their deployment and to monitor their performance when in use. It is difficult to test and validate these systems, particularly at runtime, due to the high-level and complex representations of their outputs. This paper presents an overview of different existing metrics used for the evaluation of LiDAR-based perception systems, emphasizing particularly object detection and tracking algorithms due to their importance in the final perception outcome. Along with generally used metrics, we also discuss the impact of Planning KL-Divergence (PKL), Timed Quality Temporal Logic (TQTL), and Spatio-temporal Quality Logic (STQL) metrics on object detection algorithms. In the case of panoptic segmentation, Panoptic Quality (PQ) and Parsing Covering (PC) metrics are analysed resorting to some pretrained models. Finally, it addresses the application of diverse metrics to evaluate different pretrained models with the respective perception algorithms on publicly available datasets. Besides the identification of the various metrics being proposed, their performance and influence on models are also assessed after conducting new tests or reproducing the experimental results of the reference under consideration.en
- dc.description.sponsorship European Structural and Investment Funds in the FEDER Component through the Operational Competitiveness and Internationalization Programme (COMPETE 2020) (THEIA: Automated Perception Driving; Funding Reference: POCI-01-0247-FEDER-047264) (Grant Number: 047264).en
- dc.format.mimetype application/pdf
- dc.identifier.citation Karri C, Machado J, Velhote M. Key indicators to assess the performance of LiDAR-based perception algorithms: a literature review. IEEE Access. 2023;11:109142-68. DOI: 10.1109/access.2023.3321912
- dc.identifier.doi http://dx.doi.org/10.1109/access.2023.3321912
- dc.identifier.issn 2169-3536
- dc.identifier.uri http://hdl.handle.net/10230/70218
- dc.language.iso eng
- dc.publisher Institute of Electrical and Electronics Engineers (IEEE)
- dc.relation.ispartof IEEE Access. 2023;11:109142-68
- dc.relation.projectID info:eu-repo/grantAgreement/EC/FP7/047264
- dc.rights © 2023 The Authors. This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. For more information, see https://creativecommons.org/licenses/by-nc-nd/4.0/.
- dc.rights.accessRights info:eu-repo/semantics/openAccess
- dc.rights.uri http://creativecommons.org/licenses/by-nc-nd/4.0/
- dc.subject.keyword Velhote Correia, Miguel
- dc.subject.keyword Perception algorithmsen
- dc.subject.keyword Metricsen
- dc.subject.keyword Deep learningen
- dc.subject.keyword Object detectionen
- dc.subject.keyword Panoptic segmentationen
- dc.subject.keyword Autonomous drivingen
- dc.title Key indicators to assess the performance of LiDAR-based perception algorithms: a literature reviewen
- dc.type info:eu-repo/semantics/article
- dc.type.version info:eu-repo/semantics/publishedVersion