Self-evaluation of automated vehicles based on physics, state-of-the-art motion prediction and user experience

Abstract Legal restrictions allow to give full control to automated vehicles for longer time periods either in restricted areas or when moving with reduced speed. Although being technically feasible for a wide range of driving scenarios, the restrictions are still in place due to the lack of a clear...

Full description

Bibliographic Details
Main Authors: Anne Stockem Novo, Christian Hürten, Robin Baumann, Philipp Sieberg
Format: Article
Language:English
Published: Nature Portfolio 2023-08-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-023-39811-1
_version_ 1797576836051369984
author Anne Stockem Novo
Christian Hürten
Robin Baumann
Philipp Sieberg
author_facet Anne Stockem Novo
Christian Hürten
Robin Baumann
Philipp Sieberg
author_sort Anne Stockem Novo
collection DOAJ
description Abstract Legal restrictions allow to give full control to automated vehicles for longer time periods either in restricted areas or when moving with reduced speed. Although being technically feasible for a wide range of driving scenarios, the restrictions are still in place due to the lack of a clear safety strategy. An essential step towards safety is the introduction of a self-monitoring component. In this study, a self-evaluation concept is presented which assesses a system based on a physics-defined minimum prediction horizon for state-of-the-art Deep Learning-based trajectory prediction models. Since User Experience is a key metric for car manufacturers, a further manoeuvre constraint is added to the model. We emphasize the generalizability of the presented assessment concept, however, in order to demonstrate feasibility in practical use, three specific scenarios are discussed. The results are gained with real data from publicly available driving campaigns as well as synthetically generated simulation data. Two exemplary models, a simple LSTM-based model and VectorNet, a prominent motion prediction model, are evaluated. A quantitative assessment shows a lack of training data in the public datasets for vehicle speeds > 25 m/s in order to offer safe driving above such vehicle speeds.
first_indexed 2024-03-10T22:00:25Z
format Article
id doaj.art-66f007a544624a0e99c5a312b0b62a67
institution Directory Open Access Journal
issn 2045-2322
language English
last_indexed 2024-03-10T22:00:25Z
publishDate 2023-08-01
publisher Nature Portfolio
record_format Article
series Scientific Reports
spelling doaj.art-66f007a544624a0e99c5a312b0b62a672023-11-19T12:59:07ZengNature PortfolioScientific Reports2045-23222023-08-0113111010.1038/s41598-023-39811-1Self-evaluation of automated vehicles based on physics, state-of-the-art motion prediction and user experienceAnne Stockem Novo0Christian Hürten1Robin Baumann2Philipp Sieberg3Institute of Computer Science, Ruhr West University of Applied SciencesChair of Mechatronics, University of Duisburg-EssenInstitute of Computer Science, Ruhr West University of Applied SciencesSchotte Automotive GmbH & Co. KGAbstract Legal restrictions allow to give full control to automated vehicles for longer time periods either in restricted areas or when moving with reduced speed. Although being technically feasible for a wide range of driving scenarios, the restrictions are still in place due to the lack of a clear safety strategy. An essential step towards safety is the introduction of a self-monitoring component. In this study, a self-evaluation concept is presented which assesses a system based on a physics-defined minimum prediction horizon for state-of-the-art Deep Learning-based trajectory prediction models. Since User Experience is a key metric for car manufacturers, a further manoeuvre constraint is added to the model. We emphasize the generalizability of the presented assessment concept, however, in order to demonstrate feasibility in practical use, three specific scenarios are discussed. The results are gained with real data from publicly available driving campaigns as well as synthetically generated simulation data. Two exemplary models, a simple LSTM-based model and VectorNet, a prominent motion prediction model, are evaluated. A quantitative assessment shows a lack of training data in the public datasets for vehicle speeds > 25 m/s in order to offer safe driving above such vehicle speeds.https://doi.org/10.1038/s41598-023-39811-1
spellingShingle Anne Stockem Novo
Christian Hürten
Robin Baumann
Philipp Sieberg
Self-evaluation of automated vehicles based on physics, state-of-the-art motion prediction and user experience
Scientific Reports
title Self-evaluation of automated vehicles based on physics, state-of-the-art motion prediction and user experience
title_full Self-evaluation of automated vehicles based on physics, state-of-the-art motion prediction and user experience
title_fullStr Self-evaluation of automated vehicles based on physics, state-of-the-art motion prediction and user experience
title_full_unstemmed Self-evaluation of automated vehicles based on physics, state-of-the-art motion prediction and user experience
title_short Self-evaluation of automated vehicles based on physics, state-of-the-art motion prediction and user experience
title_sort self evaluation of automated vehicles based on physics state of the art motion prediction and user experience
url https://doi.org/10.1038/s41598-023-39811-1
work_keys_str_mv AT annestockemnovo selfevaluationofautomatedvehiclesbasedonphysicsstateoftheartmotionpredictionanduserexperience
AT christianhurten selfevaluationofautomatedvehiclesbasedonphysicsstateoftheartmotionpredictionanduserexperience
AT robinbaumann selfevaluationofautomatedvehiclesbasedonphysicsstateoftheartmotionpredictionanduserexperience
AT philippsieberg selfevaluationofautomatedvehiclesbasedonphysicsstateoftheartmotionpredictionanduserexperience