Strategic Resilience Evaluation of Neural Networks within Autonomous Vehicle Software

Abstratct

Self-driving technology has become increasingly advanced over the past decade due to the rapid development of deep neural networks (DNNs).

In this paper, we evaluate the effects of transient faults in DNNs and present a methodology to efficiently locate critical fault sites in DNNs deployed within two cases of autonomous vehicle (AV) agents: Learning by Cheating (LBC) and OpenPilot.

We locate the DNN fault sites using a modified Taylor criterion and strategically inject faults that can affect the functioning of AVs in different road and weather scenarios.

Our fault injection methodology identifies corner cases of DNN vulnerabilities that can cause hazards and accidents and therefore dramatically affect AV safety. Additionally, we evaluate mitigation mechanisms of such vulnerabilities for both AV agents and discuss the insights of this study.

Key words: Autonomous Vehicles; Fault Tolerance; DNNs

Authors

• Anna Schmedding, William & Mary
• Philip Schowitz, University of British Columbia
• Xugui Zhou, University of Virginia
• Yiyang Lu, William & Mary
• Lishan Yang, George Mason University
• Homa Alemzadeh, University of Virginia
• Evgenia Smirni, William & Mary

• Publication/Conference: SAFECOMP 2024, 43rd International Conference on Computer Safety, Reliability and Security (SafeComp) 
• Date: Sept. 17-20, 2024