Driver Psychological State in Autonomous Vehicles: Research Insight

Department of Civil and Environmental Engineering University of Windsor, Canada CITE Virtual Annual Conference (June 8 CITE Virtual Annual Conference (June 8 10, 2021) 10, 2021) Presentation Topic: Driver s Behaviour in Autonomous Vehicles: A Preliminary Video Experiment Prepared By: Industry 4.0 Presenters: Ahmad Hassan, P.Eng. Niloy Talukder 1

Background of The Problem Emotional intelligence is the ability to understand, use, and manage your own emotions in positive ways to relieve stress, communicate effectively, empathize with others, overcome challenges and defuse conflict. In general, emotional intelligence (EI) is the ability to perceive and understand emotions, and to use emotions to enhance decision-making. Hayley et al., 2017, the results of the study show lower scores on specific indices of EI are associated with increased rates of risky driving behaviour, suggesting that poor emotional control may impede an individuals ability to make safe behavioural decisions when driving. The regression analysis done by the study indicates significance for risky driving and emotional recognition and expression, hence that is self- awareness. The driver psychological state of mind is important in operating an autonomous vehicle specifically of level 3 automation, where driving consists of both the autonomous vehicle system and the driver. 2

Problem Scope: Driver Psychological state of mind in autonomous vehicles Consideration: Level 3 automation Emphasis: Post Takeover Control for driver psychology Evaluation: Driver psychology (directed our research scope towards driver s self and hence self-awareness) Measurement: Self-awareness Observation: Participant Feedback 3

Methodology A) Literature Review Autonomous Vehicles Psychology/Physiology and Autonomous Vehicles (2) Psychology/physiology and Driving Psychology/Physiology Medical and Decision Making Video Experiment Design Preparation: Video Research, Selection, and Evaluation Video Experiment Preliminaries: Driver Characteristics and Driver Survey Video Experiment: Situational Self-awareness Questionnaire Video Related Questionnaire Traffic Environment Autonomous System Interaction of Driver and Vehicle Experiment Design Scenario Outline Scenario Design Sketches Situational Self-awareness Questionnaire Blood Pressure Eye Tracker (7) (3) (15) (3) B) C) 4

Self-Awareness A Psychological state Oneself becomes the focus of attention at different points depending on the situation and personality Self-awareness has two types: public or private Public: is when people are aware of how they appear to others For example, in situations when people are at the center of attention, such as when giving a presentation Private: is when people become aware of some aspects of themselves, but only in a private way Such as, your face in the mirror or your heartbeat (Cherry, 2020) 5

Self-Awareness A neurocognitive and socioecological model of self-awareness (Morin, 2011) 6

Self-Awareness The revised self-evaluation process (Morin, 2011) 7

Self-Awareness towards Decision Making Emotional Intelligence Five Elements: Self-awareness Self-regulation Internal motivation personal Empathy deals with others Social skills deals with others (Mallory, 2018) ----------------------------------------------------------------------------------------------------- A major adaptive function of self-awareness is self-regulation Altering one s behavior Resisting temptation Changing one s mood, selecting a response from various options Filtering irrelevant information (Baumeister & Vohs, 2003) 8

Research Mapping 1. Driver behaviour and psychological state of mind in Post Takeover Control (lack of literature) 2. Psychology: mapping of self-awareness 3. Physiology: Goleman, 1998, proposes that self-awareness is a key skill in handling stress Stress Management: The ability to cope with stress 4. Medical 9

Stress Definition of stress: 1. Demands or perceived stressors on a person, 2. Individual characteristics, skills and abilities to meet demands, 3. Cognitive appraisal or interpretation of a situation, and 4. Outcomes of behaviour (psychological, physiological, disease and observable behaviour) (Ramesar et al., 2009) Types of stress: Acute Stress: short term Chronic Stress: long term 10

Stress and Decision Making Physiology to Psychology Acute stress seems to enhance decision biases, mainly increasing risky choices in accordance with personal characteristics such as gender and individual proneness to risk. (Morgado et al., 2015). Medical (Physiological and Psychological) Stress is time dependent. Due to physical or psychological stress, humans activate two main physiological pathways. The first consists of the fast activation of the sympathetic nervous system (SNS), associated with improved (less risky) decision making. The second somewhat slower pathway is manifested by the hypothalamic-pituitary-adrenal (HPA) axis, associated with impaired (riskier) decision making. (Pabst et al., 2013) Psychology to Physiology A study establishes that the relationship between emotional intelligence and stress management is that of stress management is a component of emotional intelligence, while stress can be either an input or an outflow of emotional intelligence or the lack thereof (Ramesar et al., 2009) 11

PHASE I: Validation of SSAS Video Experiment Design 12

Video Search Time Stretch: Fast-through videos 2 to 17 minute length videos Driving Mode: Only automated driving, no manual to automated transition with takeover request and vice versa Audio: Commentary in or on video (not preferred) No in cabin system sounds Visual Shows driver/other passengers Sun reflecting on display screen 13

Best Video Found! Titled: Raw 1x Tesla Autopilot FSD Beta San Francisco to Sausalito Link: https://www.youtube.com/watch?v=S1DZi0x0Uhk 14

Qualtrics Survey Software Situational Self-Awareness Scale (SSAS) (Govern & Marsch, 2001) Nine items classified into three categories Categories Private: Right now, I am aware of my innermost thoughts. Public: Right now, I am concerned about the way I present myself Surroundings: Right now, I am keenly aware of everything in my environment Each item will be accompanied by a 7-point scale (strongly disagree) to (strongly agree) (https://uwindsor.qualtrics.com) 15

Video Contribution Display Messaging (wording, engagement level, color of letters and audio sound), Audio Hearing (wording, engagement level, light color affect and audio sound), Combination of messaging and audio (engagement level, awareness and comfort), and Touchscreen display (information/ instruction provided and color grid). 16

PHASE II: Driver Behaviour Simulation Experiment Design 17

NADS MiniSim Driving Simulator ISAT (Interactive Scenario Authoring Tool) 18

Driving Scenario Sample 1 19

Driving Scenario Sample 2 20

Blood Pressure 21

Eye Tracker 22

Simulation Outcomes Individuals that score high on SSAS are expected to have lower blood pressure fluctuations, hence better decision making, and vice versa, The eye-movement measures would show changes associated with mental workload (stress), Will provide an insight to enhance self-focus stimuli (self-awareness) to increase safety and performance for Post Takeover Control of the level 3 automation, and Examine the drivers self-awareness while in automated mode, as a frame of reference, while performing secondary tasks in order to be able to distinguish the drivers psychological state of mind for automated from manual 23

References Hayley, A. C., Ridder, B. de, Stough, C., Ford, T. C., & Downey, L. A. (2017). Emotional intelligence and risky driving behaviour in adults. Transportation Research Part F: Traffic Psychology and Behaviour, 49(Complete), 124 131. https://doi.org/10.1016/j.trf.2017.06.009 Cherry, Kendra (2020, July 14). Self-Awareness Development and Types. Very Well Mind. https://www.verywellmind.com/what-is-self-awareness- 2795023#:~:text=Self%2Dawareness%20involves%20being%20aware,becomes%20the%20focus%20of%20attention Morin, A. (2011), Self Awareness Part 1: Definition, Measures, Effects, Functions, and Antecedents. Social and Personality Psychology Compass, 5: 807-823. https://doi.org/10.1111/j.1751-9004.2011.00387 Mallory, Alan. (2018, February 8th). Emotional Intelligence: The Importance of Self-Awareness and Self-Regulation. Alan Mallory. https://alanmallory.com/2018/02/emotional-intelligence-importance-self-awareness-self-regulation/ Baumeister, R. F., & Vohs, K. D. (2003). Self-regulation and the executive function of the self. In M. R. Leary & J. P. Tangney (Eds.), Handbook of Self and Identity (pp. 197 217). New York, NY: Guildford Press Goleman, D. (1998). Working with emotional intelligence. London: Bloomsbury Publishing plc. Ramesar, Saras, Koortzen, Pieter, and Oosthuizen, R. M. (2009). The relationship between emotional intelligence and stress management. SA Journal of Industrial Psychology. 35(1), Art. #443, 10 pages. DOI: https://doi.org/10.4102/sajip.v35i1.443 Morgado, P., Sousa, N., & Cerqueira, J. J. (2015). The impact of stress in decision making in the context of uncertainty. Journal of neuroscience research, 93(6), 839 847. https://doi.org/10.1002/jnr.23521 Pabst, S., Brand, M., & Wolf, O. T. (2013). Stress and decision making: A few minutes make all the difference. Behavioural Brain Research, 250(Complete), 39 45. https://doi.org/10.1016/j.bbr.2013.04.046 Govern, John M., and Marsch, Lisa A. (2001). Development and Validation of the Situational Self-Awareness Scale. Consciousness and Cognition. Volume 10, Issue 3, Pages 366-378, ISSN 1053-8100, https://doi.org/10.1006/ccog.2001.0506. Wright, Bradley J., O Brien, Shaun, Hazi, Agnes & Kent, Stephen. (2014). Increased systolic blood pressure reactivity to acute stress is related with better self-reported health. Sci Rep 4, 6882. https://doi.org/10.1038/srep06882 Li, Xiaomeng, Schroeter, Ronald, Rakotonirainy, Andry, Kuo, Jonny, and Lenn , Michael G. (2020). Effects of different non-driving-related-task display modes on drivers eye-movement patterns during take-over in an automated vehicle. Transportation Research. Part F, Traffic Psychology and Behaviour, 70, 135 148. https://doi.org/10.1016/j.trf.2020.03.001 24 Prepared By: Industry 4.0

Thank You! Questions? Ahmad Hassan hassanl@uwindsor.ca https://www.linkedin.com/in/ahmadihsanhassan/ Niloy Talukder talukden@uwindsor.ca https://www.linkedin.com/in/niloy-talukder-b48b57150/ 25