Top

Gepubliceerd in:

06-10-2023 | Research

Planning lane changes using advance visual and haptic information

Auteurs: Ilja Frissen, Franck Mars

Gepubliceerd in: Psychological Research | Uitgave 2/2024

Abstract

Taking a motor planning perspective, this study investigates whether haptic force cues displayed on the steering wheel are more effective than visual cues in signaling the direction of an upcoming lane change. Licensed drivers drove in a fixed-base driving simulator equipped with an active steering system for realistic force feedback. They were instructed to make lane changes upon registering a directional cue. Cues were delivered according to the movement precuing technique employing a pair of precues and imperative cues which could be either visual, haptic, or crossmodal (a visual precue with a haptic imperative cue, and vice versa). The main dependent variable was response time. Additional analyses were conducted on steering wheel angle profiles and the rate of initial steering errors. Conditions with a haptic imperative cue produced considerably faster responses than conditions with a visual imperative cue, irrespective of the precue modality. Valid and invalid precues produced the typical gains and costs, with one exception. There appeared to be little cost in response time or initial steering errors associated with invalid cueing when both cues were haptic. The results are consistent with the hypothesis that imperative haptic cues facilitate action selection while visual stimuli require additional time-consuming cognitive processing.

vorige artikel Action, emotion, and music-colour synaesthesia: an examination of sensorimotor and emotional responses in synaesthetes and non-synaesthetes

volgende artikel When feeling is for seeing: comparing the effects of motivated perception between fear and anger on ambiguous threatening stimuli

Teasdale et al. (1993) proposed a more sophisticated method for determining the movement onset time. A two-stage algorithm first determines the sample at which the time series first exceeds 10% of its maximum value. Then, working back it looks for the first sample at which speed reaches 10% of the speed of the first point. The final step locates the onset as this second point minus the standard deviation of the time between the first and second points. In our case, however, this method could not distinguish between the early parts of the peak that were due to the participant’s movement and those that were due to the haptic cue.

Adell, E., Várhelyi, A., Dalla Fontana, M., & Bruel, L. (2008). Test of HMI alternatives for driver support to keep safe speed and safe distance—A simulator study. The Open Transportation Journal, 2, 53–64. https://doi.org/10.2174/1874447800802010053CrossRef

Asif, A., Boll, S., & Heuten, W. (2012). Right or left: Tactile display for route guidance of drivers. It-Information Technology, 54(4), 188–198. https://doi.org/10.1524/itit.2012.0681CrossRef

Bell, J. D., & Macuga, K. L. (2019). Goal-directed aiming under restricted viewing conditions with confirmatory sensory feedback. Human Movement Science, 67, 102515. https://doi.org/10.1016/j.humov.2019.102515CrossRefPubMed

Böffel, C., & Müsseler, J. (2015). Adjust your view! Wing-mirror settings influence distance estimations and lane-change decisions. Transportation Research Part F: Traffic Psychology and Behaviour, 35, 112–118. https://doi.org/10.1016/j.trf.2015.10.009CrossRef

Breitschaft, S. J., Clarke, S., & Carbon, C.-C. (2019). A theoretical framework of haptic processing in automotive user interfaces and its Implications on design and engineering. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2019.01470CrossRefPubMedPubMedCentral

Chapman, C. E., (1994). Active versus passive touch: factors influencing the transmission of somatosensory signals to primary somatosensory cortex. Canadian Journal of Physiology and Pharmacology, 72, 558–570. https://doi.org/10.1139/y94-080

Chapman, S. (2017). The effects of performing a secondary task on the preparation of lane change manoeuvres. Master’s thesis, University of Twente.

Chun, J., Han, S. H., Park, G., Seo, J., & lee, I., & Choi, S. (2012). Evaluation of vibrotactile feedback for forward collision warning on the steering wheel and seatbelt. International Journal of Industrial Ergonomics, 42(5), 443–448. https://doi.org/10.1016/j.ergon.2012.07.004CrossRef

Chun, J., Lee, I., Park, G., Seo, J., Choi, S., & Han, S. H. (2013). Efficacy of haptic blind spot warnings applied through a steering wheel or a seatbelt. Transportation Research Part F: Traffic Psychology and Behaviour, 21, 231–241. https://doi.org/10.1016/j.trf.2013.09.014CrossRef

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Erlbaum.

Crevecoeur, F., Munoz, D. P., & Scott, S. H. (2016). Dynamic multisensory integration: Somatosensory speed trumps visual accuracy during feedback control. Journal of Neuroscience, 36(33), 8598–8611. https://doi.org/10.1523/JNEUROSCI.0184-16.2016CrossRefPubMed

Dass Jr, D. E., Uyttendaele, A., & Terken, J. (2013). Haptic in-seat feedback for lane departure warning. In Proceedings of the 5th international conference on automotive user interfaces and interactive vehicular applications (AutomotiveUI '13). Association for computing machinery (pp. 258–261). https://doi.org/10.1145/2516540.2516574

de Jong, R., Liang, C.-C., & Lauber, E. (1994). Conditional and unconditional automaticity: a dual-process model of effects of spatial stimulus-response correspondence. Journal of Experimental Psychology: Human Perception and Performance, 20(4), 731–750. https://doi.org/10.1037/0096-1523.20.4.731

De Rosario, H., Louredo, M., Díaz, I., Soler, A., Gil, J. J., Solaz, J. S., & Jornet, J. (2010). Efficacy and feeling of a vibrotactile Frontal Collision Warning implemented in a haptic pedal. Transportation Research Part f: Traffic Psychology and Behaviour, 13(2), 80–91. https://doi.org/10.1016/j.trf.2009.11.003CrossRef

Deroo, M., Hoc, J. M., & Mars, F. (2012). Influence of risk expectation on haptically cued corrective manoeuvres during near lane departure. Ergonomics, 55(4), 465–475. https://doi.org/10.1080/00140139.2011.647094CrossRefPubMed

Deroo, M., Hoc, J.-M., & Mars, F. (2013). Effect of strength and direction of haptic cueing on steering control during near lane departure. Transportation Research Part F: Traffic Psychology and Behaviour, 16, 92–103. https://doi.org/10.1016/j.trf.2012.08.015CrossRef

Donges, E. (1978). A two-level model of driver steering. Human Factors, 20, 691–707.CrossRef

Duthoit, V., Sieffermann, J.-M., Enrègle, É., Michon, C., & Blumenthal, D. (2018). Evaluation and optimization of a vibrotactile signal in an autonomous driving context. Journal of Sensory Studies, 33(1), e12308. https://doi.org/10.1111/joss.12308CrossRef

Fitch, G. M., Hankey, J. M., Kleiner, B. M., & Dingus, T. A. (2011). Driver comprehension of multiple haptic seat alerts intended for use in an integrated collision avoidance system. Transportation Research Part F: Traffic Psychology and Behaviour, 14(4), 278–290. https://doi.org/10.1016/j.trf.2011.02.001CrossRef

Flanders, M., & Cordo, P. (1989). Kinesthetic and visual control of a bimanual task: Specification of direction and amplitude. Journal of Neuroscience, 9(2), 447–453. https://doi.org/10.1523/JNEUROSCI.09-02-00447.1989CrossRefPubMed

Flanders, M., Cordo, P. J., & Anson, J. G. (1986). Interaction between visually and kinesthetically triggered voluntary responses. Journal of Motor Behavior, 18(4), 427–448.CrossRefPubMed

Frissen, I., & Mars, F. (2014). The effect of visual degradation on anticipatory and compensatory steering control. Quarterly Journal of Experimental Psychology, 67(3), 499–507. https://doi.org/10.1080/17470218.2013.819518CrossRef

Frissen, I., Ziat, M., Campion, G., Hayward, V., & Guastavino, C. (2012). The effects of voluntary movements on auditory-haptic and haptic-haptic temporal order judgments. Acta Psychologica, 141(2), 140–148. https://doi.org/10.1016/j.actpsy.2012.07.010CrossRefPubMed

Gaffary, Y., & Lécuyer, A. (2018). The use of haptic and tactile information in the car to improve driving safety: A review of current technologies. Frontiers in ICT. https://doi.org/10.3389/fict.2018.00005CrossRef

Gielen, S. C., Schmidt, R. A., & Van Den Heuvel, P. J. (1983). On the nature of intersensory facilitation of reaction time. Perception & Psychophysics, 34(2), 161–168.CrossRef

Gong, S., & Du, L. (2016). Optimal location of advance warning for mandatory lane change near a two-lane highway off-ramp. Transportation Research Part B: Methodological, 84, 1–30. https://doi.org/10.1016/j.trb.2015.12.001CrossRef

Hartwigsen, G., & Siebner, H. R. (2015). Joint contribution of left dorsal premotor cortex and supramarginal gyrus to rapid action reprogramming. Brain Stimulation, 8(5), 945–952. https://doi.org/10.1016/j.brs.2015.04.011CrossRefPubMed

Hoc, J.-M., Young, M. S., & Blosseville, J.-M. (2009). Cooperation between drivers and automation: Implications for safety. Theoretical Issues in Ergonomics Science, 10(2), 135–160. https://doi.org/10.1080/14639220802368856CrossRef

Hofmann, P., & Rinkenauer, G. (2013). Response preparation in a lane change task. Ergonomics, 56(2), 268–281. https://doi.org/10.1080/00140139.2012.760752CrossRefPubMed

Hofmann, P., Rinkenauer, G., & Gude, D. (2010). Preparing lane changes while driving in a fixed-base simulator: Effects of advance information about direction and amplitude on reaction time and steering kinematics. Transportation Research Part F-Traffic Psychology and Behaviour, 13(4), 255–268. https://doi.org/10.1016/j.trf.2010.04.009CrossRef

Holmes, N. P., & Spence, C. (2005). Multisensory integration: Space, time and superadditivity. Current Biology, 15(18), R762–R764. https://doi.org/10.1016/j.cub.2005.08.058CrossRefPubMed

Huang, Z., Wu, Y., & Liu, J. (2015). Research on effects of pattern, amplitude and frequency of pulse steering torque warnings for lane departure. Transportation Research Part f: Traffic Psychology and Behaviour, 31, 67–76. https://doi.org/10.1016/j.trf.2015.03.008CrossRef

Itoh, M., Inagaki, T., & Tanaka, H. (2012). Haptic steering direction guidance for pedestrian-vehicle collision avoidance. In Proceedings of the 2012 IEEE international conference on systems, man, and cybernetics (SMC) (pp. 3327–3332). https://doi.org/10.1109/ICSMC.2012.6378305

Jordan, T. C. (1972). Characteristics of visual and proprioceptive response times in learning of a motor skill. Quarterly Journal of Experimental Psychology, 24, 536–543. https://doi.org/10.1080/14640747208400313CrossRefPubMed

Kamen, G., & Morris, H. H. (1988). Differences in sensorimotor processing of visual and proprioceptive stimuli. Research Quarterly for Exercise and Sport, 59(1), 29–34. https://doi.org/10.1080/02701367.1988.10605470CrossRef

Katzourakis, D., Velenis, E., Holweg, E., & Happee, R. (2014). Haptic steering support for driving near the vehicle’s handling limits; skid-pad case. International Journal of Automotive Technology, 15(1), 151–163. https://doi.org/10.1007/s12239−014−0017−7CrossRef

Klein, R. M. (1977). Attention and visual dominance: A chronometric analysis. Journal of Experimental Psychology: Human Perception and Performance, 3(3), 365–378. https://doi.org/10.1037/0096-1523.3.3.365CrossRefPubMed

Klein, R. M., & Posner, M. I. (1974). Attention to visual and kinesthetic components of skills. Brain Research, 71(2–3), 401–411. https://doi.org/10.1016/0006-8993(74)90984-6CrossRefPubMed

Kozak, K., Pohl, J., Birk, W., Greenberg, J., Artz, B., Blommer, M., Cathey, L., & Curry, R. (2006). Evaluation of lane departure warnings for drowsy drivers. In Proceedings of the human factors and ergonomics society annual meeting (Vol. 50, No. 22, pp. 2400–2404). https://doi.org/10.1177/154193120605002211

Krüger, M., Wiebel-Herboth, C. B., & Wersing, H. (2021). Tactile encoding of directions and temporal distances to safety hazards supports drivers in overtaking and intersection scenarios. Transportation Research Part F: Traffic Psychology and Behaviour, 81, 201–222. https://doi.org/10.1016/j.trf.2021.05.014CrossRef

Land, M., & Horwood, J. (1995). Which parts of the road guide steering? Nature, 377(6547), 339–340. https://doi.org/10.1038/377339a0ADSCrossRefPubMed

Larish, D. D., & Frekany, G. A. (1985). Planning and preparing expected and unexpected movements: Reexamining the relationships of arm, direction, and extent of movement. Journal of Motor Behavior, 17(2), 168–189. https://doi.org/10.1080/00222895.1985.10735343CrossRefPubMed

Leuthold, H. (2003). Programming of expected and unexpected movements: Effects on the onset of the lateralized readiness potential. Acta Psychologica, 114(1), 83–100. https://doi.org/10.1016/S0001-6918(03)00051-9CrossRefPubMed

Lylykangas, J., Surakka, V., Salminen, K., Farooq, A., & Raisamo, R. (2016). Responses to visual, tactile and visual–tactile forward collision warnings while gaze on and off the road. Transportation Research Part f: Traffic Psychology and Behaviour, 40, 68–77. https://doi.org/10.1016/j.trf.2016.04.010CrossRef

Macuga, K. L., Beall, A. C., Kelly, J. W., Smith, R. S., & Loomis, J. M. (2007). Changing lanes: Inertial cues and explicit path information facilitate steering performance when visual feedback is removed. Experimental Brain Research, 178(2), 141–150. https://doi.org/10.1007/s00221-006-0718-xCrossRefPubMed

Marinovic, W., Plooy, A. M., & Tresilian, J. R. (2010). The effect of priming on interceptive actions. Acta Psychologica, 135(1), 30–37. https://doi.org/10.1016/j.actpsy.2010.04.009CrossRefPubMed

Meng, F., Gray, R., Ho, C., Ahtamad, M., & Spence, C. (2015). Dynamic vibrotactile signals for forward collision avoidance warning systems. Human Factors, 57(2), 329–346. https://doi.org/10.1177/0018720814542651CrossRefPubMedPubMedCentral

Mohebbi, R., Gray, R., & Tan, H. Z. (2009). Driver reaction time to tactile and auditory rear-end collision warnings while talking on a cell phone. Human Factors, 51(1), 102–110. https://doi.org/10.1177/0018720809333517CrossRefPubMed

Navarro, J., Mars, F., Forzy, J.-F., El-Jaafari, M., & Hoc, J.-M. (2010). Objective and subjective evaluation of motor priming and warning systems applied to lateral control assistance. Accident Analysis & Prevention, 42(3), 904–912. https://doi.org/10.1016/j.aap.2009.07.008CrossRef

Navarro, J., Mars, F., & Hoc, J.-M. (2007). Lateral control assistance for car drivers: A comparison of motor priming and warning systems. Human Factors, 49(5), 950–960. https://doi.org/10.1518/001872007x230280CrossRefPubMed

Ng, A. W., & Chan, A. H. (2012). Finger response times to visual, auditory and tactile modality stimuli. In Proceedings of the international multiconference of engineers and computer scientists (Vol. 2, pp. 1449–1454).

Noubissie Tientcheu, S. I., Du, S., & Djouani, K. (2022). Review on haptic assistive driving systems based on drivers’ steering-wheel operating behaviour. Electronics, 11(13), 2102. https://doi.org/10.3390/electronics11132102CrossRef

Parasuraman, R., & Riley, V. (1997). Humans and automation: Use, misuse, disuse, abuse. Human Factors, 39(2), 230–253. https://doi.org/10.1518/001872097778543886CrossRef

Petermeijer, S. M., Abbink, D. A., Mulder, M., & de Winter, J. C. (2015). The effect of haptic support systems on driver performance: A literature survey. IEEE Transactions on Haptics, 8(4), 467–479. https://doi.org/10.1109/TOH.2015.2437871CrossRefPubMed

Pitts, M. J., Burnett, G., Skrypchuk, L., Wellings, T., Attridge, A., & Williams, M. A. (2012). Visual–haptic feedback interaction in automotive touchscreens. Displays, 33(1), 7–16. https://doi.org/10.1016/j.displa.2011.09.002CrossRef

Prewett, M. S., Elliott, L. R., Walvoord, A. G., & Coovert, M. D. (2012). A meta-analysis of vibrotactile and visual information displays for improving task performance. IEEE Transactions on Systems, Man, and Cybernetics, Part C (applications and Reviews), 42(1), 123–132. https://doi.org/10.1109/TSMCC.2010.2103057CrossRef

Rosenbaum, D. A. (1980). Human movement initiation: Specification of arm, direction, and extent. Journal of Experimental Psychology: General, 109(4), 444–474. https://doi.org/10.1037/0096-3445.109.4.444CrossRefPubMed

Rosenbaum, D. A. (1983). The movement precuing technique: Assumptions, applications, and extensions. In R. A. Magill (Ed.), Advances in psychology (Vol. 12, pp. 231–274). North-Holland.

Rosenbaum, D. A., & Kornblum, S. (1982). A priming method for investigating the selection of motor-responses. Acta Psychologica, 51(3), 223–243. https://doi.org/10.1016/0001-6918(82)90036-1CrossRef

Rowland, B. A., Quessy, S., Stanford, T. R., & Stein, B. E. (2007). Multisensory integration shortens physiological response latencies. Journal of Neuroscience, 27(22), 5879–5884. https://doi.org/10.1523/JNEUROSCI.4986-06.2007CrossRefPubMed

Scott, J., & Gray, R. (2008). A comparison of tactile, visual, and auditory warnings for rear-end collision prevention in simulated driving. Human Factors, 50(2), 264–275. https://doi.org/10.1518/001872008X250674CrossRefPubMed

Society of Automotive Engineers. (2021). Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles (Standard No. J3016_202104). https://www.sae.org/standards/content/j3016_202104/

Spence, C., & Ho, C. (2008). Multisensory warning signals for event perception and safe driving. Theoretical Issues in Ergonomics Science, 9(6), 523–554. https://doi.org/10.1080/14639220701816765CrossRef

Spence, C., Pavani, F., & Driver, J. (2004). Spatial constraints on visual-tactile cross-modal distractor congruency effects. Cognitive, Affective, & Behavioral Neuroscience, 4(2), 148–169. https://doi.org/10.3758/CABN.4.2.148CrossRef

Stanley, L. M. (2006). Haptic and auditory cues for lane departure warnings. In Proceedings of the human factors and ergonomics society annual meeting (Vol. 50, No. 22, pp. 2405–2408). https://doi.org/10.1177/154193120605002212

Stevenson, R. A., Ghose, D., Fister, J. K., Sarko, D. K., Altieri, N. A., Nidiffer, A. R., Kurela, L. R., Siemann, J. K., James, T. W., & Wallace, M. T. (2014). Identifying and quantifying multisensory integration: A tutorial review. Brain Topography, 27(6), 707–730. https://doi.org/10.1007/s10548-014-0365-7CrossRefPubMed

Straughn, S. M., Gray, R., & Tan, H. Z. (2009). To go or not to go: Stimulus-response compatibility for tactile and auditory pedestrian collision warnings. IEEE Transactions on Haptics, 2(2), 111–117. https://doi.org/10.1109/ToH.2009.15CrossRefPubMed

Tan, H., Gray, R., Young, J. J., & Taylor, R. (2003). A haptic back display for attentional and directional cueing. Haptics-e, 3(1), 1–20.

Teasdale, N., Bard, C., Fleury, M., Young, D. E., & Proteau, L. (1993). Determining movement onsets from temporal series. Journal of Motor Behavior, 25(2), 97–106. https://doi.org/10.1080/00222895.1993.9941644CrossRefPubMed

Van Baelen, D., van Paassen, M. M., Ellerbroek, J., Abbink, D. A., & Mulder, M. (2021). Flying by feeling: Communicating flight envelope protection through haptic feedback. International Journal of Human-Computer Interaction, 37(7), 655–665. https://doi.org/10.1080/10447318.2021.1890489CrossRef

van Erp, J. B., & van Veen, H. A. (2004). Vibrotactile in-vehicle navigation system. Transportation Research Part F: Traffic Psychology and Behaviour, 7(4), 247–256. https://doi.org/10.1016/j.trf.2004.09.003CrossRef

Vitello, M. P., Ernst, M. O., & Fritschi, M. (2006). An instance of tactile suppression: Active exploration impairs tactile sensitivity for the direction of lateral movement. In A. Kheddar & B. Bayart (Eds.), EuroHaptics International Conference (EH 2006) (pp. 351–355). Paris.

Wallis, G., Chatziastros, A., & Bülthoff, H. (2002). An unexpected role for visual feedback in vehicle steering control. Current Biology, 12(4), 295–299. https://doi.org/10.1016/S0960-9822(02)00685-1CrossRefPubMed

Wallis, G., Chatziastros, A., Tresilian, J., & Tomasevic, N. (2007). The role of visual and nonvisual feedback in a vehicle steering task. Journal of Experimental Psychology: Human Perception and Performance, 33(5), 1127–1144. https://doi.org/10.1037/0096-1523.33.5.1127CrossRefPubMed

Wolpert, D. M., & Landy, M. S. (2012). Motor control is decision-making. Current Opinion in Neurobiology, 22(6), 996–1003. https://doi.org/10.1016/j.conb.2012.05.003CrossRefPubMedPubMedCentral

Wong, A. L., Haith, A. M., & Krakauer, J. W. (2015). Motor planning. The Neuroscientist, 21(4), 385–398. https://doi.org/10.1177/1073858414541484CrossRefPubMed

Yan, Z., Yang, K., Wang, Z., Yang, B., Kaizuka, T., & Nakano, K. (2020). Intention-based lane changing and lane keeping haptic guidance steering system. IEEE Transactions on Intelligent Vehicles, 6(4), 622–633. https://doi.org/10.1109/TIV.2020.3044180CrossRef

Ziat, M. (2023). Haptics for human-computer interaction: from the skin to the brain. Foundations and Trends® in Human-Computer Interaction, 17, 1–194. https://doi.org/10.1561/1100000061

Ziat, M., Hayward, V., Chapman, C. E., Ernst, M. O., & Lenay, C. (2010). Tactile suppression of displacement. Experimental Brain Research, 206(3), 299–310. https://doi.org/10.1007/s00221-010-2407-zCrossRefPubMed

Ziat, M., Savord, A., & Frissen, I. (2015). The effect of visual, haptic, and auditory signals perceived from rumble strips during inclement weather. In Proceedings of the 2015 IEEE world haptics conference (WHC) (pp. 351–355). https://doi.org/10.1109/WHC.2015.7177737

Titel: Planning lane changes using advance visual and haptic information
Auteurs: Ilja Frissen
Franck Mars
Publicatiedatum: 06-10-2023
Uitgeverij: Springer Berlin Heidelberg
Gepubliceerd in: Psychological Research / Uitgave 2/2024
Print ISSN: 0340-0727
Elektronisch ISSN: 1430-2772
DOI: https://doi.org/10.1007/s00426-023-01879-9

Bohn Stafleu van Loghum

Deel dit onderdeel of sectie (kopieer de link)

Abstract

Log in om toegang te krijgen

Andere artikelen Uitgave 2/2024

The role of environmental contextual cues in sequence learning: evidence from a virtual maze context

Practice reduces the costs of producing head fakes in basketball

Manipulating reinforcement probability changes the temporal overestimation of anticipated aversive stimuli

How flexible is cognitive control? (Mouse) tracking conflict adaptation across context similarities

When feeling is for seeing: comparing the effects of motivated perception between fear and anger on ambiguous threatening stimuli

Space-time mapping on the sagittal axis in congenital blindness