Home Journal of Intelligent and Connected Vehicles Article
PDF (4.6 MB)
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript
Research Article | Open Access

Segmented trust assessment in autonomous vehicles via eye-tracking

Miklós Lukovics(), Szabolcs Prónay, Barbara Nagy
Faculty of Economics and Business Administration, University of Szeged, Szeged H-6726, Hungary
Show Author Information

Abstract

Previous studies have identified trust as one of the key factors in the technology acceptance of autonomous vehicles. As these studies mostly investigated the population in general, little is known about segment-specific differences. Furthermore, the widely used survey methods are less able to capture the deeper forms of trust—which neuroscientific methods are much better suited to capture. The main objective of our research is to study trust as one of the key factors of technology acceptance related to autonomous vehicles by using neuroscientific methods for specific consumer segments. Real-time eye-tracking tests were applied to a sample of 113 participants, combined with a posttest self-report. The tests were carried out under laboratory conditions during which our subjects watched videos recorded with the internal cameras of autonomous vehicles. Based on the fixation count, total fixation duration, and pupil dilation, we empirically verified that the trust level of all five identified segments is relatively low, while the trust level of the “traditional rejecting” segment is the lowest. An increase in trust level can be shown if the subjects receive extra information about the journey. Another important finding is that the self-reported trust level is not always congruent with the eye-tracking analysis results; therefore, combined approaches can lead to greater measurement validity.

Keywords

autonomous vehicles (AVs)technology acceptancetrusteye-tracking

References

 

Azevedo-Sa, H., Jayaraman, S. K., Esterwood, C. T., Yang, X. J., Robert Jr, L. P., Tilbury, D. M., 2021. Real-time estimation of drivers’ trust in automated driving systems. Int J Soc Robot, 13, 1911−1927.

Crossref Google Scholar
 
Bagheri, N., Jamieson, G. A., 2004. Considering subjective trust and monitoring behavior in assessing automation-induced ‘complacency’. In: Human performance, situation awareness, and automation: Current research and trends, 54–59.
 
Boon, S. D., Holmes, J. G., 1991. The Dynamics of Interpersonal Trust: Resolving Uncertainty in Face of Risk. Cambridge, UK: Cambridge University Press.
 
Bozkir, E., Stark, P., Gao, H., Hasenbein, L., Hahn, J. U., Kasneci, E., et al., 2021. Exploiting object-of-interest information to understand attention in VR classrooms. In: 2021 IEEE Virtual Reality and 3D User Interfaces (VR), 597–605.
Crossref
 

Bradach, J. L., Eccles, R. G., 1989. Price, authority, and trust: From ideal types to plural forms. Annu Rev Sociol, 15, 97−118.

Crossref Google Scholar
 

Choi, J. K., Ji, Y. G., 2015. Investigating the importance of trust on adopting an autonomous vehicle. Int J Hum Comput Interact, 31, 692−702.

Crossref Google Scholar
 
Cutrell, E., Guan, Z., 2007. What are you looking for? An eye-tracking study of information usage in web search. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 407–416.
Crossref
 

Csepeli, Gy., Örkény, A., Székelyi, M., Barna, I., 2004. Bizalom és gyanakvás. Szociológiai Szemle, 1, 3−35.

Google Scholar
 

Das, T. K., Teng, B. S., 2004. The risk-based view of trust: A conceptual framework. J Bus Psychol, 19, 85−116.

Crossref Google Scholar
 

Davis, F. D., 1989. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q, 13, 319−340.

Crossref Google Scholar
 
Desai, M., Medvedev, M., Vázquez, M., McSheehy, S., Gadea-Omelchenko, S., Bruggeman, C., et al., 2012. Effects of changing reliability on trust of robot systems. In: Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction, 73–80.
Crossref
 

Dickerhoof, A., Smith, C. L., 2014. Looking for query terms on search engine results pages. Proc Assoc For Info, 51, 1−5.

Crossref Google Scholar
 
Djamasbi, S., Hall-Phillips, A., Yang, R., 2013. Search results pages and competition for attention theory: An exploratory eye-tracking study. In: International Conference on Human Interface and the Management of Information, 576–583.
Crossref
 

Doney, P. M., Cannon, J. P., Mullen M. R., 1998. Understanding the influence of national cultureon the development of trust. The Academy of Management Review, 23, 601−620.

Crossref Google Scholar
 
Dunn, M. J., Alexander, R. G., Amiebenomo, O. M., Arblaster, G., Atan, D., Erichsen, J. T., et al., 2023. Minimal reporting guideline for research involving eye tracking (2023 edition). Behav Res Methods, 1–7.
Crossref
 
Egusa, Y. Takaku, M. Terai, H. Saito, H. Kando, N. Miwa, M., 2008. Visualization of user eye movements for search result pages. In: Proceedings of the EVIA, 42–46.
 

Eraslan, S., Yaneva, V., Yesilada, Y., Harper, S., 2018. Web users with autism: eye tracking evidence for differences. Behav Inform Technol, 38, 678−700.

Crossref Google Scholar
 
Fenyvesi, É., Vágány, J., Kárpáti-Daróczi, J., 2013. A bizalom és az érzelmi intelligencia szerepe a szervezeti tagok “együttműködöbbé” válásában. Agora, 34–48. (in Hungarian
 

Fitts, P. M., Jones, R. E., Milton, J. L., 1950. Eye movements of aircraft pilots during instrument landing approaches. Aeronautical Engineering Review, 9, 1−5.

Google Scholar
 

Gold, C., Körber, M., Hohenberger, C., Lechner, D., Bengler, K., 2015. Trust in automation–before and after the experience of take-over scenarios in a highly automated vehicle. Procedia Manuf, 3, 3025−3032.

Crossref Google Scholar
 
Guan, Z., Cutrell, E., 2007. An eye tracking study of the effect of target rank on web search. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 417–420.
Crossref
 
Habuchi, Y., Kitajima, M., Takeuchi, H., 2008. Comparison of eye movements in searching for easy-to-find and hard-to-find information in a hierarchically organized information structure. In: Proceedings of the 2008 symposium on Eye tracking research & applications, 131–134.
Crossref
 
Hámori, B., 2004. Bizalom, jóhírnév és identitás az elektronikus piacokon. Közgazdasági Szemle, 51, 832–848. (in Hungarian
 

He, X., Stapel, J., Wang, M., Happee, R., 2022. Modelling perceived risk and trust in driving automation reacting to merging and braking vehicles. Transp Res Part F: Traffic Psychol Behav, 86, 178−195.

Crossref Google Scholar
 

Hergeth, S., Lorenz, L., Vilimek, R., Krems, J. F., 2016. Keep your scanners peeled: Gaze behavior as a measure of automation trust during highly automated driving. Hum Factors, 58, 509−519.

Crossref Google Scholar
 

Hoff, K. A., Bashir, M., 2015. Trust in automation: Integrating empirical evidence on factors that influence trust. Hum Factors, 57, 407−434.

Crossref Google Scholar
 

Ibourk, E. M., Al-Adwan, A., 2019. Subtitling virtual reality into Arabic: Eye tracking 360-degree video for exploring viewing experience. Lebende Sprachen, 64, 286−308.

Crossref Google Scholar
 

Józsa, E., Hámornik, B. P., 2011. Find the difference!: Eye tracking study on information seeking behavior using an online game. J Eye Track Vis Cogn Emot, 2, 27−35.

Google Scholar
 

Kapser, S., Abdelrahman, M., 2020. Acceptance of autonomous delivery vehicles for last-mile delivery in Germany–Extending UTAUT2 with risk perceptions. Transp Res Part C Emerg Technol, 111, 210−225.

Crossref Google Scholar
 

Kenesei, Z., Ásványi, K., Kökény, L., Jászberényi, M., Miskolczi, M., Gyulavári, T., et al., 2022. Trust and perceived risk: How different manifestations affect the adoption of autonomous vehicles. Transp Res Part A Policy Pract, 164, 379−393.

Crossref Google Scholar
 

Keszey, T., 2020. Behavioural intention to use autonomous vehicles: Systematic review and empirical extension. Transp Res Part C Emerg Technol, 119, 102732.

Crossref Google Scholar
 

Kim, J., Thomas, P., Sankaranarayana, R., Gedeon, T., Yoon, H. J., 2016. Understanding eye movements on mobile devices for better presentation of search results. Asso For Info Science & Tech, 67, 2607−2619.

Crossref Google Scholar
 

Koo, J., Kwac, J., Ju, W., Steinert, M., Leifer, L., Nass, C., 2015. Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance. Int J Interact Des Manuf Ijidem, 9, 269−275.

Crossref Google Scholar
 

Körber, M., Baseler, E., Bengler, K., 2018. Introduction matters: Manipulating trust in automation and reliance in automated driving. Appl Ergon, 66, 18−31.

Crossref Google Scholar
 

Koul, S., Eydgahi, A., 2018. Utilizing Technology Acceptance Model (TAM) for driverless car technology Adoption. Journal Technology Management & Innovation, 13, 37−46.

Crossref Google Scholar
 

Kumar, N., 1996. The power of trust in manufacturer-retailer relationships. Harv Bus Rev, 74, 93−107.

Google Scholar
 

Lee, J. D., See, K. A., 2004. Trust in automation: Designing for appropriate reliance. Hum Factors, 46, 50−80.

Crossref Google Scholar
 

Liu, P., Xu, Z., Zhao, X., 2019. Road tests of self-driving vehicles: Affective and cognitive pathways in acceptance formation. Transp Res Part A Policy Pract, 124, 354−369.

Crossref Google Scholar
 

Lu, Y., Sarter, N., 2018. Eye tracking: A promising method for inferring trust in real time. Proc Hum Factors Ergon Soc Annu Meet, 62, 175−176.

Crossref Google Scholar
 

Lu, Y., Sarter, N., 2019. Eye tracking: A process-oriented method for inferring trust in automation as a function of priming and system reliability. IEEE Trans Human-Mach Syst, 49, 560−568.

Crossref Google Scholar
 

Lu, Y., Sarter, N., 2020. Modeling and inferring human trust in automation based on real- time eye tracking data. Proc Hum Factors Ergon Soc Annu Meet, 64, 344−348.

Crossref Google Scholar
 

Lukovics, M., Prónay, S., Majó-Petri, Z., Kovács, P., Ujházi, T., Volosin, M., et al., 2023. Combining survey-based and neuroscience measurements in customer acceptance of self-driving technology. Transp Res Part F Traffic Psychol Behav, 95, 46−58.

Crossref Google Scholar
 

Mayer, R. C., Davis, J. H., Schoorman, F. D., 1995. An integrative model of organizational trust. Acad Manag Rev, 20, 709.

Crossref Google Scholar
 

Manzey, D., Reichenbach, J., Onnasch, L., 2012. Human performance consequences of automated decision aids. J Cogn Eng Decis Mak, 6, 57−87.

Crossref Google Scholar
 

Meyer-Waarden, L., Cloarec, J., 2022. “Baby, you can drive my car”: Psychological antecedents that drive consumers’ adoption of AI-powered autonomous vehicles. Technovation, 109, 102348.

Crossref Google Scholar
 

Moray, N., Inagaki, T., 2000. Attention and complacency. Theor News Ergon Sci, 1, 354−365.

Crossref Google Scholar
 

Muir, B. M., Moray, N., 1996. Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. Ergonomics, 39, 429−460.

Crossref Google Scholar
 

Müller, J. M., 2019. Comparing technology acceptance for autonomous vehicles, battery electric vehicles, and car sharing—a study across Europe, China, and North America. Sustainability, 11, 4333.

Crossref Google Scholar
 
Nagy, B., Prónay, S., Lukovics, M., 2022. Én vezessek, te vezetsz vagy önvezet? –az önvezetőjármű-elfogadás öt perszóna típusa magyarországon. Marketing És Menedzsment, 56, 23–34. (in Hungarian
Crossref
 
Nagy, J., Schubert, A., 2007. A bizalom szerepe az üzleti kapcsolatokban. Budapesti Corvinus Egyetem, 77. (in Hungarian
 
Orlosky, J., Huynh, B., Hollerer, T., 2019. Using eye tracked virtual reality to classify understanding of vocabulary in recall tasks. In: 2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), 66–73.
Crossref
 

Panagiotopoulos, I., Dimitrakopoulos, G., 2018. An empirical investigation on consumers’ intentions towards autonomous driving. Transp Res Part C Emerg Technol, 95, 773−784.

Crossref Google Scholar
 

Park, J., Han, S., 2023. Investigating older consumers’ acceptance factors of autonomous vehicles. J Retail Consum Serv, 72, 103241.

Crossref Google Scholar
 
Perello-March, J., Burns, C., Elliott, M., Birrell, S., 2019. Integrating trust in automation into driver state monitoring systems. In: International Conference on Human Interaction and Emerging Technologies, 344–349.
Crossref
 
Pernice, K., Nielsen, J., 2009. How to conduct and evaluate usability studies ssing eyetracking. CA, USA: Nielsen Norman Group.
 

Potoglou, D., Whittle, C., Tsouros, I., Whitmarsh, L., 2020. Consumer intentions for alternative fuelled and autonomous vehicles: A segmentation analysis across six countries. Transp Res Part D Transp Environ, 79, 102243.

Crossref Google Scholar
 

Raats, K., Fors, V., Pink, S., 2020. Trusting autonomous vehicles: An interdisciplinary approach. Transp Res Interdiscip Perspect, 7, 100201.

Crossref Google Scholar
 

Rele, R. S., Duchowski, A. T., 2005. Using eye tracking to evaluate alternative search results interfaces. Proc Hum Factors Ergon Soc Annu Meet, 49, 1459−1463.

Crossref Google Scholar
 
Rogers, E., 2003. Diffusion of Innovations, 5th edn. New York: Free Press.
 

Shadiev, R., Li, D., 2023. A review study on eye-tracking technology usage in immersive virtual reality learning environments. Comput Educ, 196, 104681.

Crossref Google Scholar
 

Shariff, A., Bonnefon, J.-F., Rahwan, I., 2017. Psychological roadblocks to the adoption of self-driving vehicles. Nature Human Behaviour, 1, 694−696.

Crossref Google Scholar
 

Sharma, I., Mishra, S., 2022. Quantifying the consumer’s dependence on different information sources on acceptance of autonomous vehicles. Transp Res Part A Policy Pract, 160, 179−203.

Crossref Google Scholar
 
Sheng, S., Pakdamanian, E., Han, K., Kim, B., Tiwari, P., Kim, I., et al., 2019. A case study of trust on autonomous driving. In: 2019 IEEE Intelligent Transportation Systems Conference (ITSC), 4368–4373.
Crossref
 

Smyth, J., Chen, H., Donzella, V., Woodman, R., 2021. Public acceptance of driver state monitoring for automated vehicles: Applying the UTAUT framework. Transp Res Part F Traffic Psychol Behav, 83, 179−191.

Crossref Google Scholar
 

Strauch, C., Mühl, K., Patro, K., Grabmaier, C., Reithinger, S., Baumann, M., et al., 2019. Real autonomous driving from a passenger’s perspective: Two experimental investigations using gaze behaviour and trust ratings in field and simulator. Transp Res Part F Traffic Psychol Behav, 66, 15−28.

Crossref Google Scholar
 

Strzelecki, A., 2020. Eye-tracking studies of web search engines: A systematic literature review. Information, 11, 300.

Crossref Google Scholar
 
Varga, Á., 2016. Neuromarketing, a marketingkutatás új iránya. Veztud, 47, 55–63. (in Hungarian
Crossref
 

Venkatesh, V., Bala, H., 2008. Technology acceptance model 3 and a research agenda on interventions. Decis Sci, 39, 273−315.

Crossref Google Scholar
 

Venkatesh, V., Morris, M. G., Davis, G. B., Davis, F. D., 2003. User acceptance of information technology: Toward a unified view. MIS Q, 27, 425−478.

Crossref Google Scholar
 

Venkatesh, V., Thong, J. Y. L., Xu, X., 2012. Consumer acceptance and use of information technology: Extending the unified theory of acceptance and use of technology. MIS Q, 36, 157−178.

Crossref Google Scholar
 

Venkatesh, V., Davis, F. D., 2000. A theoretical extension of the technology acceptance model: Four Longitudinal Field Studies. Management Science, 46, 186−204.

Crossref Google Scholar
 

Vorm, E. S., Combs, D. J. Y., 2022. Integrating transparency, trust, and acceptance: The intelligent systems technology acceptance model (ISTAM). Int J Hum, 38, 1828−1845.

Crossref Google Scholar
 
Walker, F., Verwey, W., Martens, M., 2018. Gaze behaviour as a measure of trust in automated vehicles. In: Proceedings of the 6th Humanist Conference, 1–6.
 

Walker, F., Wang, J., Martens, M. H., Verwey, W. B., 2019. Gaze behaviour and electrodermal activity: Objective measures of drivers’ trust in automated vehicles. Transp Res Part F Traffic Psychol Behav, 64, 401−412.

Crossref Google Scholar
 

Wang, Y., Gu, J., Wang, S., Wang, J., 2019. Understanding consumers’ willingness to use ride-sharing services: The roles of perceived value and perceived risk. Transp Res Part C Emerg Technol, 105, 504−519.

Crossref Google Scholar
 

Wang, C. C., Hung, J. C., Chen, H. C., 2021. How prior knowledge affects visual attention of Japanese mimicry and onomatopoeia and learning outcomes: Evidence from virtual reality eye tracking. Sustainability, 13, 11058.

Crossref Google Scholar
 
Wickens, C. D., Hollands, J. G., Banbury, S., Parasuraman, R., 2015. Engineering Psychology and Human Performance. London, UK: Psychology Press.
Crossref
 
Xu, S., Jiang, H., Lau, F. C. M., 2008. Personalized online document, image and video recommendation via commodity eye-tracking. In: Proceedings of the 2008 ACM conference on Recommender systems, 83–90.
Crossref
 

Zhang, S., Jing, P., Xu, G., 2021. The acceptance of independent autonomous vehicles and cooperative vehicle-highway autonomous vehicles. Information, 12, 346.

Crossref Google Scholar
 

Zhu, G., Chen, Y., Zheng, J., 2020. Modelling the acceptance of fully autonomous vehicles: A media-based perception and adoption model. Transp Res Part F Traffic Psychol Behav, 73, 80−91.

Crossref Google Scholar
Journal of Intelligent and Connected Vehicles
Volume 7 Issue 2,
June 2024
Pages 151-161
DOI: 10.26599/JICV.2023.9210037
Cite this article:
Lukovics M, Prónay S, Nagy B. Segmented trust assessment in autonomous vehicles via eye-tracking. Journal of Intelligent and Connected Vehicles, 2024, 7(2): 151-161. https://doi.org/10.26599/JICV.2023.9210037
Metrics & Citations  
Article History
Copyright
Rights and Permissions
Return