AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Powered by AMiner. Clicking this button will take you away from SciOpen.
Home Tsinghua Science and Technology Article
PDF (12.9 MB)
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Open Access

Survey and Tutorial on Hybrid Human-Artificial Intelligence

School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China
School of Computer Science and Software Engineering, East China Normal University, Shanghai 200062, China
Faculty of Computing, Ulster University, Newtownabbey BT37 0QB, UK
Show Author Information

Abstract

The growing computing power, easy acquisition of large-scale data, and constantly improved algorithms have led to a new wave of artificial intelligence (AI) applications, which change the ways we live, manufacture, and do business. Along with this development, a rising concern is the relationship between AI and human intelligence, namely, whether AI systems may one day overtake, manipulate, or replace humans. In this paper, we introduce a novel concept named hybrid human-artificial intelligence (H-AI), which fuses human abilities and AI capabilities into a unified entity. It presents a challenging yet promising research direction that prompts secure and trusted AI innovations while keeping humans in the loop for effective control. We scientifically define the concept of H-AI and propose an evolution road map for the development of AI toward H-AI. We then examine the key underpinning techniques of H-AI, such as user profile modeling, cognitive computing, and human-in-the-loop machine learning. Afterward, we discuss H-AI’s potential applications in the area of smart homes, intelligent medicine, smart transportation, and smart manufacturing. Finally, we conduct a critical analysis of current challenges and open gaps in H-AI, upon which we elaborate on future research issues and directions.

Keywords

hybrid human-artificial intelligence (H-AI)Internet of Things (IoT)artificial intelligence (AI)

References

[1]
J. McCarthy, Ai as sport, Science, vol. 276, no. 5318, pp. 1518–1519, 1997.
Crossref Google Scholar
[2]
N. Kumar, N. Kharkwal, R. Kohli, and S. Choudhary, Ethical aspects and future of artificial intelligence, in Proc. 2016 Int. Conf. Innovation and Challenges in Cyber Security (ICICCS-INBUSH), Greater Noida, India, 2016, pp. 111–114.
Crossref Google Scholar
[3]
P. Rashidi and D. J. Cook, Keeping the resident in the loop: Adapting the smart home to the user, IEEE Trans. Syst., Man, Cybern. – Part A: Syst. Humans, vol. 39, no. 5, pp. 949–959, 2009.
Crossref Google Scholar
[4]
T. L. Parapugna, G. Petroselli, R. Erra-Basells, and M. G. Lagorio, Biospectroscopy, biospectrometry and imaging of Ilex paraguariensis. Basis for non-destructive quality evaluation using artificial vision, Photochem. Photobiol. Sci., vol. 15, no. 7, pp. 879–888, 2016.
Crossref Google Scholar
[5]
K. H. Yu, A. L. Beam, and I. S. Kohane, Artificial intelligence in healthcare, Nat. Biomed. Eng., vol. 2, no. 10, pp. 719–731, 2018.
Crossref Google Scholar
[6]
M. U. Scherer, Regulating artificial intelligence systems: Risks, challenges, competencies, and strategies, Harv. J. Law Technol., vol. 29, no. 2, pp. 353–400, 2016.
Crossref Google Scholar
[7]
L. Chen, H. Ning, C. D. Nugent, and Z. Yu, Hybrid human-artificial intelligence, Computer, vol. 53, no. 8, pp. 14–17, 2020.
Crossref Google Scholar
[8]
J. B. Carroll, Reviews: Guilford, J. P. The nature of human intelligence. New York: McGraw-Hill, 1967. 538 + xii pp. $14.75, Am. Educ. Res. J., vol. 5, no. 2, pp. 249–256, 1968.
Crossref Google Scholar
[9]
F. Tao, J. Cheng, Q. Qi, M. Zhang, H. Zhang, and F. Sui, Digital twin-driven product design, manufacturing and service with big data, Int. J. Adv. Manuf. Technol., vol. 94, no. 9–12, pp. 3563–3576, 2018.
Crossref Google Scholar
[10]
J. R. Searle, Minds, brains, and programs, Behav. Brain Sci., vol. 3, no. 3, pp. 417–424, 1980.
Crossref Google Scholar
[11]
D. M. W. Powers, Characteristics and heuristics of human intelligence, in Proc. 2013 IEEE Symp. Computational Intelligence for Human-like Intelligence (CIHLI), Singapore, 2013, pp. 100–107.
Crossref Google Scholar
[12]
A. S. Ahmad and A. D. W. Sumari, Cognitive artificial intelligence: Brain-inspired intelligent computation in artificial intelligence, in Proc. 2017 Computing Conf., London, UK, 2017, pp. 135–141.
Crossref Google Scholar
[13]
N. N. Zheng, Z. Y. Liu, P. J. Ren, Y. Q. Ma, S. T. Chen, S. Y. Yu, J. R. Xue, B. D. Chen, and F. Y. Wang, Hybrid-augmented intelligence: Collaboration and cognition, Front. Inf. Technol. Electron. Eng., vol. 18, no. 2, pp. 153–179, 2017.
Crossref Google Scholar
[14]
Z. Akata, D. Balliet, M. de Rijke, F. Dignum, V. Dignum, G. Eiben, A. Fokkens, D. Grossi, K. Hindriks, and H. Hoos, et al., A research agenda for hybrid intelligence: Augmenting human intellect with collaborative, adaptive, responsible, and explainable artificial intelligence, Computer, vol. 53, no. 8, pp. 18–28, 2020.
Crossref Google Scholar
[15]
A. S. Ahmad, Brain inspired cognitive artificial intelligence for knowledge extraction and intelligent instrumentation system, in Proc. 2017 Int. Symp. Electronics and Smart Devices (ISESD), Yogyakarta, Indonesia, 2017, pp. 352–356.
Crossref Google Scholar
[16]
J. M. Hoc, From human-machine interaction to human-machine cooperation, Ergonomics, vol. 43, no. 7, pp. 833–843, 2000.
Crossref Google Scholar
[17]
D. A. Norman, Natural user interfaces are not natural, Interactions, vol. 17, no. 3, pp. 6–10, 2010.
Crossref Google Scholar
[18]
M. E. Clynes and N. Kline, Cyborgs and space, Astronautics, vol. 14, no. 9, pp. 26–27, 1960.
Google Scholar
[19]
S. Ouaftouh, A. Zellou, and A. Idri, User profile model: A user dimension based classification, in Proc. 10th Int. Conf. Intelligent Systems: Theories and Applications (SITA), Rabat, Morocco, 2015, pp. 1–5.
Crossref Google Scholar
[20]
S. Calegari and G. Pasi, Ontology-based information behaviour to improve web search, Future Internet, vol. 2, no. 4, pp. 533–558, 2010.
Crossref Google Scholar
[21]
T. R. Gruber, A translation approach to portable ontology specifications, Knowl. Acquis., vol. 5, no. 2, pp. 199–220, 1993.
Crossref Google Scholar
[22]
F. Shi, Q. Li, T. Zhu, and H. Ning, A survey of data semantization in internet of things, Sensors, vol. 18, no. 1, p. 313, 2018.
Crossref Google Scholar
[23]
H. Ning, Y. Fu, S. Hu, and H. Liu, Tree-code modeling and addressing for non-id physical objects in the internet of things, Telecommun. Syst., vol. 58, no. 3, pp. 195–204, 2015.
Crossref Google Scholar
[24]
H. Ning, F. Shi, T. Zhu, Q. Li, and L. Chen, A novel ontology consistent with acknowledged standards in smart homes, Comput. Networks, vol. 148, pp. 101–107, 2019.
Crossref Google Scholar
[25]
G. Amato and U. Straccia, User profile modeling and applications to digital libraries, in Proc. 3rd Int. Conf. on Theory and Practice of Digital Libraries, Paris, France, 1999, pp. 184–197.
Crossref Google Scholar
[26]
P. Jayakumar and P. Shobana, Creating ontology based user profile for searching web information, in Proc. Int. Conf. on Information Communication and Embedded Systems (ICICES2014), Chennai, India, 2014, pp. 1–6.
Crossref Google Scholar
[27]
S. He and M. Fang, Ontological user profiling on personalized recommendation in e-commerce, in Proc. 2008 IEEE Int. Conf. on e-Business Engineering, Xi’an, China, 2008, pp. 585–589.
Crossref Google Scholar
[28]
J. Stan, V. H. Do, and P. Maret, Semantic user interaction profiles for better people recommendation, in Proc. 2011 Int. Conf. on Advances in Social Networks Analysis and Mining, Washington, DC, USA, 2011, pp. 434–437.
Crossref Google Scholar
[29]
G. Kbar and W. Mansoor, Mobile station location based on hybrid of signal strength and time of arrival, in Proc. Int. Conf. on Mobile Business (ICMB’05), Sydney, Australia, 2005, pp. 585–591.
Google Scholar
[30]
M. M. Shakir and S. A. Mawjoud, U-TDOA position location technique for WCDMA, Tikrit J. Eng. Sci., vol. 20, no. 1, pp. 29–41, 2013.
Crossref Google Scholar
[31]
W. Yao and X. Yang, Design of mobile terminal location system in WCDMA, in Proc. 16th Int. Symp. Communications and Information Technologies (ISCIT), Qingdao, China, 2016, pp. 22–26.
Crossref Google Scholar
[32]
L. Guo, F. Wang, M. Zhang, and L. Sun, Study on robot perception system of multi-sensors information fusion based on fuzzy neural network, in Proc. 7th World Congress on Intelligent Control and Automation, Chongqing, China, 2008, pp. 5728–5732.
Google Scholar
[33]
R. Berri, D. Wolf, and F. Osório, Telepresence robot with image-based face tracking and 3D perception with human gesture interface using Kinect sensor, in Proc. 2014 Joint Conf. Robotics: SBR-LARS Robotics Symp. and Robocontrol, Sao Carlos, Brazil, 2014, pp. 205–210.
Crossref Google Scholar
[34]
M. R. L. Varshini and C. M. Vidhyapathi, Dynamic fingure gesture recognition using KINECT, in Proc. 2016 Int. Conf. Advanced Communication Control and Computing Technologies (ICACCCT), Ramanathapuram, India, 2016, pp. 212–216.
Crossref Google Scholar
[35]
S. Bhattacharya, B. Czejdo, and N. Perez, Gesture classification with machine learning using Kinect sensor data, in Proc. Third Int. Conf. Emerging Applications of Information Technology, Kolkata, India, 2012, pp. 348–351.
Crossref Google Scholar
[36]
C. D. Manning and H. Schütze, Foundations of Statistical Natural Language Processing, Cambridge, MA, USA: MIT Press, 1999.
[37]
W. Chen, B. Chen, T. Xiang, and Z. Zhang, A pragmatic approach to increase accuracy of Chinese word-segmentation, in Proc. 2010 Int. Forum on Information Technology and Applications, Kunming, China, 2010, pp. 389–391.
Google Scholar
[38]
L. Zhao, W. Kong, and B. Chai, A Chinese word segmentation model for energy literature based on conditional random fields, in Proc. 2nd IEEE Conf. Energy Internet and Energy System Integration (EI2), Beijing, China, 2018, pp. 1–4.
Crossref Google Scholar
[39]
L. Y. Zhang, M. Qin, X. M. Zhang, and H. X. Ma, A Chinese word segmentation algorithm based on maximum entropy, in Proc. 2010 Int. Conf. Machine Learning and Cybernetics, Qingdao, China, 2010, pp. 1264–1267.
Crossref Google Scholar
[40]
T. Jiang, H. Yu, and Y. Jam, Tibetan word segmentation system based on conditional random fields, in Proc. IEEE 2nd Int. Conf. Software Engineering and Service Science, Beijing, China, 2011, pp. 446–448.
Google Scholar
[41]
K. Nath, S. Jelil, and L. Rahul, Line, word, and character segmentation of Manipuri machine printed text, in Proc. 2014 Int. Conf. Computational Intelligence and Communication Networks, Bhopal, India, 2014, pp. 203–206.
Crossref Google Scholar
[42]
D. Huang, M. Li, R. Zheng, S. Xu, and J. Bi, Synthetic data and DAG-SVM classifier for segmentation-free Manchu word recognition, in Proc. 2017 Int. Conf. Computing Intelligence and Information System (CIIS), Nanjing, China, 2017, pp. 46–50.
Crossref Google Scholar
[43]
Y. U. Park and H. C. Kwon, Korean syntactic analysis using dependency rules and segmentation, in Proc. 2008 Int. Conf. Advanced Language Processing and Web Information Technology, Dalian, China, 2008, pp. 59–63.
Crossref Google Scholar
[44]
I. A. Bessmertny, A. V. Platonov, E. A. Poleschuk, and P. Ma, Syntactic text analysis without a dictionary, in Proc. IEEE 10th Int. Conf. Application of Information and Communication Technologies (AICT), Baku, Azerbaijan, 2016, pp. 1–3.
Crossref Google Scholar
[45]
D. M. Berry, E. Kamsties, and M. M. Krieger, From contract drafting to software specification: Linguistic sources of ambiguity, https://cs.uwaterloo.ca/∼dberry/handbook/ambiguityHandbook.pdf, 2003.
[46]
M. Ceccato, N. Kiyavitskaya, N. Zeni, L. Mich, and D. M. Berry, Ambiguity identification and measurement in natural language texts, http://eprints.biblio.unitn.it/727/1/Report_v26_DIT_04_111.pdf, 2004.
[47]
R. Sharma, N. Sharma, and K. K. Biswas, Machine learning for detecting pronominal anaphora ambiguity in NL requirements, in Proc. 4th Int. Conf. Applied Computing and Information Technology/3rd Int. Conf. Computational Science/Intelligence and Applied Informatics/1st Int. Conf. on Big Data, Cloud Computing, Data Science & Engineering (ACIT-CSII-BCD), Las Vegas, NV, USA, 2016, pp. 177–182.
Crossref Google Scholar
[48]
L. Chen, N. R. Shadbolt, F. Tao, S. J. Cox, A. J. Keane, G. Goble, A. Roberts, and P. Smart, Engineering knowledge for engineering grid applications, in Proc. 2002 Int. Conf. EuroWeb, Oxford, UK, 2002, p. 2.
Crossref Google Scholar
[49]
K. Bartlmae and N. Heumesser, A framework for the evaluation of web-based experience and case base applications for decision support, in Proc. Professionelles Wissensmanagement Erfahrungen Und Visionen Proc. 9th German Workshop on CaseBased Reasoning GWCBR 2001, Baden-Baden, Germany, 2001, pp. 159–168.
Google Scholar
[50]
K. D. Althoff, A. Birk, C. G. von Wangenheim, and C. Tautz, CBR for experimental software engineering, in Case-Based Reasoning Technology, M. Lenz, H. D. Burkhard, B. Bartsch-Spörl, and S. Wess, eds. Heidelberg, Germany: Springer, 1998, pp. 235–254.
Crossref
[51]
L. Verma, S. Srinivasan, and V. Sapra, Integration of rule based and case based reasoning system to support decision making, in Proc. 2014 Int. Conf. Issues and Challenges in Intelligent Computing Techniques (ICICT), Ghaziabad, India, 2014, pp. 106–108.
Crossref Google Scholar
[52]
S. S. Feng, Y. G. Zhang, and J. G. Sun, Revisit Boolean lattice based fuzzy description logic, in Proc. 2009 Int. Conf. Machine Learning and Cybernetics, Baoding, China, 2009, pp. 297–301.
Crossref Google Scholar
[53]
L. Chen, C. Nugent, and G. Okeyo, An ontology-based hybrid approach to activity modeling for smart homes, IEEE Trans. Human-Mach. Syst., vol. 44, no. 1, pp. 92–105, 2013.
Crossref Google Scholar
[54]
R. M. Monarch, Human-in-the-Loop Machine Learning, Shelter Island, NY, USA: Manning Publications, 2021.
[55]
B. Nushi, E. Kamar, and E. Horvitz, Towards accountable AI: Hybrid human-machine analyses for characterizing system failure, in Proc. 6th AAAI Conf. Human Computation and Crowdsourcing, Zürich, Switzerland, 2018, pp. 126–135.
Crossref Google Scholar
[56]
E. Kamar, Directions in hybrid intelligence: Complementing AI systems with human intelligence, in Proc. 25th Int. Joint Conf. Artificial Intelligence, New York, NY, USA, 2016, pp. 4070–4073.
Google Scholar
[57]
E. Kamar and L. Manikonda, Complementing the execution of AI systems with human computation, in Proc. Workshops of the Thirty-First AAAI Conf. Artificial Intelligence, San Francisco, CA, USA, 2017.
Google Scholar
[58]
T. L. Simons and R. S. Peterson, Task conflict and relationship conflict in top management teams: The pivotal role of intragroup trust, J. Appl. Psychol., vol. 85, no. 1, pp. 102–111, 2000.
Crossref Google Scholar
[59]
R. Parasuraman and V. Riley, Humans and automation: Use, misuse, disuse, abuse, Human Factors, vol. 39, no. 2, pp. 230–253, 1997.
Crossref Google Scholar
[60]
C. R. B. Azevedo, K. Raizer, and R. Souza, A vision for human-machine mutual understanding, trust establishment, and collaboration, in Proc. 2017 IEEE Conf. Cognitive and Computational Aspects of Situation Management (CogSIMA), Savannah, GA, USA, 2017, pp. 1–3.
Crossref Google Scholar
[61]
S. Kothari, A. Tamrawi, and J. Mathews, Rethinking verification: Accuracy, efficiency, and scalability through human-machine collaboration, in Proc. IEEE/ACM 38th Int. Conf. Software Engineering Companion (ICSE-C), Austin, TX, USA, 2016, pp. 885–886.
Crossref Google Scholar
[62]
O. Russakovsky, L. J. Li, and F. F. Li, Best of both worlds: Human-machine collaboration for object annotation, in Proc. 2015 IEEE Conf. Computer Vision and Pattern Recognition, Boston, MA, USA, 2015, pp. 2121–2131.
Crossref Google Scholar
[63]
J. R. Wolpaw, N. Birbaumer, W. J. Heetderks, D. J. McFarland, P. H. Peckham, G. Schalk, E. Donchin, L. A. Quatrano, C. J. Robinson, and T. M. Vaughan, Brain-computer interface technology: A review of the first Int. meeting, IEEE Trans. Rehabil. Eng., vol. 8, no. 2, pp. 164–173, 2000.
Crossref Google Scholar
[64]
S. Kirsner, CyberKinetics’ Brain-to-computer interface gets a second chance, http://archive.boston.com/business/technology/innoeco/2009/08/cyberkinetics_braintocomputer.html, 2022.
[65]
H. Walters, The sound of color: Neil harbisson’s talk visualized, https://ideas.ted.com/the-sound-of-color-neil-harbissons-talk-visualized/, 2022.
[66]
S. Steinert and O. Friedrich, Wired emotions: Ethical issues of affective brain–computer interfaces, Sci. Eng. Ethics, vol. 26, no. 1, pp. 351–367, 2020.
Crossref Google Scholar
[67]
R. Heilweil, Elon musk is one step closer to connecting a computer to your brain, https://www.vox.com/recode/2020/8/28/21404802/elon-musk-neuralink-brain-machine-interface-research, 2022.
[68]
J. Bennett, O. Rokas, and L. Chen, Healthcare in the smart home: A study of past, present and future, Sustainability, vol. 9, no. 5, p. 840, 2017.
Crossref Google Scholar
[69]
Agile Ageing Alliance, Creating a brighter future for our older selves, https://www.agileageing.org/, 2022.
[70]
K. Takayanagi, T. Kirita, and T. Shibata, Comparison of verbal and emotional responses of elderly people with mild/moderate dementia and those with severe dementia in responses to seal robot, PARO, Front. Aging Neurosci., vol. 6, p. 257, 2014.
Crossref Google Scholar
[71]
J. Synnott, L. Chen, C. D. Nugent, and G. Moore, WiiPD-objective home assessment of parkinson’s diseaseusing the Nintendo Wii remote, IEEE Trans. Inf. Technol. Biomed., vol. 16, no. 6, pp. 1304–1312, 2012.
Crossref Google Scholar
[72]
J. Synnott, L. Chen, C. D. Nugent, and G. Moore, The creation of simulated activity datasets using a graphical intelligent environment simulation tool, in Proc. 36th Annu. Int. Conf. of the IEEE Engineering in Medicine and Biology Society, Chicago, IL, USA, 2014, pp. 4143–4146.
Crossref Google Scholar
[73]
N. Ekekwe, Neuromorphs: Replaceable human organs of the future? IEEE Potentials, vol. 27, no. 1, pp. 8–25, 2008.
Crossref Google Scholar
[74]
D. Huh, B. D. Matthews, A. Mammoto, M. Montoya-Zavala, H. Y. Hsin, and D. E. Ingber, Reconstituting organ-level lung functions on a chip, Science, vol. 328, no. 5986, pp. 1662–1668, 2010.
Crossref Google Scholar
[75]
A. Van Den Berg, LABS, cells and organs on chip: Technologies and biomedical applications, in Proc. 19thInt. Conf. Solid-State Sensors, Actuators and Microsystems (TRANSDUCERS), Kaohsiung, China, 2017, pp. 6–9.
Crossref Google Scholar
[76]
G. Dounias and D. Linkens, Adaptive systems and hybrid computational intelligence in medicine, Artif. Intell. Med., vol. 32, no. 3, pp. 151–155, 2004.
Crossref Google Scholar
[77]
R. K. Ando, M. Dredze, and T. Zhang, TREC 2005 genomics track experiments at IBM WATSON, in Proc. Fourteenth Text Retrieval Conf., Gaithersburg, MD, USA, 2005.
Google Scholar
[78]
M. M. Waldrop, Autonomous vehicles: No drivers required, Nature, vol. 518, no. 7537, pp. 20–23, 2015.
Crossref Google Scholar
[79]
N. V. Jungum, R. M. Doomun, S. D. Ghurbhurrun, and S. Pudaruth, Collaborative driving support system in mobile pervasive environments, in Proc. 2008 the Fourth Int. Conf. Wireless and Mobile Communications, Athens, Greece, 2008, pp. 358–363.
Crossref Google Scholar
[80]
W. Li, F. Duan, and C. Xu, Design and performance evaluation of a simple semi-physical human-vehicle collaborative driving simulation system, IEEE Access, vol. 7, pp. 31971–31983, 2019.
Crossref Google Scholar
[81]
A. Kusiak, Smart manufacturing, Int. J. Prod. Res., vol. 56, nos. 1&2, pp. 508–517, 2018.
Crossref Google Scholar
[82]
Ford Media Center, Ford choreographs robots to help people and each other on the fiesta assembly line, https://media.ford.com/content/fordmedia/feu/en/news/2019/09/26/ford-choreographs-robots-to-help-people–and-each-other–on-the-.html, 2022.
[83]
L. D. Evjemo, T. Gjerstad, E. I. Grøtli, and G. Sziebig, Trends in smart manufacturing: Role of humans and industrial robots in smart factories, Curr. Robot. Rep., vol. 1, no. 2, pp. 35–41, 2020.
Crossref Google Scholar
Tsinghua Science and Technology
Volume 28 Issue 3,
June 2023
Pages 486-499
DOI: 10.26599/TST.2022.9010022
Cite this article:
Shi F, Zhou F, Liu H, et al. Survey and Tutorial on Hybrid Human-Artificial Intelligence. Tsinghua Science and Technology, 2023, 28(3): 486-499. https://doi.org/10.26599/TST.2022.9010022

2105

Views

363

Downloads

7

Crossref

7

Web of Science

11

Scopus

0

CSCD

Altmetrics
Received: 15 January 2022
Revised: 15 June 2022
Accepted: 20 June 2022
Published: 13 December 2022
© The author(s) 2023.

The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).
Return