A computational model of human trust in supervisory control of robotic swarms
Li, Huao
(2020)
A computational model of human trust in supervisory control of robotic swarms.
Master's Thesis, University of Pittsburgh.
(Unpublished)
Abstract
Trust is an important factor in the interaction between humans and automation to mediate the reliance action of human operators. In this work, we study human factors in supervisory control of robotic swarms and develop a computational model of human trust on swarm systems with varied levels of autonomy (LOA). We extend the classic trust theory by adding an intermediate feedback loop to the trust model, which formulates the human trust evolution as a combination of both open-loop trust anticipation and closed-loop trust feedback. A Kalman filter model is implemented to apply the above structure. We conducted a human experiment to collect user data of supervisory control of robotic swarms. Participants were requested to direct the swarm in a simulated environment to finish a foraging task using control systems with varied LOA. We implement three LOAs: manual, mixed-initiative (MI), and fully autonomous LOA. In the manual and autonomous LOA, swarms are controlled by a human or a search algorithm exclusively, while in the MI LOA, the human operator and algorithm collaboratively control the swarm. We train a personalized model for each participant and evaluate the model performance on a separate data set. Evaluation results show that our Kalman model outperforms existing models including inverse reinforcement learning and dynamic Bayesian network methods. In summary, the proposed work is novel in the following aspects:
1) This Kalman estimator is the first to model the complete trust evolution process with both closed-loop feedback and open-loop trust anticipation. 2) The proposed model analyzes time-series data to reveal the influence of events that occur during the course of an interaction; namely, a user’s intervention and report of levels of trust. 3) The proposed model considers the operator’s cognitive time lag between perceiving and processing the system display. 4) The proposed model uses the Kalman filter structure to fuse information from different sources to estimate a human operator's mental states. 5) The proposed model provides a personalized model for each individual.
Share
| Citation/Export: |
|
| Social Networking: |
|
Details
| Item Type: |
University of Pittsburgh ETD
|
| Status: |
Unpublished |
| Creators/Authors: |
|
| ETD Committee: |
|
| Date: |
23 January 2020 |
| Date Type: |
Publication |
| Defense Date: |
21 August 2019 |
| Approval Date: |
23 January 2020 |
| Submission Date: |
28 August 2019 |
| Access Restriction: |
No restriction; Release the ETD for access worldwide immediately. |
| Number of Pages: |
50 |
| Institution: |
University of Pittsburgh |
| Schools and Programs: |
School of Information Sciences > Information Science |
| Degree: |
MS - Master of Science |
| Thesis Type: |
Master's Thesis |
| Refereed: |
Yes |
| Uncontrolled Keywords: |
Human-robot interaction, Cognitive modeling, Swarm robotics, Kalman filter, Trust |
| Related URLs: |
|
| References: |
[1] F Amato et al. “Trust Observations in Validation Exercises”. In: Proc. of Int. Conf. on Secure Software Integration and Reliability Improvement. 2011, pp. 216-223.
[2] Gary Bishop, Greg Welch, et al. “An introduction to the kalman filter”. In: Proc of SIGGRAPH, Course 8.27599-23175 (2001), p. 41.
[3] Francesco Bullo, Jorge Cortes, and Sonia Martinez. Distributed control of robotic net works: a mathematical approach to motion coordination algorithms. Vol. 27. Princeton University Press, 2009.
[4] Zack J Butler, Alfred A Rizzi, and Ralph L Hollis. “Contact sensor-based coverage of rectilinear environments”. In: Proceedings of the IEEE International Symposium on Intelligent Control/Intelligent Systems and Semiotics. IEEE. 1999, pp. 266-271.
[5] Shih-Yi Chien et al. “An Empirical Model of Cultural Factors on Trust in Automation”. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting. Vol. 58. 2014, pp. 859-863.
[6] Miguel Duarte et al. “Application of swarm robotics systems to marine environmental monitoring”. In: OCEANS 2016-Shanghai. IEEE. 2016, pp. 1-8.
[7] Mica R Endsley and Esin O Kiris. “The out-of-the-loop performance problem and level of control in automation”. In: Human Factors 37.2 (1995), pp. 381-394.
[8] Ji Gao and John D Lee. “Extending the decision field theory to model operators' reliance on automation in supervisory control situations”. In: IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 36.5 (2006), pp. 943- 959.
[9] SG Hart and LE Staveland. “Development of a multi-dimensional workload rating scale: Results of empirical and theoretical research. In, PA Hancock and N. Meshkati”. In: Human Mental Workload (1988).
[10] Makoto Itoh, Genya Abe, and Kenji Tanaka. “Trust in and use of automation: their dependence on occurrence patterns of malfunctions”. In: IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No. 99CH37028). Vol. 3. IEEE. 1999, pp. 715-720.
[11] Mohammad R Jahanshahi et al. “Reconfigurable swarm robots for structural health monitoring: a brief review”. In: International Journal of Intelligent Robotics and Ap plications 1.3 (2017), pp. 287-305.
[12] D Kleinman, Sheldon Baron, and W Levison. “A control theoretic approach to manned vehicle systems analysis”. In: IEEE Transactions on Automatic Control 16.6 (1971), pp. 824-832.
[13] John D Lee and Neville Moray. “Trust, self-confidence, and operatorsádaptation to automation”. In: International journal of human-computer studies 40.1 (1994), pp. 153- 184.
[14] John D Lee and Katrina A See. “Trust in automation: Designing for appropriate re liance”. In: Human factors 46.1 (2004), pp. 50-80.
[15] John Lee and Neville Moray. “Trust, control strategies and allocation of function in human-machine systems”. In: Ergonomics 35.10 (1992), pp. 1243-1270.
[16] Michael Lewis, Katia Sycara, and Phillip Walker. “The role of trust in human-robot interaction”. In: Foundations of Trusted Autonomy. Springer, Cham, 2018, pp. 135- 159.
[17] Huao Li et al. “Human Interaction Through an Optimal Sequencer to Control Robotic Swarms”. In: 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE. 2018, pp. 3807-3812.
[18] Bonnie M Muir and Neville Moray. “Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation”. In: Ergonomics 39.3 (1996), pp. 429-460.
[19] Sasanka Nagavalli et al. “Bounds of neglect benevolence in input timing for human interaction with robotic swarms”. In: Proceedings of the tenth annual acm/ieee inter national conference on human-robot interaction. ACM. 2015, pp. 197-204.
[20] Changjoo Nam et al. “Models of Trust in Human Control of Swarms With Varied Levels of Autonomy”. In: IEEE Transactions on Human-Machine Systems (2019).
[21] C. Nam et al. “Predicting trust in human control of swarms via inverse reinforcement learning”. In: 2017 26th IEEE International Symposium on Robot and Human Interac tive Communication (RO-MAN). Aug. 2017, pp. 528-533. doi: 10.1109/ROMAN.2017. 8172353.
[22] C. Nam et al. “Trust of Humans in Supervisory Control of Swarm Robots with Varied Levels of Autonomy”. In: 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC). Oct. 2018, pp. 825-830. doi: 10.1109/SMC.2018.00148.
[23] Raja Parasuraman and Victor Riley. “Humans and automation: Use, misuse, disuse, abuse”. In: Human factors 39.2 (1997), pp. 230-253.
[24] Raja Parasuraman, Thomas B Sheridan, and Christopher D Wickens. “A model for types and levels of human interaction with automation”. In: IEEE Transactions on systems, man, and cybernetics-Part A: Systems and Humans 30.3 (2000), pp. 286-297.
[25] Jacques Penders et al. “A robot swarm assisting a human fire-fighter”. In: Advanced Robotics 25.1-2 (2011), pp. 93-117.
[26] C.W. Reynolds. “Flocks, herds and schools: A distributed behavioral model”. In: ACM SIGGRAPH Computer Graphics. Vol. 21. ACM. 1987, pp. 25-34.
[27] Heath A Ruff, Sundaram Narayanan, and Mark H Draper. “Human interaction with levels of automation and decision-aid fidelity in the supervisory control of multiple sim ulated unmanned air vehicles”. In: Presence: Teleoperators and Virtual Environments 11.4 (2002), pp. 335-351.
[28] Tracy L Sanders et al. “The influence of modality and transparency on trust in human robot interaction”. In: 2014 IEEE International Inter-Disciplinary Conference on Cog nitive Methods in Situation Awareness and Decision Support (CogSIMA). IEEE. 2014, pp. 156-159.
[29] Thomas B Sheridan. “Extending Three Existing Models to Analysis of Trust in Au tomation: Signal Detection, Statistical Parameter Estimation, and Model-Based Con trol”. In: Human factors (2019), p. 0018720819829951.
[30] Thomas B Sheridan. Modeling Human-System Interaction: Philosophical and Method ological Considerations, with Examples. John Wiley & Sons, 2016.
[31] Thomas B Sheridan. Telerobotics, automation, and human supervisory control. MIT press, 1992.
[32] Walt Truszkowski et al. “NASA's swarm missions: The challenge of building autonomous software”. In: IT professional 6.5 (2004), pp. 47-52.
[33] Marialena Vagia, Aksel A Transeth, and Sigurd A Fjerdingen. “A literature review on the levels of automation during the years. What are the different taxonomies that have been proposed?” In: Applied ergonomics 53 (2016), pp. 190-202.
[34] Phillip Walker. CUDA Swarm Simulator. https : / / github . com / pmwalk / cuSwarm. 2015-2017.
[35] Phillip Walker, Michael Lewis, and Katia Sycara. “Characterizing human perception of emergent swarm behaviors”. In: 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE. 2016, pp. 002436-002441.
[36] Robert H Wortham and Andreas Theodorou. “Robot transparency, trust and utility”. In: Connection Science 29.3 (2017), pp. 242-248.
[37] Anqi Xu. “Efficient Collaboration with Trust-Seeking Robots”. An optional note. PhD thesis. Montreal, Quebec, Canada: McGill University, Oct. 2016.
[38] Anqi Xu and Gregory Dudek. “OPTIMo: Online Probabilistic Trust Inference Model for Asymmetric Human-Robot Collaborations”. In: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction. HRI '15. Port land, Oregon, USA: ACM, 2015, pp. 221-228. isbn: 978-1-4503-2883-8. doi: 10.1145/ 2696454.2696492. url: http://doi.acm.org/10.1145/2696454.2696492. |
| Date Deposited: |
23 Jan 2020 21:35 |
| Last Modified: |
23 Jan 2020 21:35 |
| URI: |
http://d-scholarship.pitt.edu/id/eprint/37400 |
Metrics
Monthly Views for the past 3 years
Plum Analytics
Actions (login required)
 |
View Item |
|
![[img]](http://d-scholarship.pitt.edu/style/images/fileicons/other.png)
![[feed]](/images/feed-icon-32x32.png){kind=icon}