Discover the latest developments in AR, VR, mobile, and wearable technologies for the remote guidance of physical tasks
In Computer-Supported Collaboration: Theory and Practice, an expert team of researchers delivers the latest instruction in using augmented reality (AR), virtual reality (VR), and mobile or wearable technology to support remote guidance on physical tasks. The authors offer an overview of the field before moving on to discuss state-of-the-art research developments in everything from shared visual spaces to the use of hand gestures and gaze information for better collaboration.
The book also describes the hardware devices, software tools, and libraries that can be used to help build remote guidance systems, as well as the industrial systems and applications that have been used in real world settings. Finally, Computer-Supported Collaboration includes a discussion of the current challenges faced by practitioners in the field and likely future directions for new research and development.
Readers will also discover:
A thorough introduction and review of the art of remote guidance research and engineering
Comprehensive explorations of the shared visual space used to support common grounding and the remote guidance of physical tasks, as well as mobility support for local workers
Practical discussions of mobility support of workers and helpers in remote guidance, including systems that support hands-free interaction
In-depth explorations of communication cues in remote guidance, including systems that support gesturing and sketching on a touch-based display
Perfect for researchers and professionals working in human-computer interaction or computer-supported collaborative work, Computer-Supported Collaboration: Theory and Practice is also an ideal resource for educators and graduate students teaching or studying in these fields.
By:
Weidong Huang (University of Technology Sydney Australia),
Mark Billinghurst (University of South Australia,
Adelaide,
Australia; University of Auckland,
Auckland,
NZ),
Leila Alem (University of Technology Sydney,
Australia),
Chun Xiao (University of Technology Sydney,
Australia),
Troels Rasmussen (Aarhus University,
Denmark)
Imprint: Wiley-IEEE Press
Country of Publication: United States
Weight: 666g
ISBN: 9781119719762
ISBN 10: 1119719763
Series: IEEE Press Series on Human-Machine Systems
Pages: 384
Publication Date: 22 May 2024
Audience:
Professional and scholarly
,
Undergraduate
Format: Hardback
Publisher's Status: Active
About the Authors xiii Acknowledgments xv 1 Remote Collaboration on Physical Tasks 1 1.1 Introduction 1 1.2 Remote Collaboration in Perspective 2 1.3 Book Audience 5 2 Communication Models for Remote Guidance 7 2.1 Introduction 7 2.2 Overview of Communication Models 9 2.2.1 Linear Communication Models 12 2.2.2 Nonlinear Communication Models 13 2.2.3 Summary 18 2.3 Applying Communication Models 19 2.4 Communication Behaviors in AR Conferencing 22 2.5 A Communication Model for AR 32 2.6 Conclusions 34 3 Communication Cues in Augmented Remote Collaboration 41 3.1 Introduction 41 3.2 The Research Landscape -- Trends Over Time 43 3.3 Communication in Augmented Remote Collaboration 48 3.4 Challenges 65 3.5 Future Directions 67 3.6 Conclusion 68 4 Communication Cues for Remote Guidance 81 4.1 Introduction 81 4.2 Explicit Communication Cues 84 4.3 Implicit Communication Cues 100 4.4 Challenges and Future Directions 104 4.5 Conclusion 105 5 Communicating Eye Gaze Cues in Remote Collaboration on Physical Tasks 115 5.1 Introduction 115 5.2 The Changing Research Landscape -- Research Topic Trends and Teams over the Past Two Decades 117 5.3 Categorization of System Setup Based on the Screened Publications 122 5.4 Gaze Visualization 127 5.5 Functionality of Tracked Gaze in Remote Guidance on Physical Tasks 130 5.6 Challenges of Utilizing Eye Tracking in Remote Collaboration 132 5.7 Future Directions 133 5.8 Conclusion 135 6 Evaluating Augmented Reality Remote Guidance Systems 143 6.1 Introduction 143 6.2 Evaluation Methods for Collaborative AR 148 6.3 Case Studies From Example Systems 152 6.4 Guidelines 163 6.5 Directions for Research 164 6.6 Conclusion 166 7 Supporting Remote Hand Gestures over the Workspace Video 173 7.1 Introduction 173 7.2 RelatedWork 176 7.3 HandsOnVideo 177 7.4 User Testing 183 7.5 Discussion 189 7.6 Conclusion and Future work 190 8 Gesturing in the Air in Supporting Full Mobility 195 8.1 Introduction 195 8.2 Background 197 8.3 System Overview 200 8.4 Usability Study 203 8.5 Discussion 209 8.6 Concluding Remarks and Future Work 210 9 Sharing Hand Gesture and Sketch Cues with a Touch User Interface 215 9.1 Introduction 215 9.2 RelatedWork 217 9.3 Methods and Materials 220 9.4 Results 228 9.5 Discussion 234 9.6 Limitations 237 9.7 Conclusion 238 10 Augmenting Hand Gestures in 3D Mixed Reality 243 10.1 Introduction 243 10.2 RelatedWork 245 10.3 System Overview 248 10.4 Evaluation 253 10.5 A Comparison of User Ratings between HandsInAir and HandsIn3D 260 10.6 Conclusion and Future Work 262 11 Supporting Tailorability to Meet Individual Task Needs 269 11.1 Introduction 269 11.2 Component-Based Design of RemoteAssistKit 271 11.3 Identifying Tailorable Aspects of Remote Assistance 276 11.4 How Users Tailor Remote Assistance 281 11.5 The Importance of Nonverbal Guidance Depends on the Knowledge Relationship 287 11.6 Sharing of Machine Sounds Is Important for Remote Troubleshooting 288 11.7 High-Resolution Views Are Important for Remote Product Quality Optimization 289 11.8 The Manufacturing Context Poses a Challenge for Creating 3D Reconstructions with Depth Cameras 290 11.9 Multiple Cameras SupportWorkspace Awareness in Large Industrial Task Spaces 290 11.10 Concluding Remarks 293 12 Supporting Workspace Awareness with Augmented Reality-Based Multi-camera Visualization and Tracking 299 12.1 Introduction 299 12.2 Augmented Reality for Supporting Awareness During Multi-camera Remote Assistance 302 12.3 Future Research on Multi-camera Remote Assistance 314 12.4 Discussion of 2D vs. 3DWorkspace Information 320 12.5 Concluding Remarks 321 13 Industrial Applications, Current Challenges, and Future Directions 327 13.1 Introduction 327 13.2 Remote Guidance Systems 327 13.3 Technical, Ethical, and Research Challenges and Future Directions 331 13.4 Conclusion 338 References 339 Index 343
Weidong Huang, PhD, is an Associate Professor at the University of Technology Sydney, Australia. He received his PhD degree in computer science from the University of Sydney. His research interests are in human-computer interaction, visualization and data science. Mark Billinghurst, PhD, is the Director of the Empathic Computing Laboratory and a Professor at the University of South Australia in Adelaide, Australia, and also at the University of Auckland in Auckland, New Zealand. He conducts research on how virtual and real worlds can be merged, publishing over 650 papers on augmented reality, virtual reality, remote collaboration, empathic computing, and related topics. Leila Alem, PhD, is an Adjunct Professor at the University of Technology Sydney Faculty of Engineering and Information Technology. She was a principal research scientist at the CSIRO Digital Productivity and Services based in Sydney. Her main focus of research is in the area of human factors in computer mediated collaboration settings. Drawing on cognitive psychology, social science and human-computer-interface research she has investigated the media, cognitive and social factors at play in telepresence systems and environments. Chun Xiao, PhD, is a Research Data Insights Analyst at the University of Technology Sydney. She received her PhD in computer science from Otto-von-Guericke University Magdeburg, Germany. Troels Rasmussen, PhD, was a Faculty Member in the Department of Computer Science at Aarhus University, Denmark, and received his PhD from the same university. His research interests are in augmented reality and human-computer interaction.
