Designing for Gesture and Tangible Interaction

Interactive technology is increasingly integrated with physical objects that do not have a traditional keyboard and mouse style of interaction, and many do not even have a display. These objects require new approaches to interaction design, referred to as post-WIMP (Windows, Icons, Menus, and Pointer) or as embodied interaction design.

This book provides an overview of the design opportunities and issues associated with two embodied interaction modalities that allow us to leave the traditional keyboard behind: tangible and gesture interaction. We explore the issues in designing for this new age of interaction by highlighting the significance and contexts for these modalities. We explore the design of tangible interaction with a reconceptualization of the traditional keyboard as a Tangible Keyboard, and the design of interactive three-dimensional (3D) models as Tangible Models. We explore the design of gesture interaction through the design of gesture-base commands for a walk-up-and-use information display, and through the design of a gesture-based dialogue for the willful marionette. We conclude with design principles for tangible and gesture interaction and a call for research on the cognitive effects of these modalities.

Preface.- Acknowledgments.- Introduction.- Tangible Interaction Design.- Designing for Tangible Interaction.- Gesture-based Interaction.- Designing for Gesture Interaction.- Looking to the Future: Research Challenges.- Bibliography.- Authors' Biographies .

Mary Lou Maher is Professor and Chair of Software and Information Systems at UNC Charlotte and Honorary Professor of Design Computing in the Design Lab at the University of Sydney. At UNC Charlotte, she has established a concentration in HCI in the B.A. in Computer Science and in the M.S. in Information Technology. She has established a Design Studio and a Maker Space in the Department of Software and Information Systems. While at the University of Sydney, she created a new undergraduate degree called a Bachelor of Design Computing. While a Program Director at NSF, she started a funding program called CreativeIT. Dr. Mahers research interests include: cognitive effects of embodied interaction modalities, computational and cognitive models of creativity, and design patterns for active learning strategies in CS education.Lina Lee is a Ph.D. student in the College of Computing and Informatics at UNC Charlotte. She received a B.S. and a M.S. in Housing and Interior Design from Kyung Hee University in South Korea. After then, she received a dual degree: M.S. in Architecture and M.S. in Information Technology Software at UNC Charlotte. She is a member of the InDe Lab and HCI Lab at UNC Charlotte. Her research interest is in the area of Human-Computer Interaction with particular focus on designing an interactive information system with gesture-based interactive techniques that enhance public engagement with interactive systems.