Natural User Interfaces
This content delves into the concept of natural user interfaces (NUI) and their impact on interface design. It discusses the principles behind NUI, examines the trade-offs in interface design, and highlights the four core themes of Reality-Based Interfaces. The content also explores the relationship between input/output modalities, human capabilities, and efficacy in NUI.
Download Presentation

Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
Natural User Interfaces CPSC 481: HCI I Winter 2014 Anthony Tang 1
What is all this natural user interface stuff? People invented {Kinect}* / {multi-touch}^ People like {Kinect}* / {multi-touch}^ Researchers articulation/characterization of what it is about these interfaces that make them likable/effective => natural user interface * {Insert physical game interface} ^ {Insert direct touch interface} 2
Learning Objectives By the end of this lecture, you should be able to: Discuss natural user interfaces as a design philosophy Describe the "reality-based interface" design philosophy Identify and define the four core themes of the Reality-Based Interfaces philosophy Understand how RBI relates to various trade-offs in interface design 3
Natural User Interfaces CPSC 481: HCI I Fall 2012 Anthony Tang 4
Intuitive interface? The only intuitive interface is the nipple. After that, it s all learned. Bruce Ediger 5
What does natural mean? adjective existing in or formed by nature (as opposed to artificial) noun a thing that is likely/certain to be suitable/successful in an endeavor without much training or difficulty 6
Natural User Interfaces vs. Natural User Interfaces 8
Input/Output Modalities Provide us with the opportunity to make NUIs , but do not guarantee it => NUIs are not specifically input or output technologies 9
Natural User Interfaces NUI = f(input / output capabilities, human capabilities) NUI = feelings of efficacy 10
BumpTop 11
Reality-Based Interfaces One way of thinking about Natural User Interfaces -> Reality-based interfaces Robert Jacob et al., 2008 In spite of the name, they are not advocating necessarily re-creating reality; instead, advocating leveraging our understanding of reality for design 12
RBIs: Core Themes Aspects of our understanding/capacities that have developed of/for the physical, non-digital world that can be leveraged for design 13
Nave Physics People s common-sense knowledge about the physical world Friction, gravity, velocity, momentum, mass, etc. 14
Nave Physics 15
Body Awareness and Skills People have an awareness of their own physical bodies and possess skills for controlling and coordinating their bodies Proprioception (relative relation of limbs), range of motion. Coordinating body to walk, crawl, kick, throw a ball 16
Environmental Awareness and Skills People have a sense of their surroundings and possess skills for negotiating, manipulating, and navigating within their environment Sense of orientation and spatial understanding Horizon, depth cues like shadow, lighting, etc. Manipulating things in the environment (positioning,altering, re-arranging objects) 17
Social Awareness and Skills People are aware of others in the environment and have skills for interacting with them Verbal and non-verbal communication 18
Urban Resource Planner Makes use of na ve physics, and knowledge/understanding of environment and physical space Moves body to change viewpoints No need to share a screen , it is a physical workspace 19
Tradeoffs Expressive Power: people can perform a variety of tasks in the application domain Efficiency: users can perform a task quickly Versatility: users can perform many tasks from different application domains Ergonomics: users can perform a task without physical injury or fatigue Accessibility: users with a variety of abilities can perform a task Practicality: system is practical to develop and produce 20
Expressive Power vs. Reality BumpTop Cool, but limited by screen real-estate Also limited in terms of capacity for trees of folders 21
Efficiency vs. Reality Tangible Video Editor Effective for a novice, but slows down an expert user 22
Versatility vs. Reality Tangible Video Editor Only allows you to complete one type of task 23
Case Studies URP: Urban Resource Planner Apple iPhone 24
Urban Resource Planner Makes use of na ve physics, and knowledge/understanding of environment and physical space Moves body to change viewpoints No need to share a screen , it is a physical workspace 25
iPhone Flicking photos (spatial metaphor) Zoom and rubber surface (na ve physics) Springiness/inertia flicking contacts/ends of lists, etc. (na ve physics) 26
Learning Objectives By the end of this lecture, you should be able to: Discuss natural user interfaces as a design philosophy Describe the "reality-based interface" design philosophy Identify and define the four core themes of the Reality-Based Interfaces philosophy Understand how RBI relates to various trade-offs in interface design 27
As you watch these Which of the interfaces in these video are probable to be used in five years? In ten years? Which of the interfaces looks most useful? Least useful? What does this make you think of? 28
ambientRoom 29
PingPongPlus 30
i/o Brush 31
SandCanvas 32
Sphere 33
Microsoft Productivity Future Vision (2011) 35
OmniTouch 36
MagicFinger 37
CodeSpace 38
Conte 39