Microsoft Research University of Toronto Sphere Multitouch Interactions on a Spherical Display 2 UIST 08 Spherical Displays 3 UIST 08 Pufferfish PufferSphere ARC Science ID: 650414
Download Presentation The PPT/PDF document "Hrvoje Benko, Andrew D. Wilson, and Ravi..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Hrvoje Benko, Andrew D. Wilson, and Ravin Balakrishnan
Microsoft Research – University of Toronto
Sphere
Multi-touch Interactions on a Spherical DisplaySlide2
2
UIST '08Slide3
Spherical Displays
3UIST '08Pufferfish – PufferSphere
ARC Science – OmniGlobe
Kettner
et al.
‘04 –
ViBall
Global Imagination -
MagicPlanet
Companje
et al.
‘07 –
Globe4D
NOAA –
Science on a Sphere
Not directly interactive
Physical rotation onlySlide4
Interaction Metaphor Shift
4UIST '08Slide5
Sphere
Multi-touch sensitiveBuilt on Global Imagination’s MagicPlanetInternal projection and vision-based sensing5UIST '08
GOAL: Explore interactive possibilities of spherical displays. Slide6
Video: Sphere
UIST '086Slide7
Sphere Video
UIST '087Slide8
Sphere Hardware
UIST '08816”
24”Slide9
UIST '08
9Slide10
UIST '08
10Slide11
Reusing the Optical Path
11UIST '08Slide12
Video: Touch-Sensing
UIST '0812Slide13
Touch-Sensing Software Pipeline
UIST '0813Slide14
Sensing and Projection Distortions
Vertex shader:Pre-distorts objects into 2D disk imageObjects appear undistorted on the spherical surfaceUIST '0814
2D
3DSlide15
Video: Projection Distortions
UIST '0815Slide16
Projection Distortions
UIST '0816Slide17
Choosing a Coordinate System
17
2D (Disk)
Flat (Cylindrical)
3D
(Spherical)
Hybrid
(Tangential Plane)
UIST '08Slide18
Application Prototypes
Photo & Video BrowserOmni-Directional Data VisualizationGlobeOmni-cameraPanoramic WalkthroughSphere PaintingSphere PongUIST '0818Slide19
Design Space of Spherical Displays
Non-visible hemisphereVisibility changes with position“Pseudo-private” and “public” areasNo master user position / orientationSmooth transitions in depth and orientationsNear – farHorizontal – vertical Borderless, but finite displayFew natural landmarks: poles19
UIST '08Slide20
Multi-Touch Interaction Techniques
Multi-touch basicsDrag, Rotation, ScaleExtend user’s reachFlicking, Send-to-Dark-SideMinimize orientation difficultiesAuto-rotation, TetherUniversal circular menuOrb-like invocation gestureUIST '08
20Slide21
Dragging
UIST '0821
V
Flat Surface
1
2
Q
A
θ
1
2
Spherical SurfaceSlide22
Send-to-Dark-Side
Open-palm gestureControl the location where the object will appear22
UIST '08Slide23
Auto-rotation
Similar to Shen et al. DiamondSpin23Default behaviorAuto-rotation
UIST '08Slide24
Tether
Allow unconstrained manipulationPreserve “natural” orientation of omni-directional data upon release24
UIST '08Slide25
Universal Circular Menu
Orb-like InvocationEasy to perform – Hard to do by accident25UIST '08Slide26
Video: Sphere Interactions
UIST '0826Slide27
Sphere Multi-Touch Interactions
UIST '0827Slide28
Video: Contact Area Interactions
UIST '0828Slide29
Sphere Paint & Pong
UIST '0829Slide30
User Observations
3 high-traffic demos>1000 peopleFeedback:“Magical”, “Like a crystal ball”“What is it good for?”“Can I zoom?”Interaction zones:Top – shared Middle – personal/working Bottom – storage Logs show no position preference
30UIST '08Slide31
Future Work
Zooming Sphere as a large controllerSphere as a room projector (instant CAVE)Handheld SphereUIST '0831Slide32
UIST '08
32Slide33
UIST '08
33benko@microsoft.com
http
://research.microsoft.com/~benko/projects/sphere
Try our demo
at the
reception tonight!Slide34
Extra Slides
34UIST '08Slide35
Applications
Visualizing spherical data Planets, starsPublic information boothsRemote omni-directional visualizationSphere + RoundTable 360 deg. video-conferencingRobot operationAmbient DisplaysLarge displayable input deviceTrackballSpace Mouse / JoystickPlanetarium ControlGames
35UIST '08Slide36
Conclusions
The first multi-touch sensitive spherical displaySelf-enclosed solution without occlusion and shadowing problemsA set of multi-touch interactions that facilitate data sharing around the displayOmni-directional room projection possibility Instant CAVEUIST '0836Slide37
Uses
37UIST '08Slide38
UIST '08
38
benko@microsoft.com
http://research.microsoft.com/~benko/projects/sphere
Come to our demo at the reception tonight!Slide39
UIST '08
39M.C. Escherbenko@microsoft.com
http://research.microsoft.com/~benkoSlide40
Putting it all together…
40UIST '08Slide41
Two Spheres (of Interest)
41UIST '08Slide42
Sphere Pong
UIST '0842Slide43
Sphere Painting
UIST '0843Slide44
Extending User’s Reach
UIST '0844Slide45
Auto-rotation & Menu
UIST '0845Slide46
Tether Behavior
UIST '0846