Bart Trzynadlowski httptrzyorg NYC HoloLens Developers Meetup November 28 2016 New York NY overview Who Am I How I am approaching HoloLens What Have I Done What Have I Learned ID: 626839
Download Presentation The PPT/PDF document "Hololens : first impressions" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Hololens: first impressions
Bart Trzynadlowskihttp://trzy.org
NYC HoloLens Developers Meetup
November 28, 2016
New York, NY
Slide2
overview
Who Am I?How I am approaching HoloLensWhat Have I Done?
What Have I Learned?
Unity
HoloLens
Game design challenges in AR
Technical challenges
Game ConceptsSlide3
Who am i?
I’m Bart!http://trzy.orgTwitter: @BartronPolygon
Electrical engineer turned software developer
Perhaps best known for my open source Sega Model 3 arcade platform emulator:
http://supermodel3.comSlide4
Video of Sega Model 3 emulator removed. Visit
http://www.youtube.com/BartTrzynadlowski for sample footage.Slide5
WHO AM I?How I AM approaching
hololensMy strengthsDeep programming background (C/C++, assembly language)
Knowledge of 3D graphics
Experienced in high-performance systems (low-latency trading)
My weaknesses
Zero artistic ability
Never developed a complete game from start to finish, let alone in a modern development environmentSlide6
What have I done?
In the past ~3 months:Learned UnityLearned the very basics of 3DS Max to create simple inanimate objects and rig others’ 3D models (from http://www.turbosquid.com
)
HoloLens:
Spatial perception
Occlusion/3D hole-in-wall effectsSlide7
Video of
Desert Strike for Sega Genesis removed. The Strike series served as inspiration for my helicopter demo.Slide8
HoloLens demo footage removed. View it at:
https://youtu.be/Ed-7RqIk5Ic Slide9
WHAT HAVE I LEARNED?UNitySlide10
WHAT HAVE I LEARNED?UNity
Impressions:Very conducive to rapid prototypingPowerful engine – I feel redundant as a programmer!
Easy to begin learning (start w/ Roll-a-Ball tutorial:
https://unity3d.com/learn/tutorials
)
Extremely extensive support community – even my ultra-specific, ultra-obscure Google “How do I …?” queries yield useful forum answers!
Overall:
very
impressed!Slide11
WHAT HAVE I LEARNED?UNity
Some cons:Lots of “magic”Extensive use of C# getters/setters that do heavy/non-obvious work (e.g.,
Mesh.vertices
[]
)
Occasional violation of the “principle of least surprise”
Best practices not obvious
You’ll see some weird, hacky stuff on the forumsSlide12
WHAT HAVE I LEARNED?HoloLens
Dev advice:Familiarize yourself with Microsoft’s HoloToolkit package!
Learn to save your own room mesh with HoloLens web GUI and use in Unity Editor with
HoloToolkit’s
ObjectSurfaceObserver
#if UNITY_EDITOR
Very useful!
Room mapping best done ahead of time (e.g.,
Young Conker
and
RoboRaid
)
Too slow in real-time
Analyzing the environment will be expensive and ought to be done onceSlide13
WHAT HAVE I LEARNED?GAME DESIGN CHALLENGES IN AR
No control over camera!Hard to deliver a cinematic experienceUser might not care to look where you want them to
Also a challenge in VR!
Environment totally unpredictable
Object placement, level design
Spatial meshes can be noisy
Object scaleSlide14
WHAT HAVE I LEARNED?GAME DESIGN CHALLENGES IN AR
HoloLens specific:First-time users befuddled by gestures and often have no idea what to doInstinctively use their hands to grasp and reach for things
Pain in the neck!
Gameplay on floors and tables is awesome but the device is front-heavy and can cause neck pain quickly
Consider having gameplay take place
above
eye level! (More comfy to look upwards.)Slide15
WHAT HAVE I LEARNED?GAME DESIGN CHALLENGES IN AR
Work-in-progress: Smarter object placementSlide16
WHAT HAVE I LEARNED?GAME DESIGN CHALLENGES IN AR
Work-in-progress: Smarter object placementSlide17Slide18
WHAT HAVE I LEARNED?GAME DESIGN CHALLENGES IN AR
Work-in-progress: Real-time spatial mesh deformationSlide19
WHAT HAVE I LEARNED?GAME DESIGN CHALLENGES IN AR
Work-in-progress: Real-time spatial mesh deformationSlide20
WHAT HAVE I LEARNED?GAME DESIGN CHALLENGES IN AR
Work-in-progress: Real-time spatial mesh deformationSlide21
WHAT HAVE I LEARNED?GAME DESIGN CHALLENGES IN AR
Work-in-progress: Real-time spatial mesh deformationSlide22
WHERE TO FROM HERE?Game concepts
Simulation / world-buildingSlide23
WHERE TO FROM HERE?Game concepts
Simulation / world-buildingSlide24Slide25
WHERE TO FROM HERE?Game concepts
Observation (e.g., Nintendo’s Fruit from Game &
Wario
collection)Slide26
WHERE TO FROM HERE?Game concepts
Real-time strategy (I mean, duh…)
EtherWars
Slide27
GAME CONCEPTS
Physics puzzlersSlide28
THAT’S ALL, FOLKS!(Any questions?)