Stephen M Watt Western University Teaching with Technology 21 May 2015 W estern University London Ontario Canada Teaching and Learning are Collaborations Collaborative Software Common Features ID: 311636
Download Presentation The PPT/PDF document "InkChat" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
InkChat
Stephen M. WattWestern University
Teaching with Technology
21 May 2015, Western University, London Ontario, CanadaSlide2
Teaching and Learning are
CollaborationsSlide3
Collaborative SoftwareSlide4
Common Features
Slide showsWhiteboardingVoice chatVideo chatImage captureSlide5
Technical ContentSlide6
Technical Content
Missing:MathematicsDiagrams, graphsGeometric figuresTechnical knowledge baseDocument markupScientific software connections
(Maple, Mathematica, GeoGebra, R,…)Slide7
Technical Content
Isn’t a shared whiteboard, with the ability to save images enough????Slide8
Technical Content
No!Slide9
The Treachery of Images
(La trahison des images)Slide10Slide11
Einstein’s Blackboard
Einstein to receive honorary doctorate at Oxford, May 1931.Lecture at Rhodes House.Board retrieved and preserved
by Edmund (“Ted”) Bowen.Nice to look at, but content is trapped.Slide12
Digital Ink
Location, time information, sometimes also pressure and angles. Capture online pen strokes, not images.Suitable forRecognition
algorithmsSemantic grouping AnnotationManipulation: search, transformation, archival.Problem: Multiple vendor-specific formats.Slide13Slide14
Pen-Based Math
Input for CAS and document processing.2D editing.Computer-assisted collaboration.Slide15
Pen-Based Math
Different than natural language recognition:2-D layout is a combination of writing and drawing.Many similar few-stroke characters.Many alphabets, used idiosyncratically.Many symbols, each person uses a subset.
No fixed dictionary for disambiguation.Slide16
The ResearchSlide17
The SoftwareSlide18
Prior Generations
2002 Pocket PC:Slide19
Prior Generations
2002-2008 Tablet PC: Slide20
Prior Generations
2008-2013 Java Application: Slide21
InkChat
(Java Version)Skype and GTalk add-on to the Java application.Slide22
Problems
Requires installation:Big hassle for someone to use only once in a while or on all their machines.Limited portability:Users expect versions on Android, iOS, Windows,
Mac OSX, Linux, etc… Incompatible software basesFlakey, moving APIsNeed to support multiple devices.Nowadays a single user will want to work across many devices.Slide23
Solution
Use browser infrastructure.JavaScript is not a great language for large projects, but…..It is ubiquitous: Telephones, tablets, laptops, …Libraries for many UI elements
Our new recognition algorithms are fast enough Rapid development:Prototype developed in 3 months by 3 students.Slide24
Current Generation
Desktop
TelephoneSlide25
Simple Interface
with device-adapted menusSlide26
Ink ControlsSlide27
Collaboration:
Different Viewports from Different DevicesSlide28
Collaboration
Document Annotation
Pointers for DiscussionsSlide29
Embedding in Other EnvironmentsSlide30
Cloud Integration
Save or load files to cloud storageDropBoxGoogle KeepOthers possiblePrevious work to store user profiles
Save cloud of ground-truth labelled symbols(corrected/accepted)Future work to store user-defined brushesSlide31
Application Web SiteSlide32
Application Web
Site: Found ObjectsSlide33
Conclusions
Teaching technical subjects requires new tools.Drawing, mathematics and technical text is required.The treachery of images.Needed:
Math handwriting recognition.Easy geometry and diagrams.Even a little goes a long way….… there is a lot of opportunity for future development.Document mark up.
APIs to scientific software.Slide34
Bruce CharJoseph ChoiMichael Friesen
Oleg GolubitskyRui HuVadim MazalovShirley Miao
Maplesoft
MicrosoftMITACSNSERC
Thanks
Jeliasko
Polihronov
Maya Ramamurthy
Elena
Smirnova
Clare So
Stephen Solis
Coby Viner
James Wake