Teaching the Cat to Obey a Bird Ramaraju Rudraraju Srinivasa Datla Avishek Banerjee Mandar Sudame Univ of Alabama at Birmingham Department of Computer and Information Sciences Jeff Gray ID: 492306
Download Presentation The PPT/PDF document "Programming by Voice with Scratch:" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Programming by Voice with Scratch:Teaching the Cat to Obey a Bird
Ramaraju Rudraraju, Srinivasa Datla, Avishek Banerjee, Mandar Sudame Univ. of Alabama at Birmingham, Department of Computer and Information SciencesJeff Gray University of Alabama, Department of Computer ScienceGary Edwards United Cerebral Palsy of Greater Birmingham
This research sponsored by
a Google Research AwardSlide2
Overview of Presentation
Scratch Script Video
Motivation
Architecture & Working of Myna
Dynamic Grammars
Myna FeaturesSlide3
Scratch Script Get your popcorn, its Movie Time!!Slide4
The WIMP Metaphor Motivation
Window
Menu
Icons
Pointing DeviceSlide5
Motivation
The WIMP assumes dexterityThe MYNA Solution for ScratchSlide6
Drag and Drop NavigationContinuous NavigationNavigation using Transparent Frames
FeaturesTypes of NavigationSlide7
Features (An extension of Transparent Frames)
Drop AfterDrop InDrop Before7Macro CommandsSlide8
Myna Architecture
ComponentMappingsSprite State StorageComponent Hierarchy
Scratch UI
Transparent Frames
Speech Recognizer
Command Executor
Grammar
Java Robot
MYNA
Model
View
Controller
Cloud GardenSlide9
Grammar
Speech RecognizerUnder the Hood of MynaSpeech RecognizerGrammar
Command Executor
Mappings
Mappings
Move Right
Controller
Model
Command Executor
Java Robot
Java Robot
Component
Hierarchy
Component
HierarchySlide10
Dynamic Grammar
Default GrammarNavigation GrammarSpeech Pause GrammarFile Grammar
File Grammar
Control Grammar
Looks Grammar
Default Grammar
Navigation Grammar
File
Pause
ResumeSlide11
LimitationsScratch needs to be in maximized modeNot compatible with different screen resolutionsMyna is not scroll-enabled
Large vocabulary and still growing!Future WorkIntegration with UCP - Deep human subjects testing with United Cerebral Palsy of Greater BirminghamPortability on other platformsConfigurable screen resolutionsLooking AheadSlide12
Myna is our preliminary attempt towards voice-driven programming applied to Initial Learning Environments (ILEs) to overcome the physical challenges of using the traditional WIMP metaphorOur long-term goal is to assist children with disabilities by giving them a learning tool that enables them to encounter the joys and excitement of programming, while also improving their logic skills
SummarySlide13
Thank youQuestions and comments?Additional questions?teammyna@googlegroups.com
https://sites.google.com/site/projectmyna2010/