and Brian Noble University of Michigan The Case for Operating System Management of User Attention Trend in mobile app interaction 2 Kyungmin Lee Using apps while performing primary tasks ID: 784734
Download The PPT/PDF document "Kyungmin Lee , Jason Flinn" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Kyungmin Lee, Jason Flinn, and Brian NobleUniversity of Michigan
The Case for Operating System Management of User Attention
Slide2Trend in mobile app interaction2
Kyungmin Lee
Using apps while
performing primary tasks
Apps initiate interactions
Slide3Interaction in various user contexts
3
Kyungmin Lee
User’s current primary activity
Application is unaware of user’s context
!
?
✖
✔
✖
Slide4Existing solution: Let user decide4
Kyungmin Lee
Set policy for each app
Disable all interactions
Too coarse grained! All or nothing
Slide5Our proposed approach5
Kyungmin Lee
Mobile OS
Mobile sensors
Interactions
Deliver now
Modify format
Defer
Extract user’s context
Interactions
Slide6OutlineMotivationOur visionOur proposed approachChallenges
6
Kyungmin Lee
Slide7Our vision7
Kyungmin Lee
Can you pick up milk?
From: Your wife
User’s current context
Interrupt?
Do not interrupt!
Slide8Our vision
8
Kyungmin Lee
Dangerous road conditions ahead
User’s current context
Interrupt! via audio interaction
Interrupt?
Slide9Our vision
9
Kyungmin Lee
Can you pick up milk?
From: Your wife
User’s current context
Interrupt!
Interrupt?
Slide10Manage user attention as a resource10
Kyungmin Lee
Visual Auditory Cognitive Haptic
Attention demand
100%
Visual Auditory Cognitive Haptic
Attention level
100%
Visual Auditory Cognitive Haptic
Attention level
100%
Interaction
User’s activity
<Priority level>
<Priority level>
It’s a scheduling problem!
Slide11Our proposed approachPriorityAttention level
11
Kyungmin Lee
Very
low
Low
Medium
High
Very high
User’s current context
Visual Auditory Cognitive Haptic
Attention level
100%
Slide12Our proposed approach12
Kyungmin Lee
Can you pick up milk?
From:
Y
our wife
Interrupt?
Priority
Attention demand
Attention demand
100%
Visual Auditory Cognitive Haptic
Very
low
Low
Medium
High
Very high
Slide13No delivery!Our proposed approachAttention level after delivery
13
Visual Auditory Cognitive Haptic
Attention level
100%
Can you pick up milk?
From:
Y
our wife
Medium priority
High priority
Slide14Dangerous road conditions aheadOur proposed approachAttention level after delivery
14
Visual Auditory Cognitive Haptic
Attention level
100%
Very high priority
High priority
Slide15Deliver!Dangerous road conditions aheadOur proposed approachAttention level after deliveryChange to audio modality
15
Visual Auditory Cognitive Haptic
Attention level
100%
Very high priority
High priority
Slide16Deliver!Our proposed approachAttention level after deliveryCognitive attn. load has dropped
16
Visual Auditory Cognitive Haptic
Attention level
100%
Can you pick up milk?
From:
Y
our wife
Medium priority
High priority
Slide17High priorityChallenges in determining priority
17
Kyungmin Lee
Med. priority
From:
A
colleague
Friend’s request
High priority
From:
A
colleague
Low priority
Friend’s request
Slide18Learn from user’s behavior18
Kyungmin Lee
High priority
Low priority
Slide19Interaction’s attention demandExtend AMC (Mobisys ‘13)
19
Kyungmin Lee
Button size
✔
Button closeness
✔
Text contrast ratio
✔
Word count
✖
Animation
✔
Scrolling
✔
Slide20Interaction’s attention demandExtend AMC (Mobisys ‘13)
20
Kyungmin Lee
Visual Auditory Cognitive
A
ttention demand
Demand level
Slide21Estimating user’s attention level
21
Kyungmin Lee
Visual Auditory Cognitive Haptic
Attention level
100%
Very high priority
Low priority
Lowly engaged activity
Highly engaged activity
Same activity, but different priority level
Slide22ConclusionOur vision: Right interaction at the right timeOur proposed approachTreat user attention as a shared resourceDetermine priorities of interaction and activityConsider Attention level supply vs. demand
22
Kyungmin Lee
Slide2323
Questions?
Kyungmin Lee