Patrick Dubois Supervisor Dr Andrea Bunt January 30 th 2017 M Sc Thesis 2 3 4 Contributions 5 Design considerations Model for community enhancements Multisession evaluation 6 7 ID: 545070
Download Presentation The PPT/PDF document "Soliciting Reader Contributions to Softw..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Soliciting Reader Contributions to Software Tutorials
Patrick DuboisSupervisor: Dr. Andrea Bunt
January 30
th
, 2017
M. Sc. Thesis:Slide2
2Slide3
3Slide4
4Slide5
Contributions
5
Design considerations
Model for community enhancements
Multi-session evaluationSlide6
6Slide7
7
Matejka
et al. (2011)
Yoon et al. (2016)
Bunt et al. (2014)Slide8
Questions
How does the interface impact frequency and content of submissions?
8
How can contributions be integrated into tutorials?Slide9
9Slide10
10
Tell me more!
What is this?
Corrections
Questions
OtherSlide11
11Slide12
12
Antorial
Notes instead of comments
Guides contributions via categories
Scopes notes to tutorial steps
Promotes the importance of notesSlide13
Multi-Session Evaluation
13Slide14
Participants & Tasks
Tutorials might be used as course material
14
13 (+1 dropped) expert Photoshop users
Improve tutorials using notesSlide15
15
Antorial
BaselineSlide16
Procedure
16
Meet participant
Questionnaire
QuestionnaireSemi-structured interviewAntorialBaselineSet 1
Set 2
Set 1
Set 2
Antorial
Baseline
Set 1
Set 2
Set 1
Set 2Slide17
Pre-seeded Notes
17
Is there a tool that might make selecting the flowers more efficient?
You can play with the refine edge tool to make the outline smoother.Slide18
Evaluation Results
18Slide19
19
Mean number of notes per participant
Mean number of words per note
p < 0.05
*Error bars represent standard errorSlide20
20Slide21
21
Target Audience
Majority of notes targeted tutorial author
Content always more elaborate when targeting readersSlide22
22
Overall Preference
5 preferred Antorial
5 preferred the baseline
3 were neutralSlide23
23
Antorial Facilitates Specificity
[Antorial] is more specific than [the baseline] […] The [baseline] is just for regular stuff, [Antorial] is much more specific. (P1)Slide24
24
Categories Guide Contributions
[The] icon guided me to make my comments. […] I would go here and say ‘maybe I need to look for something I don't understand, or something to correct. (P3)Slide25
25
Categories can be Restrictive
I knew what my comment was but I really had a hard time figuring out what the category should be. (P11) Slide26
26
Drawbacks of Hidden Notes
More discussion with [the baseline]. It feels more like the commenting section - it feels like you'd have more discussion with the other artists than on [Antorial]. (P9)Slide27
27
Benefits of Hidden Notes
I didn't want to annoy other people and post a lot. So I combined all the things I had to say step by step into one tutorial, by the end of it. (P11)Slide28
28
Design Considerations
Categories can guide contributions, if done well
Layout impacts behaviour
Emphasize learners as audienceSlide29
29
Limitations and Future Work
Few, expert participants
Study procedure may have limited contributions
Generalizing to other formats and domainsSlide30
Contributions
30
Design considerations
Model for community enhancements
Multi-session evaluationSlide31
31
Thanks!