Jaime Teevan with M R Morris D J Liebling K Panovich J Yang L Adamic M Ackerman B Hecht D Gergle What should I talk about at dub Questions About Questions What questions do people ask their social network ID: 638931
Download Presentation The PPT/PDF document "Social Question Asking Does Anyone Want ..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Social Question AskingDoes Anyone Want to Learn How to Get Questions Answered?
Jaime Teevanwith M. R. Morris, D. J. Liebling, K. Panovich, J. Yang, L. Adamic, M. Ackerman, B. Hecht, D. GergleSlide2
?
What should I talk about at dub?Slide3Slide4Slide5Slide6
Questions About Questions
What questions do people ask their social network?What type of questions do people ask? About what?Which questions get answered?How can someone ask an effective question?Why do people ask questions of their network?
What motivates question asking and answering?
Why would someone ask versus search?
How can tools help find the best answers?Slide7
What type of questions are asked about what?Which questions get answered?How can someone ask an effective question?
What Question Do People Ask?Slide8
What Questions Do People Ask?
What type of questions are asked about what?Slide9
Have you used a status message to ask a question?Frequency of asking, question types, responses received, why?Provide an example
Have you answered a status message question?Why or why not?Provide an exampleParticipants: 624 Microsoft employeesFollow-up: 933 from four cultures (US, UK, China, India)
Survey of Status Message AskingSlide10
Overview of Asking and AnsweringAsking status message questions
Half of participants reported asking questionsAnswering status message questions3 out of 4 participants had seen a questionAlmost all who had also answered questionsCultural variation in overall behavior
China and India asked and answered more questions
Questions seen as more important than in US and UKSlide11
Consistencies in Question WordingQuestions short (75 characters, 1 sentence)
18.5% of phrased as a statementI need a recommendation on a good all purpose pair of sandals.Often scoped1 out of 5 directed to “anyone”
Anyone know of a good Windows 6 mobile phone that won’t break the bank?
Network subset
Hey Seattle
tweeps: Feel like karaoke on the Eastside tonight?Slide12
Social Network Question Topics
Topic
%
Example
Technology
29%
Anyone know if WOW works on Windows 7?
Entertainment
17%
Was seeing Up in the theater worth the money?
Home &
Family
12%
So what’s the going rate for the tooth fairy?
Professional
11%
Which university is better for Masters? Cornell or Georgia Tech?
Places
8%
Planning
a trip to Whistler in the off-season. Recommendation on sites to see?
Restaurants
6%
Hanging in Ballard tonight. Dinner
recs
?
Current events
5%
What is your opinion on the recent proposition that was passed in California?
Shopping
5%
What’s a good Mother’s Day gift?
Philosophy
2%
What would you do if you had a week to live?
Missing: Health and Pornography
Religion, Politics, Dating, FinanceSlide13
Social Network Question Types
Type%
Example
Recommendation
29%
Building a new playlist – any ideas for good running songs?
Opinion
22%
I am wondering if I should
buy the Kitchen-Aid ice cream maker?
Factual
17%
Anyone know a way to put Excel charts into
LaTeX
?
Rhetorical
14%
Why are men so stupid?
Invitation
9%
Who wants to go to
Navya
Lounge this evening?
Favor
4%
Need a babysitter in a big way tonight… anyone??
Social connection
3%
I
am hiring in my team. Do you know anyone who would be interested?
Offer
1%
Could any of my friends use boys size 4 jeans?Slide14
Questions Vary by Who Is Asking
Type
Recommendation
Opinion
Factual
Rhetorical
Invitation
Favor
Social connection
Offer
Topic
Technology
Entertainment
Home &
Family
Professional
Places
Restaurants
Current events
Shopping
Philosophy
men
women
old
young
Twitter
FacebookSlide15
Asking used more seriously by Asian cultures v. Western cultures
Questions Vary by Who Is Asking
Type
Recommendation
Opinion
Factual
Rhetorical
Invitation
Favor
Social connection
Offer
Topic
Technology
Entertainment
Home &
Family
Professional
Places
Restaurants
Current events
Shopping
PhilosophySlide16
Types and Topics of Questions?
Subjective questions on acceptable topicsPopular topics: Technology, entertainment, familyPopular types: Recommendations, opinionsQuestions vary by demographics and cultureWhich questions get answered?Slide17
Questions Get Good AnswersQuantity: 94
% of questions answeredQuality: 69% of responses helpfulSpeed: 90% within a day (24% within 30 minutes)People expected faster responses But were satisfied
with
speed
Answer quality varies with phrasing
Shorter questions get more useful responsesSlide18
Answer Quality Varies by Question
TypeRecommendation
Opinion
Factual
Rhetorical
Invitation
Favor
Social connection
Offer
Topic
Technology
Entertainment
Home &
Family
Professional
Places
Restaurants
Current events
Shopping
Philosophy
Unhelpful
No correlation
FasterSlide19
Which Questions Get
Answered?Subjective questions on acceptable topics
Popular topics: Technology, entertainment, family
Popular types: Recommendations, opinions
Questions vary by demographics and culture
Questions get many high quality
answers quicklyCorrelated with phrasingCorrelated with topic and typeHow can someone ask an effective question?Slide20
Controlled Study of Effective AskingControlled experiment
Many people ask the same questionCompare responsesNeed generic questionTopic: EntertainmentType: Opinion
Should I watch E.T.?Slide21
Controlled Variables
Question
Statement
1 Sentence
Should I watch E. T.?
I wonder if I should watch E.T.
2
S
entences
Taking it easy. Should I watch E.T.?
Taking it easy. I wonder if I should watch E.T.
Who
posted the question
Demographics
Social network use and makeup
Profile picture
Time of day
Question phrasing
Length
Punctuation
ScopingSlide22
Question
Statement
1 Sentence
Should I watch E. T.?
I wonder if I should watch E.T.
2
S
entences
Taking it easy. Should I watch E.T.?
Taking it easy. I wonder if I should watch E.T.
Controlled Variables
Who
posted the question
Demographics
Social network use and makeup
Profile picture
Time of day
Question phrasing
Length
PunctuationScoping
Question
Statement
1 Sentence
Does
anyone
think I s
hould watch E. T.?
I wonder if
anyone
thinks I should watch E.T.
2
S
entences
Taking it easy. Does
anyone
think I should watch E.T.?
Taking it easy. I wonder if
anyone
thinks I should watch E.T.
ScopeSlide23
Measuring the ResponsesQuantity% with responses
# of responsesQuality% answered, usefulResponse lengthSpeedTime to first response
Count
Quantity
Quality
Speed
% with
response
#
of
responses
% answered
%
useful
Response length
Time to first response
Overall
282
82%
3.2
59%
72%
56
1:27Slide24
Who Posted the QuestionGenerally saw few significant differences
Larger social networks give better answersMore social profile picture get better answersClose shotAnother person
Count
Quantity
Quality
Speed
% with
response
#
of
responses
% answered
%
useful
Response length
Time to first response
≤ 200
133
75%
2.6
50%
63%
54.9
2:15
201+
148
89%
3.7
66%
80%
56.9
0:52Slide25
Afternoon questionsReceive more answers faster
Morning questionsReceive longer responses
Count
Quantity
Quality
Speed
% with
response
#
of
responses
% answered
%
useful
Response length
Time to first response
Morning
138
84%
2.8
52%
74%
61.9
1:50
Afternoon
143
80%
3.6
65%
70%
49.8
1:05
Time of DaySlide26
Count
Quantity
Quality
Speed
% with
response
#
of
responses
% answered
%
useful
Response length
Time to first response
1 sentence
153
88%
3.7
73%
80%
55.2
1:08
2 sentences
129
75%
2.5
43%
62%
56.0
1:55
Count
Quantity
Quality
Speed
% with
response
#
of
responses
% answered
%
useful
Response length
Time to first response
Question
143
81%
3.4
64%
80%
56.9
1:25
Statement
139
76%
3.0
54%
63%
54.0
1:30
Phrasing
Length
1 sentence gets more high quality responses faster
Punctuation
Question get more (useful) responses than statements
Scope
Scoping the question helps – even if just “anyone”
Count
Quantity
Quality
Speed
% with
response
#
of
responses
% answered
%
useful
Response length
Time to first response
None
89
78%
2.6
54%
63%
43.8
1:37
Anyone
95
83%
3.2
61%
74%
57.7
1:20
Movie
buff
98
86%
3.7
61%
79%
63.3
1:27Slide27
How Can Someone Ask
Effectively?Subjective questions on acceptable topics
Popular topics: Technology, entertainment, family
Popular types: Recommendations, opinions
Questions vary by demographics and culture
Questions get many high quality
answers quickly
Correlated with phrasing
Correlated with topic and type
Can influence responses by how a question is asked
Ask short questions
of “anyone
” in
the afternoonSlide28
What Questions Do People Ask?
Subjective questions on acceptable topicsPopular topics: Technology, entertainment, familyPopular types: Recommendations, opinionsQuestions vary by demographics and cultureQuestions get many high quality answers quickly
Correlated with phrasing
Correlated with topic and type
Can influence responses by how a question is asked
Ask short questions
of “anyone” in the afternoonSlide29
What motivates question asking and answering?Why would someone ask versus search?How can tools help find the best answers?
Why Do People Ask Questions?Slide30
Why Do People Ask Questions?
What motivates question asking and answering?Slide31
Motivations for Asking
Motive%
Example
Trust
24.8%
I trust my friends more than I trust strangers.
Subjective
21.5%
Search engine can provide data
but
not an opinion.
Thinks search would fail
15.2%
I’m pretty search engine couldn’t answer a question of that nature.
Audience
14.9%
Friends with kids, first hand real experience.
Connect
12.4%
I wanted my friends to know I was asking the question.
Speed
6.6%
Quick response time, no formalities.
Context
5.4%
Friends know my tastes.
Tried search
5.4%
I tried searching and didn’t get good results.
Easy
5.4%
Didn’t want to look through multiple search results.
Quality
4.1%
Human-vetted
responses.Slide32
Motivations for Answering
Motive%
Example
Altruism
37.0
Just trying to be helpful.
Expertise
31.9
If I’m an
expert in the area.
Question
15.4
Interest in the topic.
Relationship
13.7
If I know and like the person.
Connect
13.5
Keeps my network alive.
Free time
12.3
Boredom/procrastination.
Social capital
10.5
I will get help when I need it myself.
Obligation
5.4
A tit-for-tat.
Humor
3.7
I might have a witty response.
Ego
3.4
Wish to seem knowledgeable.Slide33
Motivations for Answering
Motive%
Example
Altruism
37.0
Just trying to be helpful.
Expertise
31.9
If I’m an
expert in the area.
Question
15.4
Interest in the topic.
Relationship
13.7
If I know and like the person.
Connect
13.5
Keeps my network alive.
Free time
12.3
Boredom/procrastination.
Social capital
10.5
I will get help when I need it myself.
Obligation
5.4
A tit-for-tat.
Humor
3.7
I might have a witty response.
Ego
3.4
Wish to seem knowledgeable.
Motives for Not Answering
- Don’t know the answer
- Don’t have time or interest
- Don’t know the askerSlide34
Why Do People Ask Questions?
People motivated by trust and altruismSearch often considered or triedCultural differences: Entertainment v. social capitalWhy would someone ask versus search?Slide35
Information Need: Backsplash Re-Tiling
“Any tips for tiling a kitchen backsplash?”
kitchen re-tiling tips
backsplash re-tiling
kitchen remodel
diy
Study of Searching v. AskingSlide36
Task (as expressed to the social network)
Is now looking for a new phone to get… Any suggestions???
any tips for tiling a kitchen backsplash?
Anyone know how to stop an in-car nav system from constantly rebooting???? Ugggggh
Does anyone know how to train for half marathon? Links…training…diet to follow would be great!
Lauren's going away for a month, anyone know any good vegetarian recipes?
So…after getting the PMP, what else is anyone doing to keep up their development?
should I wait for
ZuneHD
or buy
Ipod
touch (to gift someone)?
is wanting to move away from Live Space for storing and sharing pictures… Any recommendations?
Can one defeat Seattle winter with a trip to New Zealand? Does anybody have the beta on bouldering there?
is looking for recommendations (restaurants and activities) in Cancun
is starting to plan my Thanksgiving trip to Disneyland…what are the must see attractions, especially for a 3-year that loves princesses? Any websites out there for planning other than disneyland.com?
Does anyone have any recommendations on a good medium to high end TV?Slide37
How People Searched v. Asked
Task
Time spent searching
Time to first response
Responses pre-search
Total responses
Phone Shopping
38
15
3
20
Re-Tile Kitchen
29
8
3
7
Fix Car GPS
46
19
2
2
Half Marathon Training Tips
21
0
0
Vegetarian Recipes
36
36
1
10
Career
Development Advice
14
1519
0
2
Compare Zune and iPod Touch
32
7
1
3
Photo Storage Service
12
184
0
5
Bouldering in New Zealand
31
77
0
5
Cancun Vacation
49
5
2
2
Disneyland Vacation
22
8
5
10
TV Shopping
34
0
0
On average, searchers
Spent 30 minutes
Issued 6.5 queries
Visited 35.4 pagesSlide38
Different Benefits for Each Approach
Benefits of searchingReceived answers very quicklyCould refine their query as they learned moreFound content considered
objective and unbiased
Benefits of asking
Auxiliary social benefits
(awareness, connections
)Answers highly personalizedReceived answers not encountered through searchAnswers encountered through validatedSlide39
Why Ask v. Search?
People motivated by trust and altruismSearch often considered or triedCultural differences: Entertainment v. social capitalSearching and asking provide different benefits
Searching is fast and can be refined
Asking creates social connections, finds the unexpected
How can tools help find the best answers
?Slide40
Socially Embedded Search Engine
How do people respond to search engines in their social spaces?Slide41
Hard Problems to OvercomeNot always appropriate to respond
Most status messages are for social discussionQuestions can be rhetoricalCan poop qualify as a character in a book?Coming up with a relevant answer is hardRelevance not the only factor to consider
Social conformance also matters
Your friends comments reflect on you
Mentioning others can feel invasiveSlide42
New OpportunitiesExtend existing search algorithms
Lots of context availableAnswers do not need to be found immediatelyInteresting feedback mechanismsHumor and serendipity can outweigh relevanceLink to the children’s book Everybody Poops Opportunity to shape the dialog
Ask follow-up questions
Influence friends responsesSlide43
How Can Tools Help Answer?
People motivated by trust and altruismSearch often considered or triedCultural differences: Entertainment v. social capital
Searching
and asking provide different benefits
Searching is fast and can be refined
Asking creates social connections, finds the unexpected
Get both with algorithmic content in a social setting
Social conformance important, can be collected in new ways
Opportunity to influence friends responsesSlide44
Answers About Questions
What questions do people ask their social network?People ask subjective questions on acceptable topicsQuestions get many high quality answers quicklyCan influence answers by how a question is askedWhy do people ask questions of their network?
People motivated by trust and altruism
Searching and asking provide different benefits
Get both with algorithmic responses in a social settingSlide45
M. R. Morris, J. Teevan, and K. Panovich. What Do People Ask Their Social Networks, and Why? A Survey Study of Status Message Q&A Behavior.
In Proceedings of CHI 2010.J. Yang, M. R. Morris, J. Teevan, L. Adamic, and M. Ackerman. Culture Matters: A Survey Study of Social Q&A Behavior. In Proceedings of ICWSM 2011.J. Teevan, M. R. Morris, and K. Panovich. Factors Affecting Response Quantity, Quality and Speed in Questions Asked via Online Social Networks.
In Proceedings of ICWSM 2011.
M. R. Morris, J. Teevan, and K.
Panovich
.
A Comparison of Information Seeking Using Search Engines and Social Networks. In Proceedings of ICWSM 2011.Questions?