DoD Department of the Army or DLIFLC Assessing Oral Proficiency and Grammatical Errors Secondary Analysis of DA Interview Data SunKwang Bae Curriculum Development Division DLIFLC ID: 544179
Download Presentation The PPT/PDF document "This speech/presentation is authorized b..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
This speech/presentation is authorized by the Defense Language Institute Foreign Language Center and the Department of Defense. Contents of this presentation are not necessarily the official views of, or endorsed by, the U.S. Government, DoD, Department of the Army, or DLIFLC.
Assessing Oral Proficiency and Grammatical Errors: Secondary Analysis of DA Interview Data
Sun-Kwang
Bae, Curriculum
Development
Division, DLIFLC
David Moon, Technology Integration Division, DLIFLCSlide2
The Study QuestionBackgroundThe StudyResultsDiscussionsQ & APresentation Outline
2Slide3
What are the grammar structures/features that learners of Korean typically control at a given level of oral proficiency? [From the perspective of teaching & learning - 김지민 (2009);
Corder (1981)] The Study Question
3Slide4
Level 1Able to ask and answer simple questions related to everyday survival needsAble to satisfy minimum courtesy requirementsAble to deal with routine everyday situationsAble to talk simply about self
Tasks that learners can handle at each level – ILR L14Slide5
Level 2Able to satisfy routine social demands and limited work requirementsAble to narrate and describe in all three time framesAble to give detailed instructions/directionsAble to participate in conversations on current events as well as give detailed information about work, family and self
Tasks that learners can handle at each level – ILR L25Slide6
Level 3Able to participate in most formal and informal conversations on practical, social and professional topicsAble to support opinion in the FLO content areasAble to hypothesizeAble to discuss concrete and abstract topicsAble to discuss topics of particular interestAble to deal with unfamiliar situations
Tasks that learners can handle at each level – ILR L36Slide7
Level 1Structural accuracy is random or severely limitedAlmost every utterance has errors in basic structuresTime concepts are vagueCan formulate some questions
Structural control that learners are to have at each level – ILR L17Slide8
Level 2Discourse is minimally cohesiveGrammatical structures are usually not very elaborate and not thoroughly controlledErrors are frequentSimple structure and basic grammatical relations are typically controlled
Structural control that learners are to have at each level – ILR L28Slide9
Level 3Effectively combines structure and vocabulary to convey meaningDiscourse is cohesiveUse of structural devices is flexible and elaborateErrors occur in low frequency and highly complex structures, but structural inaccuracy rarely causes misunderstanding
Structural control that learners are to have at each level – ILR L39Slide10
Data CollectionFace-to-face diagnostic oral assessment interviews conducted by a pair of specialists (David Moon, EM, AS, JY, YR, NT)During June 1999 – September 200055 students: L0+ (1), L1 (15), L1+ (18), L2 (14), L2+ (6), L3 (1) The tool: Sample
The study: data collection10Slide11
Structural FeaturesSentence patterns: Plain, Honorific, QuotationVerb conjugations: Irregular, SpecialComplex constructions: Passive, Attributive, NegationParticles: Case, Locative, Instrumental, AuxiliaryCardinal/Ordinal Number: Native, Sino-Korean agreementPronouns: Personal, Things, PlacesConjunctions: Basic, Advanced, Conjunctive Fillers
The study: structural features examined11Slide12
The result: sentence patterns
L1(N=15)L1+(N=18)L2(N=14)L2+
(N=6)
Plain: Present
73/26/0
78/22/0
100/0/0
100/0/0
Plain: Past
47/53/0
61/39/0
100/0/0
100/0/0
Honorific: Present
13/83/0
17/83/0
29/71/0
100/0/0
Honorific: Past
0/100/0
6/86/6
21/ 72/7
100/0/0
Negation:
Statement
& Question
40/53/7
56/44/0
93/7/0
100/0/0
Negation:
Request
& Suggestion
13/20/67
28/43/3950/0/50100/0/0
Note: The figures are percentages “Satisfactory/Need Work/Not Applicable.”
12Slide13
The result: verb conjugations & complex structures
L1(N=15)L1+(N=18)L2(N=14)L2+
(N=6)
Irregular
verbs
27/66/7
33/67/0
57/43/0
100/0/0
Special
verbs
31/69/0
(N=13)
38/62/0
(N=16)
83/17/0
(N=12)
100/0/0
(N=5)
Passive and causative
0/
27/73
0/
56/44
21/29
/50
67/0/33
Attributive
7/93/0
33/67/0
79/21/0
83/17/0
Note: The figures are percentages “Satisfactory/Need Work/Not Applicable.”
13Slide14
The result: quotationL1
(N=15)L1+(N=18)L2(N=14)L2+
(N=6)
Quotation
: statement and question
6/38/56
22/67/11
42/44
/14
100/0/0
Quotation:
request and suggestion
0/33/67
6/38/56
7/21/72
83/0/17
Note: The figures are percentages “Satisfactory/Need Work/Not Applicable.”
14Slide15
The result: markers/particlesL1
(N=15)L1+(N=18)L2(N=14)L2+
(N=6)
Subject/Object Case
33/67/0
56/44/0
71/29/0
100/0/0
Dative/Locative
20/80/0
50/50/0
71/29/0
100/0/0
Instrumental
18/73/9
(N=11)
30/60/10
(N=10)
67/33/0
(N=12)
100/0/0
(N=5)
Auxiliary
0/100/0
28/72/0
71/29/0
100/0/0
Note: The figures are percentages “Satisfactory/Need Work/Not Applicable.”
15Slide16
The result: numbers + countersL1
(N=15)L1+(N=18)L2(N=14)L2+
(N=6)
Cardinal: Native
Korean
33/67/0
44/56/0
71/29/0
100/0/0
Cardinal: Sino-Korean
40/60/0
33/56/11
71/29/0
100/0/0
Ordinal: Native Korean
7/47/46
22/56/22
36/21
/43
83/0
/17
Ordinal: Sino-Korean
7/40/53
16/34/50
0/14/86
83/0
/17
Note: The figures are percentages “Satisfactory/Need Work/Not Applicable.”
16Slide17
The result: pronounsL1
(N=15)L1+(N=18)L2(N=14)L2+
(N=6)
Personal
53/34/13
89/11/0
93/7/0
100/0/0
Demonstrative: Things
13/54/33
72/17/11
93/7/0
100/0/0
Demonstrative: Places
26/61/13
67/22/11
100/0/0
100/0/0
Note: The figures are percentages “Satisfactory/Need Work/Not Applicable.”
17Slide18
The result: conjunctionsL1
(N=15)L1+(N=18)L2(N=14)L2+
(N=6)
Basic conjunctive endings
40/60/0
56/44/0
86/14/0
100/0/0
Advanced conjunctive
endings
0/80/20
6/83/11
0/86/14
17/83/0
Conjunctives/ Conversational Fillers
0/100/0
41/59/0
(N=17)
64/36/0
100/0/0
Note: The figures are percentages “Satisfactory/Need Work/Not Applicable.”
18Slide19
The result: discourse skillsL1
(N=15)L1+(N=17)L2(N=14)L2+
(N=6)
Repair
7/93/0
35/65/0
79/21/0
100/0/0
Vocabulary choice with precision
0/100/0
0/100/0
21/79/0
50/50/0
Negotiate
meaning
27/63/0
29/71/0
85/15/0
100/0/0
Paraphrase
and restate
7/93/0
29/71/0
21/79/0
100/0/0
Note: The figures are percentages “Satisfactory/Need Work/Not Applicable.”
19Slide20
Level 1Personal pronounsPresent tenseLevel 1+Past tenseNegation (in statements & questions)Case markers (subject, object, dative, locative)
Demonstrative pronouns (things & places)Basic conjunctive endings Discussions: grammar features that learners begin to control at L1 & L1+
20Slide21
Level 2Negation in requests and suggestionsIrregular verbs and special verbsAttributive formsInstrumental and auxiliary particlesNumbers and their agreement with countersConjunctives and conversational fillers
Repair strategy in discourse Negotiate meaning in discourseDiscussions: grammar features that learners begin to control at L2
21Slide22
Level 2+HonorificsPassive and causativeQuotationsPrecise lexical selectionParaphrase and restateThe features that learners can’t control by L2+:
Advanced conjunctive endingsDiscussions: grammar features that learners begin to control at L2+
22Slide23
Q & AImplications & Applications
23Slide24
Contact InformationOnline Diagnostic Assessment for reading and listening skills:
http://oda.dliflc.eduContact: sunkwang.bae@dliflc.edu24