/
Analysis of the 2016 National Senior Certificate  Quality Assurance of Assessment Analysis of the 2016 National Senior Certificate  Quality Assurance of Assessment

Analysis of the 2016 National Senior Certificate Quality Assurance of Assessment - PowerPoint Presentation

tawny-fly
tawny-fly . @tawny-fly
Follow
374 views
Uploaded On 2018-02-16

Analysis of the 2016 National Senior Certificate Quality Assurance of Assessment - PPT Presentation

in the public and private assessment bodies Dr MS Rakometsi CEO Mandate Section17 of the GENFETQA Act 5 The Council must with the concurrence of the DirectorGeneral and after consultation with the relevant assessment body or education institution approve the publication of the results o ID: 631964

paper question assessment moderation question paper moderation assessment marking candidates areas tasks learners poor performance sba questions papers poorly

Share:

Link:

Embed:

Download Presentation from below link

Download Presentation The PPT/PDF document "Analysis of the 2016 National Senior Cer..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.


Presentation Transcript

Slide1

Analysis of the 2016 National Senior Certificate Quality Assurance of Assessment in the public and private assessment bodies

Dr MS Rakometsi

CEOSlide2

MandateSection17 of the GENFETQA Act

(5)

The Council must, with the concurrence of the Director-General and after consultation with the relevant assessment body or education institution, approve the publication of the results of learners if the Council is satisfied that the assessment body or education institution has—

(i) conducted the assessment free from any irregularity that may

jeopardise

the integrity of the assessment or its outcomes;

(ii) complied with the requirements prescribed by the Council for

conducting assessments;

(iii) applied the standards prescribed by the Council which a learner is required to comply with in order to obtain a certificate; and

(iv) complied with every other condition determined by the Council.Slide3

Regulatory Framework

Quality Assurance of Assessment

NQF Act Section 27 (h)

The QC must develop and implement policy and criteria for assessment for the qualifications on its sub-framework.Slide4

Framework for Quality Assurance of AssessmentEvaluation

and /or accreditation of assessment bodies;

Periodic inspection of assessment systems;

Ongoing monitoring of assessment systems;

Quality assurance of external examinations through:

Moderation of examination question papers, PATs and CATs (Life Orientation)

Monitoring and moderation of SBA

Monitoring of the conduct, administration and management of assessment and examination processes

Moderation of marking

Management of concessions and examination irregularities

Standardisation

of assessment outcomesSlide5

Quality Assurance of the Department of Basic EducationSlide6

Overview 1. Feedback on Quality Assurance of Assessment Processes in the public and private assessment bodiesModeration of question papers

Moderation

of school based

assessment

Statistical

moderation of SBA marks

Marker selection and training

Verification

of marking

2. Areas of poor performance in gateway subjects (verification of marking findings)

3. Tracking directives for complianceSlide7

Question Paper ModerationIn 2016 Umalusi moderated 133 NSC question papers and the following was noted:Areas of Good Practice

Percentage of QP’s approved at first moderation improved from 11,5% Nov 2015 to 22,6% Nov 2016. Details are provided in the table below:

 

Number of moderations

November 2015

November 2016

One

11,5%

22,6%

Two

67,7%

68,4%

Three

17,7%

8,3%

Four

2,3%

0.8%

Five

0,8%

0%Slide8

Question Paper ModerationAreas of Good PracticeDBE examiners and internal moderators are commended for achieving acceptable standards in the setting of the examination question papers in the following subjects:

QP’s approved at first moderation

CAT P1

Design P2

H.

Studies

IsiNdebele FAL

P2

Mech

Tech

Setswana FAL P2

CAT P1

Dramatic Arts

IsiNdeb

ele HL P2

IsiNdebele FAL

P3

P. Sciences P2

Tshivenda SAL P2

CAT P1

Elec Tech

IsiNdebele SAL P1

IsiZulu FAL

P2

Sesotho FAL P3

Visual Arts P1

Dance

EGD P1

IsiNdebele SAL P2

IsiZulu FAL

P3

Sesotho SAL P1

Visual Arts P2

Design P1

EGD P2

IsiNdebele FAL

P1

IsiZulu SAL

P2

Sesotho SAL P2

Xitsonga SAL P2Slide9

Question Paper ModerationAreas of weaknessesThe failure by both examiners and internal moderators to address recurrent non-compliance that led to some papers requiring more than two moderations (9%). The twelve (12) question papers concerned are:

There is still some inconsistency in how examiners and internal moderators interpret higher order cognitive skills

.

Lack of approved textbooks in Music poses a challenge to both examiners and candidates, especially with content based on Jazz and indigenous music.

Three moderation

sessions

Afrikaans FAL P2; Afrikaans HL P1, P2 and P3; IsiXhosa SAL P1; Life Sciences P1 and P2; Mathematical Literacy P1 and P2; and Sesotho FA P1 and P2

Four moderation sessions

Geography P1 Slide10

Question Paper ModerationRecommendations for ImprovementAddress the conduct of those examiners and internal moderators whose papers failed to repeatedly adhere to the requirements for compliance, which resulted in their papers requiring more than two external moderations;

Develop strategies to improve the examiners and internal moderators’ abilities to identify and set higher order questions, and balance the distribution of the cognitive levels within question papers

 Slide11

Scope of SBA Moderation

Subjects

verified in

July/August 2016

Subjects

verified in

October 2016

Accounting

Agricultural Sciences

Business Studies

Civil Technology

Computer Applications Technology

Consumer Studies

Dramatic ArtsEconomicsEnglish FALGeography

Information Technology

Life Sciences

Mathematics

Mechanical Technology

Physical Sciences

Accounting

Agricultural Management Practice

Dramatic Arts

Economics

English FAL

History

Life Sciences

Mathematics

TourismSlide12

SBA Moderation

Areas of good practice

Adequate content coverage in most subjects verified.

Many teachers' files and evidence of learner performance (ELP) were well presented, neat, dated,

organized

and indexed – this made moderation relatively

manageable.

Evidence of internal moderation observed in most of the teacher and learner files.

Use of common tasks for capacity building and promoting equivalence of standards

.Slide13

SBA Moderation

Areas of weaknesses

Poor handling of irregularities committed during the conduct of SBA. High prevalence of mass copying in most SBA tasks is identified across subjects and provinces, however, very little is done to combat this act of dishonesty.

Absence of or ineffective School Assessment Irregularity Committees (SAICS) across provinces.

Lack of internal moderation for SBA tasks at all levels in most of the schools sampled.

The availability of supplies, equipment and tools is a challenge for subjects with a practical component like Consumer Studies and Hospitality Studies.Slide14

SBA Moderation

Areas of weaknesses

Failure to provide analysis grids in some teachers’

files indicating

the spread and balance of content and cognitive skills required by each task.

The

use of textbooks, recycled DBE question papers and exemplars without adjustment compromises the fairness and reliability of assessment tasks. (Highlighted

in 2015, however this

practice is still continuing)

Poorly

developed practical tasks for Physical Sciences and Life Sciences that fail to address the purpose of developing proper scientific practical skills.

In some schools tasks that do not qualify as practical tasks are at times administered.Slide15

SBA Moderation Recommendations for Improvement

Irregularities committed during the conduct of SBA need to be recorded, reported and followed up by provincial departments.

The DBE needs to ensure that

SAICs

are established at

schools

and that they function effectively to deal with irregularities committed during the implementation of SBA.

The DBE needs to ensure that a joint workshop on

development and moderation

of

assessment tasks

is conducted for curriculum staff at all districts across the provinces.

The DBE needs to ensure that all the schools offering subjects with a practical component have adequate supply of

resources, equipment and infrastructure.The curriculum directorate needs to ensure that the completion and submission of assessment grids is made compulsory for all SBA tasks across subjects. Slide16

SBA Moderation

Recommendations for Improvement

Educators need to be trained on how to develop quality assessment tasks and to be able to use previous question papers innovatively without opening up the question papers to a high level of

predictability

Schools

must be encouraged to use common practical assessment tasks developed by District offices.

Educators

must also be trained on the development of quality practical assessment tasks for Physical Sciences and Life Sciences.Slide17

Statistical moderation of SBA (Umalusi directives)SBA means/averages

that

are:

Between 5-10% above the adjusted examination

mean/average

is accepted as

is

(assessment of teachers is acceptable)

Less than 5% above the adjusted examination

mean/average

is brought up to 5% above the adjusted examination

mean/average

(assessment of teachers too strict)

More than 15% above the adjusted examination mean/average is brought down to 5% above the adjusted mean/average (assessment of teachers is inflated)Between 11% and 15% above the adjusted mean of the examination mark the marks are scaled down as follows - 11% scaled down to 9% (loss of 2%) - 12% scaled down to 8% (loss of 4%) - 13% scaled down to 7% (loss of 6%)

- 14%

scaled down to

5% (loss of 9%)

- 15%

scaled down to

5% (loss of 10%)Slide18

National: Schools with an SBA mean/average that is 15% and more above the adjusted examination mean/ average

Subject

No. of schools

Subject

No. of schools

Subject

No. of schools

Accounting

832

Economics

533

isiXhosa HL

5

Afrikaans SAL3Electrical Tech5isiZulu HL25

Agric. Science

1 043

EGD

71

Life Sciences

195

Agric. Tech

1

English FAL

54

Maths Lit

225

Civil Tech

22

English HL

56

Mathematics

1

618

CAT

83

Geography

859

Physical

Sciences

1

586

Consumer

Studies

47

History

430

Religion Studies

21

Design

1

Hospitality Studies

4

Sesotho FAL

2

Dramatic Arts

8

Information

Technology

20

Setswana HL

Tourism

Visual Arts

4

19

9 Slide19

Issues that can contribute to inflated SBA marksPoor standard and quality of school based

assessment.

Poor

marking and application of

rubrics.

Inability to distinguish between satisfactory, good and excellent learner

responses.

Shadow marking instead of actual

moderation.

Little and / or undirected feedback:

- Curriculum

Advisor to teacher / school

- Head

of department to the teacher - Teacher to the learners Ineffective moderation systems.Inadequate moderation of assessment tasks and feedback on the development of assessment tasks.Moderation of learner work and feedback on the quality of marking and performance inadequate.

Analysis of learner performance and identification of gaps in teaching and

learning not happening.Slide20

Areas of weaknessesLate submission of PATs for moderation leading to late approval, e.g., Civil Technology. This has a negative impact on the academic programme.Double lesson period as required by policy for subjects with a practical component (e.g. Civil Technology) not consistently adhered to by schools. This has a negative impact on the conduct of PATs at the schools.

Most schools do not include the PATs mark sheets when submitting for moderation.

Non-Agricultural schools offering Agricultural Management Practice do not have sites for implementation and conduct of PATs (Limpopo and Eastern Cape). This is of weakness since the practical component of assessment is not fully implemented.

Evidence of implementation of the practical performances in Dance are always missing as most schools do not record the dance performances.

Poor quality (lenient marking at the most) marking for PATs always leading to inflated marks.Slide21

The DBE needs to ensure that PATs are submitted timeously for moderation so as not to impact negatively on the learning programme.The DBE needs to ensure that schools offering subjects with a practical component adhere to the policy requirement for a double period learning session.DBE needs to make compulsory for schools to submit PATs mark sheets for moderation when the SBA moderation is conducted.

The DBE needs to ensure that non-agricultural schools offering Agricultural Management Practice secure a site where the practical component can be carried out.

The DBE needs to ensure that recording of live performances in Dance Studies is made compulsory for all schools and that such recordings are made available for external moderation.

The DBE needs to ensure that the quality of marking for PATs is improved for the assessment outcomes to be fair, valid, credible and reliable.

Recommendations for ImprovementSlide22

Marker selection and training An audit of marker selection and appointment was conducted in all the nine (9) PEDs.PEDs used PAM as the basis for selection of markers.

Enhanced criteria for selection of markers was observed in some PEDs.

School pass rate in the subjects ranging from (50%-80%) was accepted as the minimum requirement.

Marker evaluation outcomes.

Educator history of involvement in marking.

Competency tests in Western Cape.Slide23

Areas of good practiceGeneral adherence to PAM by all provincesTransparent and explicit criteria in addition to PAM by most provinces in marker selection is commendable; with the exception of Limpopo where only the PAM applies.

Insistence on the achievement of tolerance range during training enhanced the quality of marker training.

All PED’s successfully conducted marker training. The training was found to be more rigorous this year compared to the past except in a few cases in the Eastern Cape.

The creation and updating/maintenance of marker databases in some provinces is commendable (MP/ NW

).

Marker Selection and TrainingSlide24

Marker Selection and TrainingAreas of good practiceThe sharing of markers between Northern Cape and Free State to deal with shortages is evidence of good planning.

Criteria for appointment of Internal Moderators and Chief Markers is performance based (MP).

Use of competency test for the appointment of Examination Assistants in the Eastern Cape is commendable.Slide25

Areas of weaknesses There is a lack of clear and transparent national criteria on marker selection in addition to the basic requirements stipulated in the PAM document.Enhancement of the PAM requirements for marker selection differs from province to province.

Incomplete applications accepted without academic transcripts (EC, LP).

Marker Selection and TrainingSlide26

Marker Selection and TrainingRecommendation for Improvement The DBE must develop common set of basic / minimum criteria for marker selection and appointment.

The DBE should ensure adherence to the criteria for marker selection and training criteria.

PAM must be reviewed.Slide27

Areas of good practice Training of markers has improved marking in most subjects.The establishment and use of tolerance range has made marking more reliable.

The emphasis on strict internal moderation of scripts has reduced inconsistencies in marking.

Verification of MarkingSlide28

Verification of MarkingAreas of weaknesses Lack of nationally approved textbooks in Music, especially with limited content in Jazz and Indigenous music available, hampers the quality of teaching.

Educators marking literature sections which they do not teach at their schools or have limited knowledge of in languages is a weakness.

The 1:5 ratio of Senior Markers to markers is not consistently followed by all provinces in all subjects which compromises the quality of moderation at the marking centres.

Non-synchronised marking times for the provinces leads to disadvantages to candidates at provinces that marked earlier when approved changes to marking guidelines are made.Slide29

Recommendations for Improvement The curriculum directorate at DBE must to ensure that a catalogue of text books in Music is made available for use at schools.It must be compulsory that

educators

mark the prescribed test works they are teaching and not others

The DBE needs to ensure that 1:5 ratio for Senior Markers to markers is enforced across provinces and across

subjects.

Marking across provinces needs to be synchronised to ensure that none of the candidates are advantaged or disadvantaged by changes made to marking guidelines.

Verification of MarkingSlide30

Areas of poor performance ACCOUNTINGQuestions 3(Audit

Report and Income Statement

: content taught

at grade 11 and examined at grade 12. Poorly taught or poorly revised

)

Question 4 (Cash flow statement and interpretation: This section is usually not sufficiently taught in some schools

)

Question

5

(

Inventories: Most learners from sample did not do this question. It might be that some

learners did not finish the paper)

Question 6 (Budgeting: Most of the sampled learners did not finish this section when writing)Slide31

Areas of poor performance BUSINESS STUDIESQuestions 2 and 6 (Strategic Management: Candidates failed to differentiate between National Skills

Development Strategy and Human Resources Development Strategy. Candidates failed to respond to questions on content taught at Grades 10, 11 and examinable at Grade 12.

)

Question 3 (Shares: Calculations

in this section proved to be difficult for most candidates)

Question 9 (

Strategic

Management

: Candidates struggled to differentiate

between decision – making and problem solving and only gave definitions)Slide32

Areas of poor performance ECONOMICS

Paper

1

Questions 2, 3 and 4 (Data Response: Most of sampled learners struggled to respond to source

based questions. Learners showed poor understanding of the NDP

)

Question

5

(Data response – choice question

: Learners poorly interpreted this question)

Paper 2

Question 2,

3 and 4 (Data response and interpretation of graphs: Candidates poorly responded to calculation based questions and failed to interpret graphsSlide33

Areas of poor performance GEOGRAPHY

Paper

1

Questions 2(Climate,

Weather and Geomorphology

: Most candidates

struggled with definitions and explanation of weather elated processes

),

Question

3

(Rural Settlement

:

candidates struggled to explain the impact of development such as rood construction on the status of a settlement

)Question 4(Urban settlement: Learners battled with the interpretation of graphs)Paper 2Question 2(Map Calculations and Techniques: Candidates struggled with interpretation of calculations)Question 3 (Application and interpretation: Candidates failed to identify primary and secondary agricultural related activities)Question 4 (Geographical Information System: Indication are that this section is poorly taught or not taught at all in some schools)Slide34

Areas of poor performance HISTORY

Paper

1

Questions 2 (Source-based on the History of Angola: Content on this section is not easily available, May not

have been taught thoroughly

)

Paper 2

Question 3 (Source-based on Globalisation

: Many teachers are unfamiliar with this topic. May have been poorly taught)Slide35

Areas of poor performance

LIFE SCIENCES

Paper 1

Questions 2 (Human reproduction: Candidates struggled to answer question on graphical representations and practical investigations. This might be due to lack of classroom practice)

Question 3 (Thermal Pollution: Content taught at Grade 11 and may not have been effectively revised in Grade 12)

Question 4 (Essay Writing: Inability of learners to express ideas in English as a second language could be the reason for poor performance)

Paper 2

Question 3 (Multiple Alleles: This section seems to have been poorly taught in some schools)

Question 4 (Essay writing and data response: Poor language usage in writing essays and the abstract nature of the given comprehension could have contributed to poor performance)Slide36

Areas of poor performance MATHEMATICS

Paper

1

Questions 3 (Sequences and Series: the content cognitive level of this section is higher and most learners struggle to understand it,

poorly taught

at some schools

),

Question 4 (Exponential

Graphs: content cognitive level is high. Poorly taught at some schools)

Question

5

(

Graphs: Hyperbola and Parabola: Different form of formula was used. Some learners failed to recognise it)Question 7 (Financial Maths: A number of teachers struggle to teach this section)Question 12 (Counting Principle: Poorly taught section. Teachers struggle with content)Paper 2Question 5 (Trigonometry: Learners struggled with derivation of formulae)Question 6 (Trigonometry: Learners failed to work out solutions for involving double angles)Question 7 (Trigonometry: 3 dimensional trigonometric problems are usually poorly taught)Question 9 & 10 (Circle Geometry: Learners lacked knowledge, skills and reasoning ability to attempt this question)Slide37

Areas of poor performance MATHEMATICAL LITERACY

Paper

1

Questions 3 (Sequences and Series: the content cognitive level of this section is higher and most learners struggle to understand it,

poorly taught

at some schools

),

Question 4 (Exponential

Graphs: content cognitive level is high. Poorly taught at some schools)

Question

5

(

Graphs: Hyperbola and Parabola: Different form of formula was used. Some learners failed to recognise it)Question 7 (Financial Maths: A number of teachers struggle to teach this section)Question 12 (Counting Principle: Poorly taught section. Teachers struggle with content)Paper 2Question 5 (Trigonometry: Learners struggled with derivation of formulae)Question 6 (Trigonometry: Learners failed to work out solutions for involving double angles)Question 7 (Trigonometry: 3 dimensional trigonometric problems are usually poorly taught)

Question 9 & 10 (Circle Geometry: Learners lacked knowledge, skills and reasoning ability to attempt this question)Slide38

Areas of poor performance PHYSICAL SCIENCES

Paper

1

Questions 8 (Electric Circuits: the

section is mainly based on calculations. Historically, learners do poorly in this section due to calculation and interpretation which is usually at a higher cognitive level

)

Question 10

(Photoelectric Effect

: This section is usually poorly taught due to teacher lack of knowledge and understanding)

Paper 2

Question

3 & 4 (Organic Chemistry: Learners struggled to respond to questions needing explanations and deductions)Question 5 (Mole Ratios: Candidates showed poor understanding of this section, maybe due to poor teaching)Question 6 (Chemical Equilibrium: Candidates battle with interpretation and calculations in this section. The content cognitive demand is higher and usually poorly taught to learners in some schools)Question 7 (Acids and Bases: This section is usually poorly taught in some schools)Slide39

Tracking of directives for compliance / areas of weakness

Area of weakness

2014

2015

2016

Comment

Non-compliance: QP Moderation Criteria

(Technical Aspects, poorly developed marking guidelines, Inappropriate distribution of Cognitive levels)

Yes

Yes

Yes

Clear guidelines to improve quality of QPs must be given/ enforced.

Examiners to respond timeously to identified errors

Continuous training of examiners required.

Quality of SBA Tasks

(Lack or Non-availability of Internal Moderation reports, Analysis grids, Inappropriate distribution of cognitive levels, poor usage of marking rubrics)

Yes

Yes

Yes

Evidence points to absence or poor internal moderation of SBA tasks, both pre and post moderation.

Inflation of marks in SBA tasks, especially in Life Orientation

Yes

Yes

Yes

Rigorous moderation and strict marking of SBA tasks is required.

Verification of Marking, Synchronising marking of subjects across provinces

(Poor marking in Maths Lit, especially in KZN and GP).

Yes

Yes

Yes

DBE need to consider synchronisation of marking across provinces. Consistency in marking in Maths Lit needs to be improved, especially in KZN and GP. Slide40

Tracking of directives for compliance / areas of weakness

Area of weakness

2014

2015

2016

Comment

Non-compliance: Registration of foreign candidates

(The DBE has not followed the requirement for the registration of foreign candidates)

----

----

Yes

A national policy with clear guidelines on the processes to be followed when foreign candidates are registered must be developed.

Criteria for appointment of Markers across provinces

(The various provinces use different criteria as enhancement to the PAM for the appointment of markers)

----

----

Yes

The DBE needs to develop a national set of criteria for the appointment of markers. The criteria should be clear and transparent to all stakeholders.

Development of functional SAICS in all centres across provinces

----

----

Yes

Irregularities committed during the conduct of SBA are usually not attended to.

The DBE needs to ensure that SAICs are available and functional to deal with SBA based irregularities.Slide41

Evidence based reportsAreas of good practiceHuge improvement in the quality and content of the report

Recommendations

DBE should strengthen the interventions and support to progress learners

The DBE should link the magnitude of the interventions with the final outcome of results for future reference.

The DBE to distinguish between the real, the perceived and the envisaged impact of the interventions strategies for future interventions.

Identify the interventions that worked with evidence of the impact.

Focus on sustainability of interventions.

Distinguish interventions on national, provincial and district level as provincial and district intervention will have little impact nationally

. Slide42

QUALITY ASSURANCE OF THEINDEPENDENT EXAMINATIONS BOARDSlide43

Question Paper ModerationIn 2016 Umalusi moderated 81 NSC question papers and the following was noted:Areas of Good Practice

Percentage of QP’s approved at first moderation declined from 45% Nov 2015 to 42% Nov 2016. Details are provided in the table below:

 

Number of moderations

November 2015

November 2016

One

45%

42%

Two

46%

51%

Three

7%

7%

Four

2%

0%Slide44

Question Paper ModerationAreas of Good PracticeIEB examiners and internal moderators are commended for achieving acceptable standards in the setting of the examination question papers in the following subjects:

QP’s approved at first moderation

Afrikaans

HL P1

Xitsonga

FAL P2

Geography P2

German

HL P1

IsiZulu FAL

P2

German

HL P2Sepedi HL P1German SAL P1

Sepedi HL P2

German SAL P2Slide45

Question Paper ModerationAreas of weaknessesThe failure by both examiners and internal moderators to address recurrent non-compliance that led to some papers requiring more than two moderations (7%). The six (6) question papers concerned are:

There is still some inconsistency in how examiners and internal moderators interpret higher order cognitive skills

.

Three moderation sessions

IsiZulu HL Paper 1; Mathematical Literacy Paper 1; Mathematics Paper 1; Sesotho FAL Paper 1; Sesotho HL Paper 1 and Xitsonga FAL Paper 1.Slide46

Question Paper ModerationRecommendations for ImprovementAddress the conduct of those examiners and internal moderators whose papers repeatedly failed to adhere to the requirements for compliance, which resulted in their papers requiring more than two external moderations; Retrain some (maybe new) examiners and internal moderators in the art of setting of question papers, especially with respect to: the technical details, the quality of questions and the development of marking guidelines – the three criteria which had the lowest levels of compliance at the first moderations; and

Continue to develop strategies to improve examiners and internal moderators’ abilities to identify and set higher order questions, and balance the distribution of the cognitive levels within question papersSlide47

Scope of SBA Moderation

Subjects

verified in

July/August 2016

Subjects

verified in

October 2016

Accounting

Afrikaans First Additional Language (FAL)

Computer Applications Technology

Economics

English Home Language (HL)

Geography

HistoryLife SciencesPhysical SciencesLife OrientationMathematicsMathematical Literacy

Dramatic Arts

Information Technology

Geography

History

Information Technology

Economics

Life Orientation Slide48

SBA Moderation

Areas of good practice

Educators’ files were found meeting the IEB Subject Assessment

Guideline

(

SAG).

Files were found orderly arranged and easily accessible.

Learners’ were found performing well in general in all the assessment tasks provided

.

The mark sheets containing learners’ marks for the formal assessment tasks were

available in

the educators’ files.

The assessment tasks adequately covered the prescribed topics and sub-topicsSlide49

SBA Moderation

Areas of weaknesses

Technical aspects of assessment tasks

- the technical aspects of the tasks such as the time allocation and mark allocation were found not indicated on the assessment tasks in some of the schools verified, e.g. Accounting, Physical Sciences where non-correlation of the total mark and the duration of the assessment paper was detected.

Internal moderation of assessment tasks

- It was noted during moderation that no moderation of learners’ tasks is conducted in most schools moderated. It was further noted that the assessment tasks were not moderated at all levels of moderation as prescribed by the SAG, e.g. Accounting,

Feedback to learners

- No evidence could be found during moderation that learners are provided with any feedback after every task has been administered, e.g. Accounting.

Cognitive demands

- The questions set in some of the assessment tasks in some schools were found to be cognitively low and not on grade 12 standard. It was further noted that some tasks were only addressing lower order level of difficulty, e.g. Accounting

.Slide50

SBA Moderation

Areas of weaknesses

Marking

of assessment tasks

- Leniency in the marking of laws/ statements and force diagrams was found in some subjects such as Physical Sciences. It was further noted that shadow marking was practiced in some subjects. Omission of other alternative answers in the marking guidelines.

Grade 11

- The tasks in grade 11 were found not of the same standard as those in grade 12, e.g. Life Orientation, Accounting

. Slide51

SBA Moderation

Recommendations for Improvement

The

technical aspects of the assessment tasks need to be improved to ensure that the tasks are valid and reliable and are not unfairly disadvantaging the learners.

All the assessment tasks need to be internally moderated and evidence of such moderation should be available in the teachers’ files.

Learners should be provided with feedback after every assessment task being administered.

All the assessment tasks need to address all the cognitive levels and ensure that problem solving questions are included where applicable.

All assessment tasks need to be assessed objectively and fairly.

Grade 11 assessment tasks need to be at the required standard as required by SAG.

Learners

should be provided with feedback after every assessment task being administered

.Slide52

SBA Moderation

Recommendations for Improvement

Grade

11 assessment tasks need to be at the required standard as required by SAG.

Consider designing the marking tools that will be fair and that will be applied constituently.

The

recycling of previous papers without any modification need to be discouraged in all papers.

Objective

rubric need to be used to ensure that the tasks are objectively and fairly assessed.

The

curriculum directorate needs to ensure that the

completion and submission of assessment grids is made compulsory for all SBA tasks across subjects. Slide53

Areas of good practiceElectronic system used for marker selection which assist with the sifting.Markers are selected from each region.

Areas of weaknesses

No evidence of academic transcripts from markers. Principals sign that the educator is qualified to mark with no evidence to support.

Recommendation

for Improvement

Academic transcripts should be attached to the application for marker

Marker Selection and TrainingSlide54

Areas of good practice Marking was found to be fair, valid and reliable. No candidates were advantaged or disadvantaged during the marking process. General adherence to marking guidelines and high level of consistency in marking was observed.

The answer scripts were found moderated by both

the internal moderators and the examiners. The

standard of internal moderation was very good

.

Variances in marks were within the agreed tolerance range.

The

variance between 1% and 3% across the randomly selected sample of scripts that was subjected to internal moderation/verification.

Verification of MarkingSlide55

Areas of good practice Some discrepancies were evident in the allocation of marks by the markers, internal moderators and examiners in

some

subjects. However

, the few deviations were found not large enough to impact

on

the candidates’ final performance.

The level of marking has improved due to the consistent application of the marking guidelines.

Moderation of more than 10% at the various levels was

achieved.

Verification of MarkingSlide56

Areas of weaknesses In Economics P1 and Physical Sciences P1, it was noted that markers

did not award

marks

to candidates for some alternative

answers.

In

English P2 bullets used in the essay topics were found to be confusing to the candidates

.

Verification of MarkingSlide57

Recommendations for ImprovementMarkers, internal moderators and examiners in Economics and Physical Sciences P1 should ensure that correct alternative responses provided by learners are marked appropriately although they may not be featuring on the marking guideline.

Verification of MarkingSlide58

Areas of poor performance ACCOUNTING

PAPER 1

Question 1

– Inventory systems

The majority of candidates verified struggled to answer question 1.7 for 4 marks that was based on accounting equation, it seems teachers are not doing enough in class with this in all sections.

Question 3

– Cash Flow Statements

Some candidates struggled to complete the financing activities section of the cash flow statement

Question 4

– Manufacturing

It was evident during verification that with some candidates the last part of this question was not attempted.Slide59

Areas of poor performance ACCOUNTING

PAPER 2

Question 2

– Reconciliations

An explanation for poor performance in this section could be that curriculum change where this section had been moved from grade 10 to grade 11, has had an effect

Question 3

- Company Analysis

It would seem that teachers might not be practising enough questions in class that would assist the candidates to deal with practical scenario questions in general

. Slide60

Areas of poor performance

BUSINESS STUDIES P1

Question 2

Many learners could not explain the difference between the National Skills Development Strategy and the Human Resources Development Strategy.

Question 3

No learner attained the full 10 marks in the calculation question in Question 3.4. This was despite of the fact that similar questions appeared in the pastSlide61

Areas of poor performance

BUSINESS STUDIES P1

Question 4

Learners failed to identify the job analysis components of Question 5.1. Quality indicators (Question 5.5) appeared in the past

Question 6

Question 6.5 was a recap from grade 10/11 work which is examinable in grade 12. Many learners failed to correctly tabulate the differences.

Question 9

Candidates failed to distinguish between decision making and problem solving. Slide62

Areas of poor performance

ECONOMICS

Paper 1

Question 1

Candidates were challenged with calculations and graphs

Question 2.1.2

Candidates mostly struggled with calculations

Question 3.5

Candidates struggled with questions on elasticity and market Slide63

Areas of poor performance

GEOGRAPHY

Paper 1

Question 2

The majority of candidates struggled in drawing a sketch to explain how a superimposed drainage pattern develops.

Question 3

Some candidates struggled to write and some did not write a report required for Question 3.5.4, which had 24 marks.

Paper 2

Question 1

Some struggled with the topographic map grid in question 1.2.1 which showed a lack of knowledge of the map index. The cross section in question 1.2.4 also proved challenging.

Question 2

Some candidates were not able to create a buffer

zone.Slide64

Areas of poor performance HISTORY

Paper

1

Questions 2

Source-based on the History of Angola: Content on this section is not easily available, May not have been taught thoroughly

Paper 2

Question 3

Source-based on Globalisation: Many teachers are unfamiliar with this topic. May have been poorly taughtSlide65

Areas of poor performance

LIFE SCIENCES

Paper 1

Question 4

Essay Writing: Inability of learners to express ideas in English as a second language could be the reason for poor performance.

The average performance was below 45.8%

Paper 2

Question 3

This question was the most

poorly answered amongst the three questions.

The average performance

was at 55.8%Slide66

Areas of poor performance

MATHEMATICS

Paper 1

Question 8

: Graph:

Using a graph to answer questions that are not easily answered algebraically, posed a problem for a large number of learners. 8a and 8g were very poorly answered.

Question 11

Probability: Generally poorly answered, especially the questions that require calculations of probabilities. Question 11c was however, admittedly a difficult question.

Question 12

: Problem:

On measurement involving 3-D objects. This problem was a complex one, having several parts to it, and requiring a good visual sense. Along with 11c, it was one of the most poorly answered questions in the paper.

Paper 2

Question 3

: Analytical Geometry

Question 10

: Geometry:

Very poorly answered. Learners find ratios difficult to handle.

Question 12

: Geometry: Most were able to find the area using the area formula. 12b required a construction to solve. Some ingenious constructions surfaced. Learners came up with at least six different solutions . They struggled with the 3-D problem 12d.Slide67

Areas of poor performance MATHEMATICAL LITERACY

Paper

1

Question 2

: Measurement

conversions using imperial system and rounding off

Question 3

: Measurement and Maps and Plans questions which created challenges for some candidates

Question 5

: Candidates struggled with number formats involving tons

Paper 2

Question 1.3

was answered poorly as candidates struggled with scale concept and calculation of perimeter and volume.

Question 2 also contained Measurement skills which learners found challenging. Question 4 presented challenges to candidates as they found it difficult to interpret given data and thereafter perform calculations involving measures of central tendencies.Slide68

Areas of poor performance PHYSICAL SCIENCES

Paper

1

Question 8

Electrodynamics (The logical reasoning and relating explanations to relevant scientific equations was a big challenge to learners)

Paper 2

Question 7

Learners struggled to respond to questions needing explanations and deductionsSlide69

Tracking of directives for compliance / areas of concern

Area

of concern

2014

2015

2016

Comment

Non-compliance: QP Moderation Criteria

(Technical Aspects, poorly developed marking guidelines, Inappropriate distribution of Cognitive levels)

----

Yes

Yes

Clear guidelines to

improve quality of QP’s need to be given.Examiners to respond timeously to identified errorsContinuous training of examiners required.Quality of SBA Tasks

(Lack or Non-availability

of

Internal Moderation reports, Inappropriate distribution of cognitive levels,)

----

Yes

Yes

Evidence points to absence or

poor internal moderation of SBA tasks, both pre and post moderation.

Alternative responses to questions by candidates not fully considered in Economics and Physical Sciences P1

----

----

Yes

IEB

needs to ensure that emerging alternative responses during marking are fully discussed and considered where necessary

One person is used for both capturing and verification of marks. The double capture method employed by IEB is not fully functional.

-----

-----

Yes

The responsibility of capturing the marks and verifying should be assigned to different people.Slide70

Tracking of directives for compliance / areas of concern

Area

of concern

2014

2015

2016

Comment

Non-compliance: Registration of foreign candidates

(The DBE has not followed the requirement for the registration of foreign candidates)

----

----

Yes

A

national policy with clear guidelines on the processes to be followed when foreign candidates are registered must be developed.Criteria for appointment of Markers across provinces(The various provinces use different criteria as enhancement to the PAM for the appointment of markers)----

----

Yes

The

DBE needs to develop a national set of criteria for the appointment of markers. The criteria should be clear and transparent to all stakeholders.

Development

of functional SAICs in all centres across provinces

----

----

Yes

Irregularities

committed during the conduct of SBA are usually not attended to

.

The DBE needs to ensure that SAICs are available and functional to deal with SBA

based irregularities.Slide71

Evidence based reportsAreas of good practiceGood security: Using the electronic locking system; surveillance equipment (to tap in at any point of time to spot check and record what is happening at the exam centre)

Piloting of an on-line marking system in 2017 in certain subjects

.

Recommendations

IEB should continue to develop strategies to improve examiners’ and internal moderators’ ability to identify and set higher order questions and balance the distribution of cognitive demands within question papers.

Control measures should be put in place for shredding and disposal of examination related waste material.

Both the examiner and the internal moderator in each subject are expected to remain at the marking venue for the duration of the entire marking period to moderate and assist the marking personnel where necessarySlide72

QUALITY ASSURANCE OF THESOUTH AFRICAN COMPREHENSIVE ASSESSMENT INSTITUTESlide73

Question Paper ModerationIn 2016 Umalusi moderated 46 NSC question papers and the following was noted:Areas of Good Practice

Percentage of QP’s approved at first moderation improved from 18,8% Nov 2015 to 21,7% Nov 2016. Details are provided in the table below:

 

Number of moderations

November 2015

November 2016

One

18,8%

21,7%

Two

41,6%

58,7%

Three

31,3%

19,6%

Four

8,3%

0%Slide74

Question Paper ModerationAreas of Good PracticeThere was evidence that all question papers were internally moderated and that all Internal moderators (IM) submitted their reports;

That for the large majority of question papers, there is sufficient evidence to show that the recommendations of the IM were adopted;

Question papers were representative of the latest developments of the subject;

Question papers included a variety of question types as commanded by the subject;

The large majority of the subjects showed that the source materials were subject specific and of the required length;Slide75

Question Paper ModerationAreas of Good PracticeFor the MCQ questions, the options followed grammatically from the stem, were free from absolute terms (e.g. ‘always’ and ‘never), and were approximately of the same length and were language comparable;

The overwhelming majority of the question papers showed that the questions relate to what is pertinent to the subject and were free from ambiguities that might have arisen from the use of double negatives;

Foreign names, terms and jargon across all subjects were accompanied by a glossary;

Questions allowed for the adaptations and modifications for assessing special need students in the interest of inclusivity; andSlide76

Question Paper ModerationAreas of Good PracticeWith

regard to the marking guidelines, they were complete with mark allocation and mark distribution within each of the questions; encouraged a spread of marks; awarded marks positively and

utilized

level responses and analytical approaches where appropriate.Slide77

Question Paper ModerationAreas of weaknessesThe failure by both examiners and internal moderators to address recurrent non-compliance that led to some papers requiring more than two moderations. The nine (9) question papers concerned are:

There is still some inconsistency in how examiners and internal moderators interpret higher order cognitive skills

.

Three moderation

sessions

Afrikaans FAL Paper 2, Afrikaans HL Paper 1, Business Studies, CAT Paper 2, English HL Paper 1 and Paper 2; Life Sciences Paper 1, and Mathematical Literacy Paper 1 and Paper 2Slide78

Question Paper ModerationRecommendations for ImprovementThe subjects for which question papers were approved at third level should be investigated to ensure that a repeat is avoided in the next examination session;SACAI should train its internal moderators on:

applying the moderation instrument to the question papers and marking guidelines;

applying the relevant educational taxonomy effectively; and

enhancing editorial and proofreading skills. Slide79

Scope of SBA Moderation

Subjects

verified in

July/August 2016

Subjects

verified in

October 2016

Accounting

Business Studies

Civil Technology

Computer Applications Technology

Economics

Life Orientation

English FALLife Sciences

Mathematics

Physical Sciences

Accounting

Business Studies

Civil Technology

Computer

Applications Technology

Economics

Life Orientation

English FAL

Life Sciences

Mathematics

Physical SciencesSlide80

SBA ModerationAreas of good practiceModeration thorough across centres.

The quality of the files presented generally good.

Detailed feedback provided to teachers

Question papers generally complied with the necessary prescribed technical requirements.Slide81

SBA Moderation Areas of weaknesses

Cognitive demands of the assessment tasks very low, the June Mathematics Paper 2 did not comply with the prescribed cognitive weighting norms.

Marking of the assessment tasks was inconsistent in some subjects, (Civil Technology), the number of ticks did not correspond with mark/s for each sub-question and the extra ticks in the test and June marking guideline led to confusion of the total mark.

No analysis grid in Hospitality Studies and Life Sciences;

No detailed constructive qualitative feedback provided to learners after moderation.Slide82

Cont. Areas of ConcernIn Accounting, the case study recorded as controlled test.There is evidence of poor quality of tasks for Civil Technology with particular reference to Excelsior Akademie

Rooihuiskraal

and

Auxilio

Learning AcademySlide83

SBA Moderation Recommendations for Improvement

An analysis grid

must

be developed clearly indicating the weightings used in the distribution of cognitive demands.

Assessment tasks should address all levels of cognitive demands.

Centres must provide constructive feedback to learners after every assessment administered.

Avoid recycling DBE previous question papers and set well designed question papers for the preliminary examinations.

W

eaker centres must be trained, supported

and

guided

for the development and implementation of SBA

tasks.Slide84

SBA Moderation Recommendations for ImprovementEducators need to be trained on how to develop quality assessment tasks and to be able to use previous question papers innovatively without opening up the question papers to a high level of predictability

Schools must be encouraged to use common practical assessment tasks developed by District offices.

Educators must also be trained on the development of quality practical assessment tasks for Physical Sciences and Life Sciences.Slide85

Marker selection and training Areas of good practiceCriteria for appointment of marking personnel was transparent.

Training was informative and covered all aspects related to marking.

Areas of weaknesses

The CM’s and IM’s were not trained by SACAI.

Recommendation for Improvement

SACAI should thoroughly train the CM’s and IM’s Slide86

Verification of Marking Areas of good practice Thorough and judicious marking practices of the IM, CM and Markers for Consumer Studies, Economics, English HL, EGD, Geography and Mathematics was observed. Slide87

Verification of MarkingAreas of weaknessesSACAI ignored irregularities: learners did not use prescribed answer books ; typed answers accompanied by concessional letters; and the final mark reflected the mark of the marker and not that of the final moderator(BS)

Learner performance is extremely poor and is probably as a result of home-schoolers who do not receive any kind of formal teaching and/or exposure to cognitive academic language proficiency, (CALP) skills.

The

internal moderator

was not always present to address marker inconsistencies, (English

HL)Slide88

Verification of MarkingRecommendations for Improvement Formal teaching sessions for the acquisition of CALP, English language usage and subject content knowledge must be put in place and/or carefully monitored. The current status of learner performance has provided great cause for alarm.

Policies and procedures to manage irregular practices should be in place.

SACAI should make every effort to ensure that appointed IMs, CMs and Markers are able to report for duty for the full duration of the marking process (unless, of course, if absence is due to unforeseen circumstances).Slide89

Areas of poor performance

ACCOUNTING

Candidates performed generally poor in the subject although large number of alternatives were given for opinion based questions.Slide90

Areas of poor performance

BUSINESS STUDIES

Question 2

Challenging topics were 2.3 (EEA), 2.6 (SETAs), 2.7 (Rights consumers)

Question 3

Challenging topics were 3.2 (Leadership styles), 3.5 (Success factors), 3.6 (impact investments).

Question 4

Challenging topics were 4.3 (CSR v/s CSI), 4.4 (Aspects King

Code III), 4.6 (Impact teamwork), 4.7 (Role JSE).

Question 5

Challenging topics were 5.2 (TQM), 5.4 (Quality standards HR), 5.7 (elements TQM).

Question 7

Candidates performed poorly in all the essays, they could not analyse and

interpret essays.

Many were not able to express themselves in full logical sequence, some

opted not to answer any essays, or answered only one of the two required

essays. Slide91

Areas of poor performance

ECONOMICS

Paper 1& 2

The majority of the candidates performed poorly in both P1 and P2.

A number of candidates did not score any marks for their essay responses.

Most candidates lacked current Economics knowledge; poor spelling and grammar; ‘sloppy’ sentence construction; irrelevance; and unsubstantiated arguments.

A major concern was the inability of candidates to use standard Economics vocabulary in their responses.Slide92

Areas of poor performance

GEOGRAPHY

Paper 1

Question 2

-

Climatology and geomorphology

Cold front occlusion, river capture and rejuvenation

were challenging concepts for candidates.

Question 3

-

Settlement and the economy of RSA

Candidates need to be more familiar with terminology e.g. Urban profile and food security.

Paper 2

Questions 2

-

Cross section and Calculations

Candidates could not apply scale distance and could not measure accurately.

Cross section-Candidates did not know the meaning of “Intervisibility”

Questions 3

-Interpretation

Learners were unable to apply concepts of range and sphere

of influence of Worcester in relation to the relief depicted on the map

Learners could also not distinguish between heavy and light industry properly.

Question 4

GIS

Very poorly performed, learners had no confidence for applicationSlide93

Areas of poor performance HISTORY

Paper

1

Inability to develop and sustain a line of argument in essay writing.

Candidates struggled to select evidence from sources to answer source-based questions

Paper 2

Inability to develop and sustain a line of argument in essay writing

Candidates struggled to select evidence from sources to answer source-based questions.Slide94

Areas of poor performance

LIFE SCIENCES

Paper 1

Question 1

: Candidates were not exposed to the subject terminology.

Question 2

: Inability to interpret diagrams.

Question 3

: Candidates didn’t know how to draw a flow diagram

Paper 2

Question 1

: Candidates were not exposed to the subject terminology.

Question 3

: Candidates lacked the knowledge of subject language as they battled to use the terms ‘alleles’Slide95

Areas of poor performance

MATHEMATICAL LITERACY

Paper 1

Questions 2

Based on Measurement, created some problems for candidates.

The performance of candidates in the question on the topics of Measurement on both papers was much lower than for the other topics.

Question 5

Candidates struggled with number formats involving tons. The inability of candidates to express reasons and explanations clearly.

The performance in Questions 2 and 5 relating the Topics Measurement and

Maps were much lower than for the other questions

Paper 2

Question 2

Answered poorly as candidates struggled with scale concept and calculation of perimeter and volume.

Question 3

Contained Measurement skills which learners found challenging.

Question 4

This question was poorly answered. Slide96

Areas of poor performance

PHYSICAL SCIENCES

Paper 1

Question 2,3,4,5 and 10

– Poorly answered. Vertical projectile motion, work/energy theorem and momentum problems need to receive more attention. Waves/Sound and Light questions were also poorly answered.

Paper 2

Question 6,7 and 10

– Poorly answered.

Questions requiring language and writing proved to be a challenge.

Equilibrium Constant problems need a lot of attention.

Candidates also performed poorly in Acids and Bases and Chemical Systems.Slide97

Tracking of directives for compliance / areas of concern

Area

of concern

2014

2015

2016

Comment

Non-compliance:

QP Moderation Criteria

(Technical Aspects, poorly developed marking guidelines, Inappropriate distribution of Cognitive levels)

Yes

Yes

Yes

Clear guidelines to improve quality of QP’s need to be given.Examiners to respond timeously to identified errorsContinuous training of examiners required.

QP Moderation Criteria

Repeated non –compliance in

the setting of English Home Language and Mathematical Literacy question papers.

----

Yes

Yes

SACAI needs to investigate the cause of non

– compliance to criteria for setting of question papers in the two subjects.

Quality of SBA Tasks

:

Poor quality

SBA tasks administered in some centres including Excelsior Academy,

Rooihuis

Kraal,

Oxilio

Learning Academy, Free2BMe and Alpha Education SA.

----

----

Yes

SACAI needs to provide training,

support and guidance for the development and implementation of SBA tasks.

Verification of Marking

Learner performance is generally low in most subjects owing to poor

command of the Language of Learning and Teaching.

Yes

Yes

Yes

Formal teaching sessions are needed to improve the learners usage of cognitive academic language proficiency (CALP) skills.Slide98

Tracking of directives for compliance / areas of concern

Area

of concern

2014

2015

2016

Comment

Standardisation and Resulting

Incorrect usage of colour coding and lack

of a bold line to divide the statistical information according to years.

----

----

Yes

SACAI needs to ensure that the correct colour coding for graphs in the standardisation booklet and the use of the bold line is adhered to.Over-reliance on outside programme administrator (IT service provider)YesYesYes

SACAI needs to ensure that its staff is capacitated to manage the exam

IT system.

Certification

The processes followed for the registration of immigrant learners are incomplete and do not comply with the policy.

----

Yes

Yes

The

DBE needs to develop a national set of criteria for the appointment of markers. The criteria should be clear and transparent to all stakeholders.Slide99

Evidence based reportsAreas of good practice

Remarkable improvement in the setting of question papers and compliance to policy

Recommendations

SACAI should screen their markers carefully to ensure that they have the necessary subject content knowledge. This is critical for the marking of alternative and implicit responses that cannot be included in the marking guideline.

Formal teaching sessions for the acquisition of CALP, English language usage and subject content knowledge must be put in place and/or carefully monitored. The current status of learner performance has provided great cause for concern.Slide100

StandardisationSlide101

Why Umalusi

Standardises

Results and How

Provision of GENFETQA – Council may adjust raw marks;

International practice – large scale assessment systems;

Standardisation – process used to mitigate the effect of factors other than the learners’ knowledge and aptitude on the learners performance.

Sources of variability – difficulty in question paper, undetected errors, learner interpretation of questions.Slide102

Objectives of Standardisation

To ensure that a cohort of learners is not advantaged or disadvantaged by extraneous factors other than their knowledge of the subject, abilities and their aptitude.

To achieve comparability and consistency from one year to the next.

To deliver

a constant product to stakeholders: TVETs, HE, employers, and societySlide103

Why Umalusi

standardises

results and how cont.

Assumptions – for large populations the distribution of aptitude and intelligence does not change appreciably ;

Process of standardization:

Moderation of question papers;

Review of learner performance against historical performance of candidates in each subject;

Historical average (norm) constructed using past 3 to 5 years data;

Pairs analysis provides further comparisons of raw means;

Statistical moderation of

i

nternal assessment.Slide104

Why Umalusi standardises results, and how cont.

Qualitative input meetings;

Reports (Moderator,

C

hief

M

arker and Internal Moderator);

Umalusi research (maintaining standards & post exam analysis);

Responsibility of Assessment Standards Committee:

Committee of Council;

Responsible for setting and maintaining standards;

Observers (SAQA,

USAf

, Teacher Unions).Slide105

Process of

Standardisation

Continuation of JMB and SAFCERT model;

Assessment Standards Committee;

Qualitative Reports;

Pre-

standardisation

and

Standardisation

meetings;

Standardisation booklets (data) – subject raw mark distributions (external written component only) of entire cohort;

Subjects are standardised individually, in a linear and non- iterative manner.Slide106

Standardization principlesThe

method applied has remained the same since the Joint Matriculation Board (JMB) era: 1918 – date

Generally,

no adjustment should exceed 10% of the historical

average in either direction (upward or downward)

If the distribution of the raw marks is below

or above the

historical average, the marks may be adjusted

either way subject

to limitations

In

the case of

an individual candidate,

the adjustment effected should not exceed half of the raw mark obtained by the candidateAfter considering qualitative & quantitative reports, the ASC formulates positions on each subject: ‘accept raw marks’, ‘downward adjustment’ or ‘downward adjustment’ Slide107

EXAMPLESSlide108

2016 NSC Standardisation DecisionsSlide109

109DBE 2016 DECISIONS

Description

Total

Number of instructional offerings presented

58

Raw marks

26

Adjusted(mainly upward)

28

Adjusted (mainly downwards)

4

Number of instructional offerings standardised:

58Slide110

IEB 2016 DECISIONS

Description

Total

Number of learning areas presented

64

Raw marks

52

Adjusted (mainly upwards)

7

Adjusted (mainly downwards)

5

Number of learning areas standardised:

64Slide111

111SACAI 2016 DECISIONS

Description

Total

Number of learning areas presented

28

Raw marks

16

Adjusted (mainly upwards)

9

Adjusted (mainly downwards)

3

Number of learning areas standardised:

28Slide112

ConclusionBoth private and public assessment bodies should be commended for the consistent improvement in assessment practices over the years.Umalusi has witnessed a high level of compliance by assessment bodies in executing its directives for improvement issued to each one of them after each examination cycle.

D

espite a few areas of concern raised, and a few irregularities reported during the administration of the 2016 NSC examinations,

Umalusi

was satisfied with all the assessment processes from the three assessment bodies and their results were duly approved in December 2016. Slide113

THANK YOU