TESTING AND ASSESSMENT

Methodology
for
Planning and Monitoring
the Quality of
Student Learning Outcomes Assessments
Day 4: Using Graphical Presentations to Describe BOET and DOET Accomplishments and Improvements
Overview of the Workshop
 Day 1: International Trends in Assessing Students Learning Outcomes
 Days 2 and 3: Methodology for Planning and Monitoring the Quality of Assessments:
 Part 1. Aligning Assessments to Improve Examination Quality
 Part 2. Analyzing Test Specifications to Improve Examination Quality
 Part 3. Judgmental Methods to Improve Examination Quality
 Part 4. Statistical Methods to Improve Examination Quality
 Day 4: Using Graphical Presentations to Describe BOET and DOET Accomplishments and Improvements
Using Graphical Presentations to Describe BOET and DOET Accomplishments and Improvements


Student Learning Outcomes are Important to Monitor
Achievement is a major goal of lower secondary education
Need to demonstrate that schools help students to achievement the learning outcome goals
Need to demonstrate that the students’ achievement of the learning outcomes can be sustained over time
FSQL is important but without student learning outcome information the main point of lower secondary education is missing from FSQL
Demonstrating a Pattern of Change Over Several Years is More Important than Showing One Year`s Results
One year’s result may not be a typical result
One year’s result may not be sustainable over time
One year’s results may be result of many factors not under the control of a school, a BOET, or a DOET
A pattern of results can show that there is overall improvement even if one year is different
Conclusion: There is a need for Education Authorities to Monitor Students’ Achievement of the Curriculum Objectives and to Report Progress Over Time
What Information is Available?
Examination scores for students in every lower secondary school
School reports on students’ quality levels
Other?
Graphs are Important
Easier to see trends and patterns in the data
Graphs communicate better
A picture is worth many words
Seeing is believing
Math Lit Math Lit Math Lit
2006 2006 2006 2006 2006 2006
4.8 5.2 5.7 5.7 5.0 4.1
5.0 5.1 5.6 6.3 6.5 6.5
4.8 5.0 5.9 5.4 7.8 7.9
6.4 5.1 5.1 5.3 3.6 3.6
6.9 5.0 6.4 5.4 7.9 7.0
6.8 6.7 5.0 4.8 7.7 5.8
6.3 6.8 6.5 5.8 5.4 5.5
5.6 5.0 5.4 5.2 7.3 7.0
4.7 5.1 5.8 5.5 7.6 5.5
5.4 4.3 8.2 6.4 8.3 6.7
5.6 5.6 7.6 6.9 6.8 6.0
4.7 5.0 7.6 6.7 7.8 7.2
5.4 5.1 7.3 7.3 9.4 9.1
6.3 5.8 5.4 5.0 5.4 4.5
4.4 5.8 5.2 4.2

Examples of Monitoring Questions that Could be Asked and Answered by Graphs
How do Teacher Qualifications Impact Pupil Learning Outcomes?
What is the Achievement Trend for Boys and Girls in LS Mathematics?
How Different is the Achievement of Minority Students in Boarding and Nonboarding Schools?
How do Schools Differ in Biology Achievement?
Does Student Achievement Improve as Teachers Have More Experience With the New ICT Curriculum?
Examples
Graphs that could be Used to Answer Questions Like the Preceding Ones
How do Teacher Qualifications Impact Pupil Learning Outcomes?
What is the Achievement Trend for Boys and Girls in LS Mathematics?
How Different is the Achievement of Minority Students in Boarding and Nonboarding Schools?
How do Schools Differ in Biology Achievement?
Average Biology Score in the School
Does Student Achievement Improve as Teachers Have More Experience With the New ICT Curriculum?
Group Activities Will Give you Practice
Activity will be about graphing trends in student achievement and comparing groups of students

What You are to do in the Graphing Trends Group Activity
You are given:
Data tables showing average examination scores for a group of schools in Mathematics and Literature for each of four years. There are also average scores for male and female students
Part 1. Read the tables of end-of-year examination results
Part 2. Graph the information in the tables according to the trend specified in the directions
Study the tables of data
Identify the parts of the information needed to answer the questions posed
Also graph your results on the graph paper provided
Part 3. Reflect on your findings and interpret your results
Review your findings
Answer the questions on the last page of the activity handout
Part 1. Read the information in the tables
Part 2. Draw graphs
Part 3: Interpreting the graphs
Good Luck!