How Final Scores are Calculated
Calculating a Student’s Score
Multiple-Choice Score + Open-Response Score = Student’s Raw ScoreUsing a standard psychometric process, the student’s raw score is converted into a score on a scale from 200 to 400 points. A scale score of 300 is required to be successful on the OSSLT.
Why are raw scores converted to scale scores?
This process is part of a well-established statistical procedure known as "equating", which ensures results are validly comparable from one year to the next.
Does this affect the student’s outcome?
No. Converting a raw to a scale score does not change the student’s outcome. Consider that the freezing point of water is the same whether one uses a Fahrenheit or Celsius thermometer.
The Scoring Process
EQAO processes are designed to ensure accurate, fair and valid results for all students. The scoring process includes
- scorer training;
- double scoring of each student’s paper and
- ongoing monitoring for productivity, validity and reliability.
Parents and students can be assured students’ work has been scored against the same standard and in a consistent manner across the province.
Student Anonymity
Student test booklets are identified by barcode only. To ensure anonymity during the scoring process, neither the student’s nor the school’s name appears on the booklet.
All multiple-choice responses are scanned with computer software and double- checked to ensure that every student answer has been electronically recognized.
Random Distribution
When completed test booklets are received back from Ontario schools, they are scrambled and randomly distributed among the scorers.
Scorers
About 1200 scorers from across the province are gathered in the GTA for about two weeks each year to score the test. Scorers and scoring leaders must pass a qualifying test in order to participate. Scorers
- are primarily practising or recently retired Ontario educators and
- have credentials with the Ontario College of Teachers, a university degree or a professional background in language and literacy (e.g., are faculty of education students).
Training
Each student paper is scored with the same set of criteria and following identical scoring procedures. Scorers are trained to score consistently using
- rubrics (scoring guides);
- anchor papers (sample responses) and
- practice or training papers.
All scorers participate in two daily activities designed to refresh their training and ensure every Ontario student is assessed with a uniform scoring standard.
Multiple scoring
For scoring, student booklets are separated according to the seven booklet sections.
- Each section is independently scored by at least of two different scorers.
- At least 14 scorers will have marked any given student’s work.
Student responses are automatically sent to a scoring leader or literacy expert for a third score if there is a large discrepancy in the scores assigned by the two scorers.
Monitoring for validity and reliability
Selected booklets, referred to as "validity papers", are chosen, prescored by scoring leaders and circulated blindly throughout the marking session to monitor the validity (accuracy) of scoring on a daily basis. The reliability (consistency) of each scorer is also monitored on a daily and cumulative basis.