Saturday, July 27, 2013

HSC and ATAR (5 of 10) - Moderation of Assessment Marks

Assessment Mark
For each HSC course Alex undertakes in Year 12, he completes the required assessment tasks as mandated by the school. Once the assessments are complete, the school submits the total assessment mark (called raw assessment mark) together with the rank order in his year group for each course to the Board of Studies (BOS):
                                                   Raw
Course                 Unit         assessment mark     Rank
Economics             2                  80/100              15
English Advanced   2                  90/100                1
Maths Ext. 1           2                 75/100                8
Maths Ext. 2           2                 85/100                4
Modern History       2                 72/100               38
History Ext.             1                 45/50                  2

As different schools may use different programs of  assessment tasks and have slightly different marking criteria, all school-submitted assessment marks are moderated by BOS in order to maintain fairness across schools. While the raw assessment marks might be influenced by individual schools, the HSC examination is used as a common scale to allow schools to be compared fairly as all students sit together in the open examination. The moderation process re-distributes the total raw examination marks of each HSC course obtained by the individual school during the HSC examination to all its students according to the students' performance in school (i.e. according to the ranking and their relative performance of each student in the school assessment). The process may sound complicated, but let's illustrate using Alex and his High School in one HSC course as an example.

Assuming Alex's class in Year 12 in his High School has 6 students (just hypothetical for simplicity), their raw assessment marks together with the rank order in the English Advanced course are submitted by the school. Their raw examination marks in the English Advanced course are also extracted from the HSC examination:
                         Raw                                      Raw
Course     assessment mark  Rank         examination mark  Rank
Alex                   90                1                        76               3
Ben                    78                2                        92               1
Charles               75                3                        80               2
Dylan                  58               4                         60               4
Edward              55                5                         50               6
Frank                 40                6                         51               5

Total                  396                                         409
Mean                  66                                           68

The moderation process works as follows:
1. the top raw assessment mark is adjusted to equal to the top raw examination mark (92).
2. the bottom raw assessment mark is adjusted to equal to the bottom raw examination mark (50)
3. the mean of the raw assessment marks of the school is adjusted to equal to the mean of the raw examination mark of the school (68)
4. basing on 1-3 and the statistics of all the raw examination marks of all the students in the school, a concave-up quadratic curve for the moderated assessment marks of all the students in the school is  established:

5. individual student's moderated assessment marks are then determined (can be read off) from the above quadratic curve from their raw assessment marks

As such, the moderated assessment marks for the English Advanced course of Alex's school are as follows:
                    Moderated
                assessment mark Rank
Alex                   92               1
Ben                    77               2
Charles               74              3
Dylan                  59              4
Edward               57              5
Frank                  50              6

Total                 409
Mean                 68

Note that:
1. the total moderated assessment mark of the school is equal to the total raw examination mark of the school (409), i.e. the total raw examination marks of the school is re-distributed as the moderated assessment marks of the school
2. the rank order of each student in the school assessment is maintained, i.e. Alex remains 1st and Ben remains 2nd, and so on in the raw assessment is the same as those in the moderated assessment
3. the relative performance between students is also maintained, i.e. the relative gaps between Alex/Ben, Ben/Charles etc in the raw assessment are the same as those in the moderated assessment.

The process is then repeated for all other courses Alex undertakes, and Alex's moderated assessment marks are calculated as follows:
                                      Moderated
Course                Unit  assessment mark
Economics             2          85/100
English Advanced   2          92/100
Maths Ext. 1           2          74/100
Maths Ext. 2           2          80/100
Modern History       2          70/100
History Ext.             1           44/50

After moderation, the school assessments (the assessment marks) are now on the same scale as the HSC examination (the examination marks), and are deemed fair across all schools. To cater for the difference in students' performance in different year, the moderated assessment marks are further aligned to the performance bands according to the current year's cut-offs similar to the alignment process of the raw examination marks. Alex's reported assessment marks are then calculated as follows:
                                          Reported
Course                Unit     assessment mark
Economics            2              92/100
English Advanced  2               96/100
Maths Ext. 1          2               80/100
Maths Ext. 2          2               88/100
Modern History      2               76/100
History Ext.            1                47/50

Friday, July 19, 2013

HSC and ATAR (4 of 10) - Alignment of Examination Marks

Result of each HSC course is determined by Board of Studies (BOS) based on 50% from the HSC examination and 50% from the school assessment tasks.

Examination Mark
Alex undertakes a set of HSC courses and sits for the HSC examinations. The marks he obtains for each course from the examinations (called raw examination marks) are as follows:
Course                  Unit       Raw exam mark
Economics               2              78/100
English Advanced     2              76/100
Maths Ext. 1            2              69/100
Maths Ext. 2            2              70/100
Modern History        2              68/100
History Ext.              1               47/50

To cater for the difference in students's performance in difference years, the cut-off marks (the minimum marks in the current year) in each performance bands are set by BOS as mentioned in previous blog. Alex's raw examination marks are then aligned to the performance bands based on current year's cut-offs, e.g. The current year's cut-off marks of 2-unit courses for Band 5 is 74 and for Band 6 is 82. With Alex's raw examination mark of 78 for Economics (which is half way between Band 5 and Band 6), Alex's mark for Economics after the alignment (called the reported examination mark) would be reported as 85. Likewise, Alex's raw examination mark of 76 for English Advanced is 1/4 above Band 5, and is aligned and reported as 83 accordingly. The process is repeated for each course that Alex undertakes, and the reported examination marks are then calculated as follows:
Course                  Unit    Reported exam mark
Economics               2             85/100
English Advanced     2             83/100
Maths Ext. 1            2             75/100
Maths Ext. 2            2              80/100
Modern History        2              74/100
History Ext.              1              46/50

Saturday, July 6, 2013

HSC and ATAR (3 of 10) - Determining the HSC Result

A student's achievement in the HSC consists of the results in each of the HSC courses they study. The achievement of each course is determined and reported by the Board of Studies (BOS) with 50% based on the open HSC examinations and 50% based on the assessment tasks completed in individual school in Year 12. The process of determining the HSC result of each course is as follows:

HSC course:           HSC examination            Assessment tasks
                                         |                                   |
                                         |                            submitted
                                    marked                        by school
                                         |                                    |
                                      raw                                raw
                             examination mark            assessment mark
                                         |                                    |
                                         |                             moderation
                                         |                                    |
                                         |                             moderated
                                         |                        assessment mark
                                         |                                    |
                                   alignment                       alignment
                                         |                                    |
HSC mark:                    reported                         reported
      |                      examination mark            assessment mark
      |
Performance band

Before we walk through the process of determining the HSC result, we first give some explanations of the performance band standards defined by BOS.

Performance Band Stardards
Performance of the achievement is measured against standard performance bands. Marks obtained for each course are divided into bands and each band aligns with a description of a typical performance by a student within that mark range. For 2-unit courses, there are 6 performance bands (1-6) with Band 6 being the highest level of performance. For Extension courses, there are 4 performance bands (E1-E4) with Band E4 being the highest. The standard Performance Bands and the corresponding mark ranges defined by BOS are as follows:
2-unit courses
Band            1        2         3         4        5         6
Mark range   0-49   50-59  60-69  70-79  80-89  90-100
Extension courses (except Mathematics Extension 2)
Band             E1      E2      E3       E4
Mark range   0-24   25-34  35-44  45-50
Mathematics Extension 2
Band             E1      E2      E3       E4
Mark range   0-49   50-69  70-89  90-100

As students' performance in the HSC may be different in different years due to differences in examination papers and marking criteria etc., a procedure is used to enable the raw examination marks awarded each year to be aligned to the standard performance bands. BOS looks at critical information each year like statistical data and student responses to produce a set of cut-off marks for each performance band. e.g. Based on current year's student performance, BOS may set 82 to be the minimum mark required for Band 6, 74 for Band 5, and so on. The cut-off marks for the standard performanc bands for 2-unit courses in the current year may be set as follows:
2-unit courses
Band             1         2        3         4         5         6
Cut-off          0         45      55       64       74       82
Extension courses (except Mathematics Extension 2)
Band             E1       E2       E3       E4
Cut-off          0         20       32       40
Mathematics Extension 2
Band             E1       E2       E3       E4
Cut-off          0         45       60       80

We shall walk through the process of determining the HSC result with the example of Alex in the current year HSC.