The course has focused on the Formative part of assessment and largely disregarded the Summative.
To define them:
Formative is the casual side of assessment. This involves questioning and exercises to monitor the student progress/learning. The students benefit by experiencing a measured improvement and the teachers by being able to measure student learning and adjust delivery techniques. Information gathering as training progresses.
Summative is the formal and official side of assessment. Commonly known as EXAMS. This spawn of Satan, evoked fear and trepidation in the minds of students. A measure to determine knowledge after training.
There is a grey area between Summative and Formative. This is mainly when Formative assessment count towards a final grade or used to support a decision about a student or course.
The best example of Summative Assessment I have encountered would be the process used by the RNZAF.
Instructors were invited to submit questions from the material given to the students. The questions were moderated and entered into the 'bank' with an individual number. Overtime and as questions were used the results were recorded and each question was rated as to it's difficulty. The questions for the exam paper were randomly selected by computer (1990's) and a difficulty score given to the paper as a whole. When the paper was marked the difficulty factor was divided into the final result and an adjusted percentage awarded. The instructor was also given a print out detailing how the question results compared to the awarded difficulty.
This procedure ensured, as much as possible, that all students were on a level paying field and the comparison between marks a year apart could have some validity.
An instructor could target areas that needed extra attention.
A great system that initially absorbed huge man hours but became easier and more accurate with time.
"The course has focused on the Formative part of assessment and largely disregarded the Summative" - this comment is important and amusing, but not entirely accurate. This course was focused more on Formative assessment, but never said that Summative is not equally important. One reason is that if we teach all at once we will just fly over the topic leaving participants with a good feeling and a poor understanding of all that was superficially approached. We have a limited time to cover formative assessment as it should and this is a major reason of a certain focus. Second, I do not think that we miss at MIT summative assessments, but formative! (also, I found often that what is called "formative" is just a collection of smaller summative assessments). Third, if you have a limited power as lecturer in shaping/designing summative (ie. unit standards), you are free to design formative assessments to improve summative while teaching. I hope we will discuss also about this topic in class. Best, Stefan
ReplyDeleteHi - I have just had the opportunity to design a formative assessment as the result of information which came to light during the marking of a summative assessment.
ReplyDeleteIt became clear that there was a substantial knowlege deficit within the group - this became the topic for a tutorial that I held with a smaller group of students in the clinical setting. The pre and post-test results revealed a significant improvement in understanding following this session.