Good assessment items are made, not born. This workshop will provide an overview of the process of numeracy and mathematics item writing, including the theoretical principles and reasons for choices made at every stage. Some of the processes that typically go into developing strong and valid assessment items will be explored in the workshop. Throughout this workshop the discussion will be linked to specific items from a variety of sources.
Participants will examine how a stimulus and the accompanying assessment items start as drafts. They will contribute to the process of panelling and revision of both text and items, and compare their suggestions with the real history of revisions made to material used in an existing numeracy test. They will consider qualities of the items in relation to the key feature of the Australian Core Skills Framework (ACSF). The results of a formal trial-by-learner – the field test – will be examined. They will compare the initial drafts of a unit of items with the final set as used in an operational assessment tool. Specific numeracy issues related to the complexity of the language and the text in the stimulus will also be addressed. The choice of distractors for multiple choice numeracy items creates opportunity to report diagnostically on common misunderstandings that lead students to incorrect responses.
The last part of the workshop will give participants time to put the principles to work and to write and panel some items. This may include putting some of their own assessment items up for critique.
This workshop is also available on 10 December 2012