nus-scantron-mrq

Author: Min-Yen KAN [email protected]

Scantron Scantools Application and Conversion Profile for Multiple Response Questions for the School of Computing's Scantron Form

This file documents how to use the standard School of Computing Multiple Choice Question (50 Question) worksheet to be used for multiple response questions; i.e. "mark all responses that apply", as opposed to the simple "mark one only" multiple choice questions).

Steps for setting up the application

1. Launch ScanToolsPlus.

2. Find out the file paths under the menu option "File->Paths".

   

3. Take note of the filepath for Application and Profiles.

   

4. Using file explorer, copy the two files from this repo to the respective folders:

• Z556.SDS goes in Application folder from step (3).
• CS3244.$CP goes in Profiles folder from step (3).

Steps for using the application

1. First, launch the application.

   

2. Select the appropriate application and conversion profile. The application is "556 MCQ 50 (KanMY)" and the conversion profile is "cs3244" respectively. Add a new data file by clicking on the "create" button.

3. Load in your MCQ 50 forms with the reading barcode facing the input of the machine (that is, load the paper sideways). In my experience, loading small batches is good, as the machine can jam fairly easily. Don't feed crumpled papers; either do these again on another MCQ sheet on behalf of the original, or hand-enter them later (since it takes longer to fill in a new form than typing the results in for those that got stuck). After loading ... (wait for it ... wait for it) ... press "Scan"!

4. After scanning, your files will appear in the destination directory (which in this computer at the Equipment Room in SoC COM2 #02-63, is D:\SFW\results\.

5. After it completes, you can load in your CSV into Excel. The results should look like this, with a column for the Student ID, and columns for each mark all "MA" question 1 through 50. Each entry is "left-justified" such that the question will have nil (no response) or a substring of "ABCDE" in the entry.

6. I suggest that you convert the CSV file into an Excel spreadsheet so that you can do the scoring more comprehensively in the spreadsheet directly. Take a look at the sample Excel file MRQ Sample Marking Excel

7. For marks safety, I also suggest that you securely delete the marks file from your scan after you leave.

8. For MCQ (i.e., "mark one choice" vs. this "mark all responses"), please reset the application to the "555" application, scoring profile and conversion application. The "555" MCQ application has scoring pre-built against a key, whereas in this application, I have not yet set a scoring mechanism and prefer to do the scoring separately.

In-Frequently Asked Questions (iFAQ)

1. Can you use Multiple Choice questions on the form? Yes. The form allows you to do both.

2. Partial credits. Wai Kay suggests:

To me, an option is correctly answered if it is supposed to be shaded and student shades it, or it is supposed to be unshaded and student did not shade it.

Thus the marking scheme I use is:

• 3 marks for all 5 correct
• 2 marks for 4 correct
• 1 mark for 3 correct
• 0 marks otherwise.

This will give a random chance of around 25%, which is slightly more than 5 option MCQ. But less than 50% if taken as a set of T/F questions. Wai Kay: See Siddiqui NI, Bhavsar VH, Bhavsar AV, Bose S. Contemplation on marking scheme for Type X multiple choice questions, and an illustration of a practically applicable scheme. Indian Journal of Pharmacology. 2016;48(2):114-121. doi:10.4103/0253-7613.178836

3. Sample instructions. I suggest:

4. None of the above marking: Do we need to worry about having an option for "None of the Above"? Do we avoid the anomaly that a student who didn't have time to answer some questions still earning some marks for those unanswered questions.

I wouldn't be too concerned about this. No students will leave blanks in an MCQ if they run out of time. They would just randomly shade an option. Having MRQ with option E as "None of the above" will just result in this happening, and you would have removed 1 of the 32 possible combinations. With MRQ they would randomly shade 2 or 3 and hope for the best

True. To add,

• Using E is 'None of the above' actually makes it a 4-choice question, reducing legit combinations from 32 to 16?
• Yes, students do random shading for MCQ but with MRQ there is no need to randomly shade anything, as an unanswered question is 50% correct already (provided roughly half the options are 'false' options). Random shading does not improve those odds.

History

I (knmnyn) cloned the original 555 application that works for the same 50 MCQ response sheet and renamed it 556 to test out how it might work, hence the ID "556". gt Thanks to Terence Sim, Leong Wai Kay (@pottiepie), Damith Rajapakse (@damithc)for input for the iFAQ section.