Generated OMR Reports
Below is a list of the OMR generated reports which are found in the .rtf file (and PDF if you choose to have it in PDF format as well).
Report #1: Original Order of Test Sheets
- Shows the original order the tests were read into the scanner to provide you with quick access to any test in the stack
- Useful for checking individual answer sheets for accuracy and/or errors
Report #2: Instructor Information
- Shows the following Scoring Options that were selected on the Info, Weight, and Key Sheet
- Course Number (if entered)
- Grading Rule: Conventional or Weighted
- Order of Summary Report: Alphabetic or Numeric (Student ID)
- Number of copies
- Number of Questions
- Shows the Question, Key Answer to the Question, and Weighted Score of the Question
Report #3: Test Analysis & Distribution
- Shows the number of questions, the number of exams graded, the subjective points possible, total points possible, mean, median, mode, standard deviation, and the Kuder-Richardson reliability scores (KR-20 and KR-21)
- Overall class performance is illustrated with a histogram showing frequencies and percentiles for each score obtained on the exam
Report #4: Frequency Distributions
- Shows the simple counts of how many students selected each choice for each questions
- Shows the number of invalid and omitted responses for each question
- When the "AND" or "OR" options are used, the number of people answering combinations is displayed, although the actual combinations are not
Report #5: Item Analysis
- An analysis of the individual items on the exam
- The class is divided into thirds based on the overall test scores of students
- For each question, the percentage of students from the upper third selecting each choice is compared to the percentage of those from the lower third who picked that choice
- The correct answer is denoted by the letters CR for single correct answers and by the correct combination for combination answers
Tips on the Item Analysis Report:
- A well-written exam item should have responses in all or nearly all of the possible choices. When no student in the class picks a choice, then it is not a good distractor. The choice had the same effect as if not there. You may also want to check that many of the students in the upper third do not flock to any one wrong choice. This often indicates a poorly worded choice or one in which the distinction between the right and wrong answer is not clear - even your "good" students were confused on the point covered.
- Items should discriminate between the students in the upper and lower thirds of the class. If all items cover the same general topic, then the number of students in the upper third who correctly answer a question should be greater than or equal to those in the lower third who correctly answer the same question.
- The item discrimination index shows this relationship using the following formula: (U - L)/ N where U is the number of students answering correctly in the upper third, L is the number of students answering correctly in the lower third, and N is the number of students in a third. A negative score means students who did poorly on the test did better on this item than those who did well -- this item probably needs to be rewritten. A score below .20 suggests there is low discrimination power, and the question may need examination. Ideally, you should have a variety of indices covering the .2 to .8 range.
Report #6: Individual Scoring
- Detailed information on each student taking the test
- Shows the student's name, identification number, weighted percentage score, weighted correct score, number of omitted questions, and individual subjective points obtained are displayed, and the student's answer to each question on the test is indicated
- A $ symbol is printed for each correct answer
- If an answer is incorrect, the response chosen is printed
- NOTE: An asterisk (*) appears for each answer that could not be read by the scanner for both the 5-choice and 10-choice, single correct answer exams. This is usually due to more than one answer being chosen on a single-response test or to stray marks on the page
Report #7: Student Summary
- Shows the Student ID number, sorted in ascending order, is printed on the left side of the page
- Student names are printed on the right side of the page if Question #3 on the INFO sheet was filled win with A
- Shows the unweighted number of questions answered right, wrong, and omitted, the subjective points obtained, the weighted points, and the weighted percentage are displayed to the right of each Student ID number
Report #8: Student Report
- This report will only be provided if Question #10 on the INFO Sheet is filled in with A
- Report #8 does not have a report heading like the above reports, it immediately follows Report #7: Student Summary
- The report is a condensed report that can be distributed to each student so they can see their results
- The report shows the student's name, score, and which answers were correct or incorrect
- Correct answers are shown with the $ symbol and incorrect answers are shown with the student's chosen answer