Create a Scoring Event

1. From the Summary Tab in Create Assessment, select the Scoring Event checkbox to include the item as part of a Scoring Event. The user has the option to select multiple items or a single item from the assessment to be included in the Scoring Event. Users with appropriate permissions can create Item Bank assessments and mark the Constructed Response and/or Writing Prompt items that will be scored in a scoring event. This option will be available for online district-level or school-level Item Bank assessments.
2. Once the Scoring Event checkbox is selected, the system will display a warning for the user: Items selected to be scored in a Scoring Event will not be available in the Score Online screen for this assessment.

1. From the navigation bar, click on the Apps menu button (three horizontal lines/hamburger).
2. Select Scoring Event from the dropdown.

3. This will land you on the Manage Scoring Events page.
4. To create a Scoring Event, select the Create Scoring Event button.

1. On the Event Info & Assessment tab enter a name for the Scoring Event. Alternatively, you may select an assessment first (see steps 3 and 4 below) to have the Scoring Event Name field automatically take on the name of the selected assessment and then edit the name as needed.

2. Edit the Scoring Event Name as needed.
3. Select the filters to identify the Assessments to be selected for the Scoring Event.
4. Select the Assessment to include. Only assessments that have Scoring Event items and are currently not being used in a Scoring Event will be available for selection.

5. Once selected, assessment information appears in the Selected Assessment column.
6. Select Save and then Next to navigate to the Setup tab.

7. Scoring Event Window - Start and End dates that Staff are able to access and score student work.
8. # of Graders per Student: 1 (Single Scoring) - Allows one grader to score each student. Students will be single-scored.
9. # of Graders per Student: 2 (Double Scoring) - Allows two graders to score each student. Students will be double-scored and a Score Agreement must also be selected.
10. Blind Scoring - Set whether student information will be hidden when graders score student responses. Students will be assigned a Blind Scoring Student number for scoring event purposes.
11. Allow Scoring from Own School - Set whether graders can score students from within their school.
12. Require Scoring of Own Students - Set whether graders will be guaranteed to be assigned their own students to score.
13. Select Save and Next to navigate to the Graders tab.

Final Score Calculation

Score Agreement radio buttons for Perfect and Adjacent appear when # of Graders per Students = 2.

Average 

• Single-scored events
  • Grader 1’s submitted score is the final score (score is not doubled).
• Double-scored events
  • Grader 1 + Grader 2’s submitted scores are averaged into the final score(s).
• Grader 3 scoring for score resolution
  • If Adjacent and tolerence is not set, Grader 3’s submitted score is the final score (score is not doubled)

Sum

• Double-scored events
  • Grader 1 + Grader 2’s submitted scores are summed into the final score(s).
• Grader 3 scoring for score resolution
  • Grader 3’s submitted score is doubled to be the final score.

Score Agreement

Score Agreement radio buttons for “Perfect” and “Adjacent” appear when # of Graders per Students = 2. 

Perfect

• Require initial graders to assign a student the same score to be accepted as the final score.
• Grader 1 and Grader 2’s scores will only be accepted as the final score if both give the student the same score. 

Adjacent

• Accept variance in initial graders’ scores that are within the tolerance value to be the final score.

Tolerance

Selecting “Adjacent” as the Score Agreement displays a “Tolerance” show/hide toggle. Blue info icon displays:

Set Tolerance (score difference) values for the system to accept scores for final score calculation when different scores are submitted by Grader 1 and Grader 2 for a student. 

Toggling “Tolerance” to show displays a “Set Tolerance Values” table containing all WP and CR items from the assessment selected for the event. Table columns include Item #, Item Type, Tolerance Value. Items are listed in the order of item # from the assessment.

• Writing Prompt item Objectives: [value] Points
  • Users can set a tolerance for each objective of each WP item.
    • Default is 0.01 points.
  • Maximum value for tolerance accepted will depend on the max point value range for each objective for each item.
  • Each textbox is similar to that in the Score Online CR / WP Items screen (below): 
    • Hovering over “Obj. #” displays the objective name and point range.
    • Entering a value out of tolerance range outlines that textbox in red and a purple hover displays “Enter the value between 0.01-[max value]”.

Scoring Resolution Method

This setting appears below Score Agreement and Tolerance, if available, when “# of Graders” is "2 (Double Scoring)".

The event creator can select checkboxes for “Assign Final Grader” and “Discuss Scores with Previous Grader”. By default both will be selected. Users can deselect one but not both.

Determine whether scoring disagreements are resolved through another grader, or allow the initial graders to discuss a final score. Selecting both gives the secondary grader the ability to decide.

“Assign Final Grader” = The student will be assigned to a different grader from the first two graders to determine the final score.

“Discuss Scores with Previous Grader” = Grader 2 will be prompted to contact Grader 1 via email or other means beyond SchoolCity to discuss the scores they gave to the student. Both users will rescore the student for the items with rubric score(s) or WP item objective(s) that were not perfect match or within tolerance.

14. Use the filter option to reduce the number of staff users from the selection list.
15. Select the graders for the Scoring Event.
16. Once selected, select the + Add as Grader button.

17. As Graders are successfully added to the Scoring Event, the counter in the Graders tab will increment.
18. Select the Graders tab to review the selected Graders.

19. The listing of Graders is available for review and updating.
20. Selecting the checkbox to the left of the Graders name will permit a subsequent action on the Grader.
21. The user will be able to Remove the grader by selecting the Remove Grader button.
22. Once satisfied with the graders, select Publish to publish the Scoring Event.

After publishing the Scoring Event, the event will be available in the Manage Scoring Events page.