Assessment Results – Crowdmark https://crowdmark.com Online Grading Software for Instructors Mon, 27 May 2024 13:16:41 +0000 en-US hourly 1 https://crowdmark.com/wp-content/uploads/2022/10/favicon.png Assessment Results – Crowdmark https://crowdmark.com 32 32 What do students see? https://crowdmark.com/help/what-do-students-see/ Tue, 04 Jul 2023 03:07:40 +0000 /?post_type=help&p=10119

When you email your students the links to their assessment results, each student will be able to see images of his/her own assessment, with scores, feedback, and any other information you’ve chosen to include. Students will not see the cover pages of administered assessments as they contain personally identifying information.

If you change a student’s grades or feedback after results have been sent, for example if a re-grade is requested or work is added, the changes will happen in realtime on the student’s score page.

How can I see a student’s score page?

  1. In your assessment’s Dashboard, click on Students in the sidebar.

  2. You will see a list of students. Locate the student, then under the three dots menu on the right hand side, click Score.

  3. A page with the student’s scores and feedback will appear.

  4. If you have added an assessment summary message and/or chosen to include the Distribution of scores graph, the score page will have a Summary section at the top.

]]> Locking an assessment https://crowdmark.com/help/locking-an-assessment/ Thu, 29 Jun 2023 22:42:19 +0000 /?post_type=help&p=10020

Instructors have the ability to lock and unlock an assessment at any time. Locking an assessment makes it read-only, ensuring that scores and feedback cannot be changed once grading and regrading are complete. Assessments must be unlocked for grading.

Locking an assessment does not remove students’ access to work that has been graded and returned. However, it does block students from submitting, as well as prevent students from accessing their submissions before the grading process starts.

Locking an assessment

  1. Navigate to your assessment’s settings page in the lefthand sidebar.

2. Select the Lock assessment button.

]]> Exporting a list of assessment grades https://crowdmark.com/help/exporting-a-list-of-assessment-grades/ Thu, 29 Jun 2023 22:37:55 +0000 /?post_type=help&p=10015

Once you’ve finished grading, you can download a list of grades. The downloaded CSV file can be opened as a spreadsheet and edited in a program like Excel or Google Sheets, or imported to your LMS’ gradebook. The grades CSV includes columns for:

  • Links to students’ assessment results
  • Name
  • Email address
  • Student ID
  • Grades by question
  • Question version (Randomized question groups only)
  • Submission time (Assigned assessment only)
  • Lateness penalties (Assigned assessment only)
  • Submission status (Assigned assessment only)

You can also export grades for all assessments in a course at once. See Exporting a list of course grades for more information.

Exporting assessment grades

  1. Navigate to your assessment and click Results in the sidebar.

  2. Click the Export CSV button in the Export data section.

    Here’s an example of a grades CSV from an Assigned assessment:

See also

]]> Understanding multiple choice analytics https://crowdmark.com/help/understanding-multiple-choice-analytics/ Wed, 28 Jun 2023 21:56:07 +0000 /?post_type=help&p=10006

You can view analytics about scores and responses as well as question and distractor quality on any assessment that uses Crowdmark’s multiple choice bubble sheet. After booklets have been matched to students and the assessment has been graded you can view the analytics by navigating to the Results page of your assessment and clicking the Multiple choice analytics button.

Scores

The Scores page displays statistics for the total scores on the multiple choice component of your assessment. You can also download the data as CSV files to analyze question and student responses.

  • Number of students: The total number of students matched to a graded assessment.
  • Average score: Mean total score
  • Median score: Middle score when the total scores are sorted from lowest to highest
  • Lower quartile: Middle score of the lower half of scores when sorted from lowest to highest
  • Upper quartile: Middle score of the upper half of scores when sorted from lowest to highest
  • Highest score: Highest total score
  • Lowest score: Lowest total score
  • Standard deviation: Measures the amount of variation in the total scores sn=1ni=1n(xi-x)2

    where n is the number of students, xi is the total score for student i and x is the average total score on the test

Question data export

From the Scores page, you can download a CSV file of data for each question. The following statistics are available in the export:

  • Percent answered correctly: Percent of students who answered the question correctly
  • Class: Percent of all students who answered the question correctly
  • Top 27%: Percent of students who answered the question correctly in the top 27% of scores when total scores are sorted from lowest to highest
  • Bottom 27%: Percent of students who answered the question correctly in the bottom 27% of scores when total scores are sorted from lowest to highest
  • Average Score: Mean score on question
  • Standard Deviation: Measures the amount of variation in the question score
  • Point biserial: Measures how well the question discriminates between high and low scoring students. Point biserial less than 0.2 should be rejected or improved by revision
  • Response Frequencies: Percent of students who selected each response (A, B, C, D, E, or x for no response)
  • Answer Key: Correct response or responses to question
  • Non-Distractors: Response(s) to question not selected by any students.

Student data export

From the Scores page, you can download a CSV file of data for each student. The following statistics are available in the export:

  • Scores: Score on each multiple choice question
  • Total Score: Total score on all multiple choice questions. Total score has a minimum value of 0. If the sum of the scores produces a negative value, Crowdmark will record it as 0.
  • Responses: Selected response for each question (A,B,C,D,E, or x for no response)

Questions

For each multiple choice question on your test, Crowdmark displays a bar chart showing the frequencies of each response and of no response selected (denoted “x”) on the Questions page. Hovering over one of the green bars will show you the percentage of students who selected this response. The correct response for the question is typed in bold and the corresponding bar is highlighted in darker green.

Diagnostics

The Diagnostics page summarizes your multiple choice questions in terms of difficulty, discrimination and distractors. Often referred to as item analysis, these diagnostics give you insight into your individual multiple choice questions as well as some test-level statistics to help you determine the quality of your test. Crowdmark highlights your most difficult and easiest questions, questions that are most and least effective at discriminating between your best and worst performing students and questions that include functional and nonfunctional distractors.

  • Difficulty: The difficulty of a question is determined by computing the percentage of students who answered the question correctly.

    Crowdmark classifies questions as easy when more than 70% of students answer correctly and difficult when less than 30% of students answer correctly.

  • Discrimination: The discrimination of a question refers to the correlation between student responses to a particular question and total scores on the test. Crowdmark uses the Point Biserial coefficient, denoted by rpb, to calculate the discrimination of the correct response to each question using the formula: rpb=(M1-M0sn)pq

    where M1 is the mean test score for the group who answered the question correctly, M0 is the mean test score for the group who answered the question incorrectly, sn is the test standard deviation, p is the proportion of students who answered the question correctly and q is the proportion of students who answered the question incorrectly.

    A positive point biserial coefficient for a correct response indicates that those who scored well on the whole test answered the question correctly. Generally, the correct response for a point biserial greater than 0.40 is a very good discriminator and less than 0.2 should be rejected or improved by revision.

    Point biserial correlation coefficients can also be calculated for each incorrect response (distractor). A question should have a negative point-biserial discrimination for each of its distractors. This means that the incorrect responses were selected by the weaker students.

  • Distractors: Distractors are the incorrect responses to a question.

    Crowdmark classifies questions as poor distractors poor when an incorrect response to the question was selected by less than 5% of students or the incorrect response was selected by top performing students.

    Crowdmark classifies questions as having good distractors when all incorrect responses are chosen by at least 5% of the students and incorrect responses are selected by weak students.

High-level statistics

  • Distractor quality: Distractors are the incorrect responses to a question. For example, if the correct response to a question is B, then the distractors would be A, C, D and E. A good distractor is one that was selected by students with low achievement. Crowdmark measures the distractor quality of the overall test by calculating the percentage of good distractors on the test. Crowdmark classifies a good distractor as having a frequency of response of at least 5% and discriminating towards students with a lower total score. Crowdmark uses the point biserial coefficient to calculate the discrimination correlation of each distractor.

  • Reliability coefficient: Measures whether the test as a whole discriminates between higher and lower performing students. Crowdmark uses the Kuder-Richardson 20 coefficient (KR-20) to calculate the test reliability, which we will denote by r in the formula below.

    r=nn-1(1-i=1npiqi2)

    where n is the number of questions, pi is the proportion of students who answered question i correctly, qi is the proportion of students who answered question i incorrectly and sn is the test standard deviation.

    The KR-20 coefficient typically ranges between 0 and 1 but it is possible to obtain a negative value with small sample sizes. The closer to 1 the more reliable an exam is considered because its questions do a good job consistently discriminating among higher and lower performing students.

    The interpretation of the KR-20 depends on the purpose of the test. Tests intended to distinguish between students who have mastered the material and those who have not should have a reliability coefficient of 0.5 or higher. A test with a KR-20 value less than 0.3 is considered poor. If the purpose of the test is to ensure that all students have mastered essential concepts, then the KR-20 value should be close to 0.

Sources:

]]> Returning graded assessments https://crowdmark.com/help/returning-graded-assessments/ Wed, 28 Jun 2023 21:10:18 +0000 /?post_type=help&p=10001

After the grading is complete, an Instructor or Facilitator can return student work with scores and feedback online. To do this:

  1. Navigate to your assessment and click Results in the sidebar.

     

  2. Click the Return grades button.

     

This will send an email to each student containing a link to their score page, which includes their work, scores, feedback, and any other information you’ve chosen to include.

You can send a message to your students and choose whether or not to include the class results graph by clicking Edit beside Student view settings. You can change these settings anytime and students’ score pages will be updated automatically.

For more information about the score page, see What do students see?

]]> Sending a message to students after grading https://crowdmark.com/help/sending-a-message-to-students-after-grading/ Wed, 28 Jun 2023 20:48:51 +0000 /?post_type=help&p=9993

When you send grades to students, you have the option to include a message that will appear on their score page when they view their results. The message can be edited anytime and will be automatically updated on all score pages.

Adding a summary message

  1. In your assessment’s Dashboard, click on Results in the sidebar.

  2. Click the Pencil icon beside Assessment Summary Message.

  3. Enter a message and click Save. 

     

]]> Downloading student work and results https://crowdmark.com/help/downloading-student-work/ Mon, 30 Jan 2023 15:00:00 +0000 /?post_type=help&p=6788

There are a few ways to download student work to your computer. Instructors and Facilitators can download graded booklets in PDF format for a specific student, or in bulk for a class. They can also download CSVs of grades by question, and students’ text responses. Ungraded pages of student work can be downloaded by Instructors, Facilitators, and Graders while grading.

Bulk downloads of student results

In the Results tab of the assessment, Instructors and Facilitators can download student results to keep for their records. When you land on the Results page, scroll down to the Export data section.

These results come in multiple formats:

  • Grades: Download grades to import into your LMS’s gradebook. This can be used to import into a gradebook, or for any other type of record keeping or data manipulation. Select Export CSV to generate a spreadsheet of student grades by question. See more details here.
  • Graded Student Work: Download graded assessments for all students. Select Export PDF to open a modal window, and click Export as PDF. When your export is ready, you will receive a notification email with a zip file containing each student’s submission in PDF format.
Pro tip: student work can be downloaded from this tab at any time before, during or after grading.

Bulk downloads of student work

In the Grade tab of the assessment, Instructors and Facilitators can download various formats of any available Text responses for additional grading or to keep for their records. From the side bar select Grade and scroll down to the Export data section. For bulk downloads of Administered assessment booklets, or Assigned PDF or Multiple choice responses, use the Graded work download in the Results tab. These results also come in multiple formats:
  • Student answers: Download answers to text response questions. Select Export CSV to generate a spreadsheet of students’ typed responses in the assessment by question. This spreadsheet also contains links to individually-downloadable attachments.
  • Student file uploads: Download files attached to text response questions. Select Export ZIP. This opens a modal window with two options to choose from:
  • Files organized by student email, then question label. This generates multiple folders of students’ attachments in text response questions, labelled by student email. Each folder contains sub-folders of students’ attachments from the assessment, labelled by question.
  • All files in a single folder generates a folder of students’ attachments in text response questions. This file contains all attachments from the assessment, labelled by student email and question.

Note: group assessment downloads will be labelled with the email address of the first student in the group.

Downloading or printing an individual student’s graded booklet

Instructors and Facilitators can download a student’s graded booklet by saving the student’s view of their graded work as a PDF file or printing it. Students can also do this.

  1. Navigate to your assessment and click Students in the sidebar.

  2. Search for the student whose booklet you wish to download.

  3. Click the Score link for the student under the three dots menu on the far right. The student’s view of their graded work will appear.

  4. Click the Print link below the assessment name. Your browser’s print dialog will appear.

  5. This next step differs depending on your browser and operating system. There should be an option such as “Print to PDF” or “Save as PDF” you can select to download a PDF file or you can print the pages.

Downloading ungraded student work

Anyone who has access to grading can download pages of student work without the grading and question labels.

  1. While grading, click the sidebar icon in the lower left corner. This will open a drawer with a thumbnail view of the pages.

  2. Drag the page(s) to your desktop or a folder to save them to your computer.

]]>