1. Scores and Submissions
2. Item Analysis
3. Student Submissions
4. Surveys and Evaluations
5. Raw Data

The Results screens produce reports of scores and student responses.

You can look at the results at any time. It is a good idea to look at the results soon after students start completing an activity to check that everything is working.

1. Scores and Submissions

The Scores and Submissions screen shows the scores for all students in one or more activities.

1. From the Main Menu select Scores and Submissions and click Proceed.

2. Select one or more activities.
   To see a report of all activities, click Select All Activities. This may take a long time if you have many activities, so it is usually better to select only the activities you want to see.
3. Check one or more ways to display the scores:
   • Percentage Scores: Display scores as a percentage from 0.00 to 100.00.
   • Fractional Scores: Display scores as the number of correct answers divided by the number of scored questions, e.g. 9/10.
   • Dynamically Graded Percentage and Fractional Scores: You only need to use dynamic grading to calculate scores if you have changed the answer key of one or more question items after one or more of the students have submitted the activity. (Otherwise it will be the same as the score that was computed at the time the activity was submitted.)
   • Number of Attempts: Display the number of times the student submitted the activity.
4. Choose to organize the results either in a table (for viewing and printing) or delimited by commas (for importing into a spreadsheet and uploading to a grade program such as Post'Em, Gradebook or SPSS).
5. Click Proceed.

You will see a table of results.

• The top row includes information about the activities:
  • Activity: the name of the activity
  • Scoring Method: how the student's score was determined from the student's submissions (first, max, average, or avfm)
  • Section(s): whether this activity was for one section, or ALL sections
• For each student, there is one row with at least the first two of the following columns:
  • Username: the student's username as it appears in the roster
  • Student Name: the student's last and first names
  • ID Number: the student's IU student ID number (or assigned password for non-IU students)
  • Section: the student's section number
  • % Score: the percentage score for this activity, calculated using the above scoring method
  • Fraction: the number of correct answers divided by the number of scored questions
  • % DScore and DFraction: dynamically generated scores, displayed in red
  • Attempts: the number of times the student has submitted this activity
    Zero scores do not count as attempts, since students often accidentally submit activities by pressing Enter before they answer any questions.
• N/A will be displayed for activities such as course evaluations that do not have scored questions, or for scores that cannot be calculated because the student did not complete the activity.

If you chose comma-delimited format,

1. Click File->Save in your browser.
2. Save as a text file, using the extension .csv.
3. Open the file in Excel, SPSS, or another spreadsheet or statistical program.
   If necessary, indicate that the file is delimited by commas.
4. Delete unneeded columns by clicking the column header cell and clicking Edit->Delete.
5. Move columns by clicking the column header cell to select it, holding down the shift, and dragging the edge of the column.
6. If you will be importing the file into Post'Em, save as a CSV (comma-delimited) file.

2. Item Analysis

The Item Analysis screen contains five different types of reports on student scores and question items.

1. From the Main Menu select Item Analysis and click Proceed.

2. Select the name of the activity.
3. Choose one or more of the five types of reports (see below for a description of each).
4. Choose Preserve to display student answers to essay questions exactly as students typed them, including whitespace (blank lines, tabs and spaces). Choose Ignore to remove the extra whitespace.
5. Click Proceed.

You will now see one of these five reports:

1. See answers grouped by student submissions:

   Key for event activity:

   • For scored questions, the key lists the correct answers for each question in the activity.
     Multiple-choice questions will have correct answers A, B, C, etc.
     Check questions are either T (true, checked) or F (false, unchecked).
     Other questions are either T (true, answered) or F (false, unanswered).
   • For unscored questions, the key lists the question types:
     s=select, r=radio, n=numeric, o=open, c=check, e=essay

   For each student is listed the student's last name, first name, username, PRE (present) or ABS (absent), and answers to each question.
   The student's correct answers are underlined.

2. See list of participating students and scores:

   For each student is listed the student's last name, first name, username, percentage correct, correct answers, and total questions.

3. See answers collected grouped by items:

   For each question in the activity is shown:

   • The question number as it appeared to students in the activity and the question type
   • The question ID number as it appears in the question file
   • The question topics
   • The text of the question as it appeared to students
   • The answer key (correct answer)
   • A table with three columns:
     • Key: a smily face appears next to the correct answer(s)
     • Answer: a possible answer
     • Count: the number of students who gave this answer

4. Traditional item analysis:

   This is similar to the three reports generated in the Old Item Analysis below.

5. Special report on OPEN questions:

   For each OPEN question, the answers to all student submissions are listed.

6. Old Item Analysis:

   The Item Analysis screen contains student scores, classifications, item difficulty levels etc.

   1. From the Main Menu select Item Analysis (Old) and click Proceed.

   2. Select the name of the activity.
   3. Choose one or more of the three types of reports.
   4. Click Proceed.

   You will now see one or more of the three reports.

   1. If you selected Examinees' Scores, Responses, Attendance
      you will see a table with the following information:
      • Student name: last name, first name, middle initial
      • Student ID: username
      • Att: whether the student attended or was absent
        Currently this is not used because the attendance feature is disabled.
      • Z_score: a statistical measure which compares scores with the mean
        A Z_score of 1.0 is one standard deviation above the mean.
      • Score: the percentage of questions answered correctly
        Only the score of the student's first attempt is shown.
        A score of N/A indicates the activity was unscored or untaken.
      • Good: the number of questions the student answered correctly
      • All: the total number of questions in the activity at the time when the student submitted it
      • STA:
        The three possible values are
        • ABS: The student did not submit the activity, so the score is absent.
        • EAD:
        • PRE: The student submitted the activity.
      • Answers: the student's answers to each multiple choice question
        Correct answers are underlined.
        An unanswered question is shown as a blank space.
        A question that was not available to the student when he or she submitted the activity is shown as a dash (-).
        An open question is shown as T for a correct answer and F for incorrect.
        (Actual responses to open questions are available on the Item Analysis screen under Item Statistics.)
   2. If you selected Frequency Distribution
      you will see the following information:
      • Average: The average score of all students.
      • Standard deviation: A statistical measure of the spread of student scores.
      • Number of scores: A count of how many students completed the activity and received a score.
      • List of scores in event ActivityName: A table of scores in descending order of score with the following columns:
        • A column displaying in which third of the class the student scored
          • U: upper third
          • M: middle third
          • B: bottom third
          • -: the student did not take the activity
        • Student Name: last name, first name, middle initial
        • Student ID: username
        • Score: the percentage of questions answered correctly
          Only the score of the student's first attempt is shown.
          A score of N/A indicates the activity was unscored or untaken.
        • Z: a statistical measure which compares scores with the mean
          A Z score of 1.0 is one standard deviation above the mean.
        • by_Z: The percentage above other students, using the Z score.
      • Score frequencies for the same exam: A table showing the number of students achieving each possible score
        • # of points: The percentage score.
        • # of students: A count of how many students received that score.
        • real: The percentage above other students, using half of the students with the same score.
        • by_Z: The percentage above other students, using the Z score.
   3. If you selected Item Statistics
      you will see the following information for each question:
      • Question #: the question ID number
      • Topics: the topics included in the question.
      • The question as displayed to the student.
      • Responses: messages displayed to students after the activity is submitted, if any.
      • Answer key: the correct answer, if any
      • The number of the question as shown in the student's activity.
      • The number of responses in the bottom, middle and upper third of scores, including whether the question was correct, wrong, left blank, or not seen by the student.
      • A table showing a count of each different response.
        A yellow smily face appears next to the correct answer.

3. Student Submissions

You can quickly look at all of the submissions and scores of one student on one activity.

1. From the Main Menu select Student Submissions and click Proceed.

2. Choose an activity and username and click Proceed.

You will then see a screen with the following information:

• Student: the student username
• Activity: the name of the activity
• a table with a row for each of the student's submissions of that activity, and three columns:
  • the submission number
  • Date: the date the activity was submitted
  • Score: the student's score, shown as a fraction of the questions answered correctly

4. Surveys and Evaluations

This report gives statistics on responses for each question.
It is often used to summarize surveys and course evaluations.

1. From the Main Menu select Surveys and Evaluations and click Proceed.

2. Activity: Select an activity from the menu, or type the name of an activity as it appears in your activity settings.
   You can summarize more than one activity if their names are similar by typing only part of the activity name. For example, if you want statistics for all the questions in activities quiz1, quiz2 and quiz3, type quiz for the activity.
3. Topic: Choose the topic from the list.
   To display results from all topics, just use the default : any :.
4. Section(s): Type the course section(s) for which you would like statistics.
   To display results from all sections, just use the default ALL.
5. Items: Choose whether to include essay and/or non-essay questions.
6. Norms: Choose the school or academic area where the statistics should be recorded.
   Norms should only be used for course evaluations, and only one time, when the course evaluations are completed. Otherwise, just use the default none.
7. Click Proceed.

The following information will be displayed for each question:

• For multiple-choice questions, there will be a table with a column for each possible response.
  • The first row is the total number of each possible response.
  • The second row is that total as a percentage of the number of people who took the survey.
  • The third row is that total as a percentage of all responses.
    This number will be higher if not everyone responded to the question.
    Note: % of total is not displayed for RADIO questions. This is a feature that we need to add.
• For check questions, a count of each student response is listed.
  (Percentages are not displayed, since respondents may check more than one answer.)
• For open and numeric questions, a count of each student response is listed.
• For essay questions, student responses are merely listed.

Note that only the student's first submission to any question is counted.

5. Raw Data

The Raw Data report displays student answers to questions as stored in QuizSite. This report is useful for searching or sorting the data or for importing into a spreadsheet or statistical package for advanced data analysis.

1. From the Main Menu select Raw Data and click Proceed.

2. Select from the following search options. By default, they will be set to ALL.
   • Student name: The student's last name as it appears in the roster, or any part of the student's name.
   • Student username: The student's IU Network ID username.
   • Section number: One of the section numbers listed in the course roster.
   • Activity name: One of the activity names listed in the activity settings file.
   • Topic name: The topic of the activity as listed in the activity settings file.
   • Question number: The question ID number as listed in the questions file.
3. Select from the following additional options.
   • Show submissions from the past n days: Only display data that students submitted less than n days ago.
   • Show responses to essay questions: Whether ESSAY questions are included in the report.
   • Show responses to non-essay questions: Whether questions other than ESSAY questions are included in the report.
   • Show responses to non-anonymous/anonymous questions:
     • To see scored quiz results, choose non-anonymous.
     • To see survey or course evaluation results, choose anonymous.
   • If not anonymous, sort by: name, activity, dateusername, activity, dateactivity, name, datedate
   • Display format: Choose to display the output of the search in an HTML table (for viewing and printing) or a comma-delimited text file (for saving and exporting to another program).
4. Click Proceed.
5. To see all data, you can just click Proceed without choosing any options, but it may take a very long time.
6. To reset the form, click Reset or Reload or Refresh in your browser.

The following information will be displayed:

• Username, Name, ID Number, Section, IP Number, Date, Activity, and Score are displayed for non-anonymous questions.
• Only Section and Activity are shown for anonymous questions.
• (The IP number is a network address consisting of four numbers separated by periods. The first three numbers are usually the same for all computers in a single room, so the IP number can be used to check whether all students attended class and completed an in-class activity in the same room.)
• The remaining columns are question numbers, sorted alphabetically for now, with non-essay questions first and essay questions second.
• One row of data will appear per student submission.
• Answers to CHECK questions are displayed as a comma-separated list.

If you chose table format, at the bottom of the screen will appear a summary of the raw data.

• The left table is for all the student submissions collected for this course in all semesters.
• The right table is for the student submissions that match your selection criteria.
• Each table includes a count of students, activities, questions (essay and non-essay) and submissions.

If you chose comma-delimited format,

1. Save the web page as a .csv file.
   • Click File, click Save As..., and type a file name.
   • In Internet Explorer, type the extension .csv, save as type text, and click Save.
   • In Netscape Navigator, type the extension .txt and then change the extension to .csv in Windows Explorer.
2. Open the file in Excel, SPSS or another statistical package.