HEDC's evaluation service generate 3 standard evaluation reports:
- Individual teacher summary report – a summary of responses to the same 5 closed questions that have been used to appraise teacher performance for the last 15 plus years.
- Paper/course student evaluation report – a detailed summary of all questions asked.
- Coordination of tutors/demonstrators summary data report – a summary like the individual teacher report albeit for coordinators seeking feedback from the staff they supervise.
By default, reports are returned to the person requesting the evaluation (unless they are ordering on behalf of someone else, in which case the someone else receives it) and the head of department (or equivalent) via the email address that has been entered in the 'Email results to HoD' field on the request form. Additional people for reports to be distributed to can be noted in the 'Final notes' field of the request form.
All 3 types of evaluation reports display the percentage of respondents who chose different options for each of the closed, rating-type questions. By default, the left end-point descriptor on each 5-point Likert scale reflects the most positive response and the right end-point descriptor the least positive. To report an overall impression, percentages are combined for the two left-most responses (1s and 2s) to summarise the most positive responses, the 3s reflect the middle response, and the two right-most responses (4s and 5s) combine to summarise the least positive responses.
The paper/course evaluation report provides the most detail (see figure 1). It displays the:
- Number of responses to each of the 5 rating options
- Number who did not respond to the current rating question but did respond to other rating questions (counted as NIL responses)
- Percentage of responses to each 5 rating and NIL options (shown as ‘Distribution 1’)
- Percentage of responses when combining the most (1s and 2s) and least (4s and 5s) positive options (shown as ‘Distribution 2’)
- Interpolated median, or median where more appropriate (shown as ‘Median’)
Figure 1: Paper/Course evaluation report template (partial)
Percentages that don’t add to 100
Rounding errors may explain why percentages add to 99 or 101 instead of 100.
Percentages may also add to less than 100 to reflect NIL responses which are not explicitly recorded on either the individual teacher or coordinator reports. For example, if everyone in a class of 10 responded to question 1 but only half responded to the other 4 questions, and all gave positive responses to questions 1, 2 and 5, an individual teacher report would show 100% 1s and 2s for question 1 and 50% 1s and 2s for questions 2 and 5 (see figure 2). To show 100% 1s and 2s for questions 2 and 5, instead of 50%, would hide the fact that half of the respondents failed to answer the question. For this reason, the values shown are proportions of all who have responded to any of the rating-type questions.
Figure 2: Individual teacher report template (partial)
Reporting different response rates for the same evaluation
Since 1 April 2016, HEDC has begun providing both paper/course and individual teacher reports for questionnaires that include the 6 core questions (5 rating and 1 comment). In rare circumstances, the headline response rates on these reports may differ even when they summarise the same questionnaire. This is because the individual teacher report only summarises responses to the 5 core rating questions, whereas the paper/course report also summarises online comment data. For example, if 9 students in one class complete the ratings questions and 1 student completes only the comments questions, the number of responses on the individual teacher report would be 9, to reflect the number of students who responded to rating-type questions. In contrast, the number of responses on the top of the paper/course report would be 10, to reflect the number of students who responded to any of the questions.
The paper/course report counts comments-only respondents because, unlike the individual teacher report,
(a) it explicitly details the number of responses to each ratings question (which, in this example, would be 9 and match the count in the teacher report), and
(b) it may be summarising questionnaires that only contain comments questions, and if it didn’t count them, these paper/course reports would always show zero responses irrespective of how many actually gave written feedback.