Evaluation by Staff

Evaluating Teachers' Experiences of Courses

Teachers who take part in any form of teaching within the medical curriculum are expected to consider how the courses with which they are involved are achieving what they set out to achieve.  We therefore expect that teachers look carefully at the course as a whole and also at their own teaching within it.  There are a number of ways in which teachers can do this:

Reflection
One of the key objectives of an evaluative approach to teaching in general is that it helps teachers to be reflective about their own practices.  While some forms of teaching evaluation are quite formal (see Teaching Evaluations and Peer Review, above), it is helpful if teachers also try to critically appraise their own practices informally.  They may do this in writing, using a logbook for example, or perhaps in conversation with another teacher or interested person.  Such deliberations are entirely private but may lead to further evaluative work as new ideas are implemented and tested.  The following are some ideas to guide teachers' reflection about their practice:
  • Notice what works and what doesn't
  • Consider why things work or don't
  • Analyse how your students respond to you and to the tasks
  • Consider ideas that might work better in the future.
Formal evaluations as a teacher
All teachers are encouraged to evaluate their own teaching using the instruments and procedures identified by HEDC in their document "Guidelines for the Evaluation of Teaching" (also available from http://hedc.otago.ac.nz/evaluation/index.asp). The HEDC document describes the process from planning through data collection to the eventual implementation of changes that may be made as a consequence of the evaluation.  The results of these evaluations also form part of the 'Otago Teaching Profile' which is a component of all academic applications for promotion and progression within the University.

There are other, less formal ways in which teachers can evaluate their own teaching.  More information and assistance is available from the Medical Education Adviser.

As a course convenor
Convenors play a key part in the quality of teaching delivered within the University as a whole, and it is important that they evaluate the quality of their own work within this.  Teachers who teach on the convenor's courses or attachments are in the best position to provide useful information about the co-ordination of the course and the role of the convenor in running it. The HEDC document "Guidelines for the Evaluation of Teaching" (also available from http://hedc.otago.ac.nz/evaluation/index.asp) describes the procedures that can be used to gather information from teachers about a convenor's work. Again, the intention is that this process should enable convenors to explore their own performance with a view to improving the quality of courses as a whole.  However, the data from these evaluations may also be submitted as part of the 'Otago Teaching Profile'.  Further information and advice is available from the Medical Education Adviser. Peer review is a term used to describe a wide range of evaluative practices undertaken with colleagues.  The HEDC document "Guidelines for the Evaluation of Teaching" (also available from http://hedc.otago.ac.nz/evaluation/index.asp) describes the approaches in more detail.  The intention is that it should be a collaborative process in which staff members work together to learn about and improve their teaching practice.  However, evidence of participation in the peer review process may also be submitted as part of the 'Otago Teaching Profile'.  Further information and advice is available from the Medical Education Advisor.

Closing the Loop

It is the responsibility of Course Convenors and the MEGs to respond to the results of evaluation. This may mean implementing changes in the running or assessment of a course or discussing an issue with an individual teacher. Change may not always be possible or advisable, perhaps for financial or logistical reasons. It is the responsibility of Course Convenors and committees to communicate these reasons and to discuss acceptable alternatives.

There is little point in undertaking and reporting the results of any evaluation if there is no subsequent change or development.

In time it is hoped that student evaluation data and module / yearly digests written by module convenors will be placed on the web both as a record and as a mechanism for ensuring reappraisal of courses in ongoing developments.

Reporting Process for Course Evaluation


Evaluation Documentation

An effective evaluation process needs to be well documented / reported and be transparent to all stakeholders. The stakeholders are students, module/course organisers, Associate Deans for Education, Heads of Department, Deans and relevant committees.

The following is a brief outline of the procedure for reporting course evaluation and thence to addressing any issues that have arisen from this report. The process of documenting and reporting course evaluation is detailed in the diagram below left.

Reporting process
The following is the expected process to be followed:

Convenors of a module or course receive feedback on the course through a variety of different means, including self reflection. The main source is formal student evaluation, however staff feedback is also considered relevant.

Group review meeting
Periodically, convenors consult with other members of a teaching team about the course or module in order to understand more about how it is running. Such meetings are a good opportunity to review the students' evaluations of their experiences of the course and to discuss performance in assessments. They are also an important opportunity to review the teachers' experiences of teaching on the course. Teachers may be able to provide some background information that sheds light on a student's comment for example, or they may have found that a key area of the curriculum is not being covered adequately to allow for students to deal with the assessments given.

These meetings are held towards the end of an academic year while there is time to discuss and develop changes for the following year. In addition, it is also advisable to meet at regular intervals during the year so that problems and successes can be identified in as timely a fashion as possible.

Informal discussion
Many issues relating to a course will become apparent through informal discussions with teachers as the course progresses. Convenors may choose to act immediately or to discuss the issue with other members of the teaching team before deciding whether further action is necessary. The Medical Education Advisers are also available to discuss any aspect of a course or its teaching and to offer support or advice where appropriate.

  Draft Module Evaluation Report – 18.7 KB