±«Óãtv

Ìý

This page contains useful information for department heads and liaisons about interpreting the results, tenure and promotion, holistic evaluation, BLUE text Analytics (BTA)Ìýand faculty engagement.

Interpreting the results

Deans and department heads will receive individual reports for each instructor evaluated for a course listed under their departmentÌýor facultyÌýand a departmentÌýor facultyÌýmeans reports.ÌýÌý

The department head reports include the results of the core 7 quantitative questions, the departmental (course level questions) if added by the department and the written comments.

The deans’Ìýindividual reports includeÌýthe results of the coreÌý7 quantitative questions only. The deans do not receive any qualitative comments.

When interpreting theÌýresultsÌýyou should consider the following.Ìý

1. The class size: Smaller class sizes in general will receive higher score than large classes. Instructors only teaching large classes should not be compared to instructors teaching only small courses.Ìý
2. Trends over time: Look at results received over time. In order to take a comprehensive and meaningful look at anÌýinstructorsÌýteaching ability, you should look at results from multiple courses over multiple years. Research suggests that data should be reviewed from courses every term for at least two years, totalling at least five courses.Ìý(last sentence taken directly from McGill’s site)
3. Read the comments: Written comments can provide useful insights. Look for specific comments aboutÌýspecific teaching patterns. Look at comments about teaching behaviours that can be changed, try to ignore comments about personal characteristics.ÌýLookÌýall aspects of the reports;Ìýconsider the comments in relation to the quantitative results.ÌýÌý
4. Understand the statistics: Make sure you understand the statistics included in the reports.ÌýFor an explanation of the statistics pleaseÌýclick here.

Holistic evaluations

Student Learning Experience Questionnaires are an important part of assessing the quality of education an institution provides. At ±«Óãtv University, SLEQs are recognized as an essential component of aÌýformal institutional evaluation strategyÌýthat includes evidence from students (both SLEQ results as well as direct evidence of students' achievement of learning outcomes), self-reflection, and peer evaluation of teaching (including the peer review of teaching materials as well as possibly a peer observation of teaching), usually presented in the form of a comprehensive teaching dossier.Ìý

It is strongly recommended to collect multiple sources of evidence when including results in a teaching dossier, when reviewing the results for tenure and promotion procedures and when making any hiring or reappointment decisions.Ìý

Tenure and Promotion

Tenure and promotion committees use the SLEQ results each term as part of the process. When using the SLEQ for tenure and promotion, please consider all aspects of this site and more specifically the section on interpreting the results and Holistic evaluations Ìý

Blue Text Analytics (BTA)

Included on all departmental means reports are text analytics blocks which represent the comments received in allÌýSLEQ forms for your department. The resultsÌýhave been categorized intoÌýattributesÌýandÌýthemes.ÌýTheÌýwords displayedÌýon the reportÌýmay or may not have appeared in the SLEQ reports.ÌýBut the software has determined that a part of the comment was identified to represent the specific theme. These report blocks are supposed to allow department heads toÌýeasilyÌýsee how their department is doing. It also makes comparisons to your faculty and to the university. This by no means should replace the reading of the individual reports, it is only meant as an added tool and can be especially useful for departments with large numbers ofÌýwrittenÌýresponses.ÌýÌý

Also included is the agregated results of the SRCC questions added to the Fall 2021/2022 SLEQs.

Ìý[PDF - 182 kB] to see a more detailed description of the attributes and themes used by the BTA dictionary.

General BTA Dictionary - Attributes

[PDF - 123 kB]A subcategory within the attributes category. Themes within the positive subcategory are intendedÌýto identify aspects of a subject that the commenter views as an asset.

[PDF - 128 kB]A subcategory within the attributes category. Themes within the negative subcategory are intendedÌýto identify aspects of a subject that the commenter feels need improvement.

[PDF - 90 kB]Neutral is a theme within the attributes category. Comments classified as neutral by Text AnalyticsÌýmention feedback that is neither positive or negative. Only one theme is provided to captureÌýneutral comments so that the majority of comments are placed in themes in the arguably moreÌýuseful positive and negative categories.

Faculty Engagement

One of the best ways to get students engaged in the SLEQ process is to first get your faculty member engaged. Departments where the faculty members are engaged in the process regularly get above 70% in response rates.Ìý

There are definitely ways to help improve the response rate in individual courses and we speak about in in the instructor section if this website. As a department or faculty, there needs to be clear information, support and encouragement in order for faculty members to buy in to the process. Making certain that your department or faculty has clear guidelines on how the SLEQ result will be used, making sure that they are only part of a broader approach to evaluation. The SLEQ should never be used as the sole measure of teaching effectiveness. Removing as much of the stress around the process as possible will make instructors more willing to participate and encourage students to respond.