±«Óătv

 

Assessment Design Recommendations


Reminder: These ideas are not in any way intended to be prescriptive – these are simply suggestions from our peers for ideas that have shown promise or worked for them. We acknowledge that there is no quick fix, and that upholding academic integrity takes effort.

Considerations for designing assessments

  • Use course learning outcomes to inform your assessments. What is it that students should know by the end of your course and how might they demonstrate this knowledge?

  • Focus on higher levels of learning. Rather than testing students only on foundational/basic knowledge, consider having them apply concepts to new situations, integrate across concepts, demonstrate the ability to compare and contrast, and so on.
    • Questions that require students to analyze, evaluate, and create are inherently more difficult to look up (Google, generative A.I.) online and easier to spot when multiple students provide the same response.
    • For further reading, see Waterloo’s Centre for Teaching Excellence article on .
    • For further reading, see , particularly in relation to course and assessment design considerations.
      Ěý
  • Incorporate choice when selecting the topic of an assessment, or randomly assign different topics to different students; this method can help to reduce the likelihood of unauthorized collaboration amongst students.

Question format

  • Create multiple-choice questions that rely on knowledge application rather than memorization.
    • Taking a concept and modifying it or applying it to an unfamiliar setting that wasn’t explicitly covered in lectures or readings can make it more challenging to look up the answer and gets at a deeper level of understanding from students.
      • For example: if testing about colour vision, rather than asking students to identify which type of cone receptor responds to long wavelengths, you could instead ask what might happen to colour vision if you were to remove one of the types of cones.
        Ěý
  • Give students examples of research designs, schematics, maps, diagrams, or other visuals and ask them to identify variables (e.g., what is/are the dependent variable(s) in this example) or components. This can be a great way to test understanding and isn’t something that can be easily looked up online.

  • Consider using a multi-select question format to ask a combination of true-false statements.
    • This allows for more nuance than a typical multiple-choice question that only allows for one true or one false statement (e.g., “Which of the following statement is TRUE?”). Using a multi-select format allows you to ask, “Out of the five (5) statements below, select all TRUE statements”.
    • For , you can choose to grade “all or nothing,” “right minus wrong,” or “correct answers only.” To locate the correct answer to this question on the internet or in a textbook, students would need to look up every single option to determine the correct set of responses.
      Ěý
  • Consider using “analogy” questions to test students’ understanding of the relationship between concepts.
    • For example, if testing the concept of transduction (converting sensory stimuli into neural signals), a question might be:

Photoreceptors are to vision, as ________ are to ________.

a) hair cells; audition
b) hair cells; olfaction
c) papilla; taste buds
d) cilia; hair cells


(Students need to understand that photoreceptors are the cells responsible for transduction in vision and which of the answers has a pairing of the cells responsible for transduction and the corresponding sense.)

Open-book or take-home exams

Typically, open-book (or take-home exams) are assessments that rely on high-order thinking such as analysis, synthesis, and evaluation (rather than recall or recognition), and in which students are generally permitted to consult reference/resource materials. However, the exact definition and corresponding rules and regulations around these types of exams can vary widely.

  • Provide clear and explicit instructions of what is permitted or disallowed. Definitions of open-book and take-home exams vary across faculties, departments, and course instructors, so it is therefore essential that all course instructors provide clear guidelines to students about acceptable resources, references, supports, etc.
    • Considerations: as you think about what is permitted and or disallowed in your course, it is worthwhile to be explicit on your syllabus and in your communications with your students your responses to each of these questions:
      • Are students permitted to access materials posted to their Brightspace course space when completing the exam?
      • Can students discuss their ideas/responses with each other prior to exam submission?
      • What constitutes “unauthorized collaboration”?
      • Are there sites/resources students can/cannot turn to for support for the completion of their exam (e.g., tutors, writing support, “homework” websites, generative A.I., etc.)

Alternative assessment options

The idea of an “alternative” assessment is to replace traditional (often multiple-choice style) tests with assessments that are more resistant to integrity infractions. Typically, this is because alternative assessments rely on personal connections and interpretations of specific course content, encourage creativity and innovation from students, and/or require students to demonstrate their process from beginning to end. It must be acknowledged that some of these options are not scalable for large classes, but they may prove useful in some courses (either as replacements for traditional tests or in addition to tests to spread out the composition of final course grades).

There are many options for alternative assessments; below is a sampling of ideas but more suggestions can be found in the links at the bottom of this section.

Infographics or mind-maps

  • Creating infographics or mind-maps requires students to identify key points and distill information into only the most essential pieces. It also fosters student creativity and requires students to present concepts in multiple formats (i.e., using text and image).
  • Reading:
  • Reading: Drawing Ideas:

Short presentations

  • Consider allowing students to choose their presentation topic from a pre-set list. Create clear guidelines and provide students the rubric ahead of time. Emphasize clarity, content, and audience engagement. A one-page presentation proposal can help ensure that students stay on-track, meet assignment expectations, and avoid relying heavily on additional help to create the final product.
  • When considering adopting presentations as an assessment tool, keep in mind that there may be students in your class for whom this is a particular issue. If you have any concerns regarding accommodations for this option, contact access@dal.ca.

Scaffolded assignments

  • Designing assessments that “build” on each other can foster student learning and reduce integrity infractions. Students can submit portions or outlines of their work for formative feedback and use the feedback for future iterations of their assignment. This approach may be especially useful in writing-intensive courses.
  • To ensure students are not merely breaking down a purchased paper, you could insist on a reflective piece (or paragraph) noting the reasons or rationale for part of the paper. For example, why did the student decide to discuss subtopics A, B, and C under a topic? Instructors can see the progression of thought and understanding for individual students and become familiar with their writing style and voice.
  • Reading: .

Podcasts

  • Audio recordings allow students to explain their understanding in their own voice. The lack of video/imagery forces students to focus on the content and clarity of their presentation (and no webcam is required).
  • Reading
  • When considering the use of podcasts, keep in mind that there may be students in your class for whom accessibility is an issue. If you have any concerns regarding accommodations for this option, contact access@dal.ca.

Video creation

  • Asking students to create videos for course assessments shifts the role of the student from consumer to producer. It allows students to be creative, present their understanding using multiple formats (e.g., text, imagery, animation, etc.), and gain valuable communication-based skills.
  • Instructors may consider having students create videos that they then use in future iterations of the course (e.g., demonstrations of techniques, explanations of challenging concepts), summarize their understanding of a particular concept, or create content for community groups outside of the classroom (e.g., local grade-schools).
  • Grading tip: Peer-evaluation can work very well when assessing student-created videos.
  • Reading
  • When considering the use of video creation, keep in mind that there may be students in your class for whom accessibility is an issue. If you have any concerns regarding accommodations for this option, contact access@dal.ca.

Design an experiment

  • In STEM fields, instructors may ask students to design an experiment that focuses on a concept/idea from class. Depending on the level of the course, students might be expected to design an experiment, identify any confounding variables or limitations, hypothesize outcomes, and so on. This approach might work well in the social sciences and health fields, as well.
  • Additionally, a peer-review element could be added, requiring students to provide feedback to each other about the quality of their design. Peer reviews should be structured in that instructors should give reviewers guidance on what to look for and what to comment on.
  • Reading
  • When considering the use of experimental design, keep in mind that there may be students in your class for whom accessibility is an issue. If you have any concerns regarding accommodations for this option, contact access@dal.ca.

Conduct an experiment

  • Course instructors can generate a series of questions for students to consider. These can be somewhat individualized and allow instructors to assess student understanding based upon student selection/input.
  • For example, the question could ask the student to drop a paperclip from a higher point and ask them to say how high, rather than specify the height exactly.

Project-based and group-based assessments

  • Project-based (and group) assessments require students to work together towards a common goal. Through these types of assessments, students can develop valuable communication, collaboration, time-management, problem-solving, and critical-thinking skills.
  • Reading: .

Self-reflection or personalized assignments

  • Asking students to reflect on their own experiences or learning, helps students to create deeper learning experiences, can increase instructor-student rapport, and can give course instructors insight into where students might be struggling.
  • Personalized assignments ensure no two students are submitting the same assignment and can help to showcase students’ thought processes, reasoning, and rationale.
  • Reading
  • Reading: