Raising Student Evaluation Response Rates

Student evaluations of teaching play a crucial role in professional and course development and in the personnel review process. If they are to be useful, it is important that the data they provide be as accurate as possible. Unfortunately, students are not always motivated to complete them, perhaps because they don’t realize their voice is valued in this process. It is also well-documented that response rates for online evaluations are lower than for in-person administration. There are concrete strategies available to increase participation; however, and research points to creating a positive classroom culture and having explicit discussions of evaluations and specific ways they have been/will be used to inform courses as particularly effective (Chapman & Joines, 2017). A summary of some additional techniques is included below.

  • Make an announcement about evaluations in person (if possible) and in your Canvas course. Do this at the beginning and near the end of the survey period. Be sure to explain why student feedback is important and give specific examples of how you have used it in the past to revise classes. If you are teaching online, you could accomplish this with a short video.
  • Provide some time in class or a space online for students to ask questions about evaluations and their uses at UWGB.
  • Allow students time in class to complete their surveys, making sure to leave the “room” when you do. You should not be present when students complete evaluations. If you do provide time, note that ending class early to do so may only result in students leaving. In online courses, you might factor additional time for evaluations into your calculations of workload for the week and let students know that.
  • Assure students that the surveys are anonymous. Reinforce the point by leaving the physical or Zoom room when the students take them.
  • Include the direct link or QR code for your specific course evaluation in the Canvas announcement. You might also attach this helpful Knowledge Base article so students know how to locate the surveys for all their classes or even show in-person students where to find the necessary information.
  • Put “Complete Course Evaluation” as a task in your Canvas shell and include it on the calendar so it shows up on students’ “To Do” list for the class.
  • Bring the topic of the evaluations up several times during the period they are open, so they remain top of mind for students, even if you’ve already allowed time to complete them in class.
  • Monitor overall response rates for your classes during the open period. Ethically, you cannot award credit for completing an evaluation, and remember they are anonymous. You can, though, make classes aware of response rates and even create a contest between course sections to see who can achieve the highest overall response rate by a specific date. Offer a non-tangible prize to the winning class, such as bragging rights or a choice on a final assignment.
  • Throughout the semester, foster an environment of open communication and respect with students, which may motivate them to see their feedback as valued and worth taking the time to provide for you.

Chapman, D.D., & Joines, J.A. (2017). Strategies for increasing response rates for online end-of-course evaluations. International Journal of Teaching and Learning in Higher Education, 29(1), 47-60. http://www.isetl.org/ijtlhe/

Distance Education Certificate and Course Enrollments (2022-23 AY & Summer 2023)

CATL is excited to announce that we are continuing the Distance Education (DE) Certificate program that launched last year! Instructors developing or reworking a course for any of UWGB’s distance education modalities are encouraged to participate and complete the full certificate.

The Distance Education Certificate consists of three courses which act as progressive steps in a sequence. Instructors will earn a digital badge after completing the first and second courses in the series, and the Distance Education Certificate after completing the third course. Qualifying instructors will also earn stipends after completing the second and third courses in the sequence.

Course Availability, Deadlines, & Compensation

Course 1: Learning and Integrating Technology for Education (LITE) 101

  • All full-time instructors will be automatically enrolled in LITE 101. The course will remain open indefinitely, and there is no deadline for completion.
  • Instructors working toward the DE Certificate who complete LITE 101 will be able to enroll in LITE 201 the following semester.
  • LITE 101 is not tied to a stipend.

Course 2: LITE 201 (Trail Guides)

  • Registration for the Summer 2023 cohort of LITE 201 is now open closed. Stay tuned for information on the Fall 2023 section!
  • Full-time instructors who complete LITE 201 within the 2022-23 academic year will qualify for a $750 stipend.*

Course 3: LITE 301 (Retreats)

  • Registration for the Spring 2023 cohort of LITE 301 closed Jan. 31, 2023. Stay tuned for informationon the Fall 2023 section!
  • Full-time instructors who complete LITE 301 within the 2022-23 academic year will qualify for a $750 stipend.*

*To receive compensation, participants must receive approval from their unit chair. Instructors that have already met their maximum overload payment for the contract period do not qualify for compensation.

If you have questions about these courses, please contact CATL at catl@uwgb.edu. If you have questions about compensation or the payment process, please contact Human Resources at hr@uwgb.edu.

The first course in the DE Certificate series is called Learning and Integrating Technology for Education (LITE) 101. This self-paced course includes information about the different course modalities offered at UW-Green Bay, as well as the technologies you might use for teaching in each one, including in-person teaching. This course also serves as the foundation of the DE Certificate series because it provides an overview of our specific distance education modalities and the technologies that will help you to be successful in them.

LITE 201: Trail Guides (formerly just called Trail Guides) picks up where the first course leaves off. LITE 201 course centers on developing learning pathways for students. This self-paced course is for you if you would like to explore how to develop distance education courses more systematically. Through LITE 201, you will develop a module for a distance education course. LITE 201 is self-paced but offered on a semester basis.

In LITE 301: Retreats (formerly just called Retreats), you will be encouraged to reflect on your own teaching practices. LITE 301 focuses on the process of using feedback, reflection, and scholarly teaching practices to refine classes. You will, for example, explore scholarship of teaching and learning (SoTL) literature relevant to issues in your course or to revisions or teaching innovations you are considering. You will also engage with several of your colleagues through synchronous and asynchronous activities designed to support your efforts in reflecting on and refining your teaching practices. LITE 301 is offered as a cohort-based, semester-long community of practice.

LITE 115 Course: Enhancing Course Videos with PlayPosit

Is there a teaching technology that you’ve heard CATL talk about but haven’t gotten the chance to try out yet? Want to learn a new tool alongside fellow instructors so you can swap ideas and tips? In addition to the three courses in the DE Certificate, CATL is offering supplemental professional development training courses that explore certain teaching tools and techniques in more depth!

Learning and Integrating Technology for Education (LITE) 115: Enhancing Course Videos with PlayPosit will equip you with the guidance you need to start building interactive videos, called “bulbs,” for your own courses. Work through each module at your own pace as you discover the basics of PlayPosit, build your first bulb, and finally implement PlayPosit bulbs in one of your courses. Participants will also learn how to monitor bulbs and use PlayPosit’s analytics to reveal data on student engagement and achievement that may be informative for planning future iterations of a course.

Prerequisites: None (though completion of LITE 101 is recommended)

When: Registration for the Summer 2023 section of LITE 115 is now closed. Please stay tuned for future sections of LITE 115 in Fall 2023!

Badges

Participants will earn a digital badge for completing each of the three modules in LITE 115 that you can include in your email signature or embed in online portfolios or resumes as evidence of your commitment to professional development! Participants will not be obligated to complete all three modules and may participate at whichever level fits their interest and capacity.

Questions?

If you have any questions about LITE 115 or PlayPosit in general, please contact CATL (CATL@uwgb.edu). You can also check out our blog resources on PlayPosit as well as a selection of step-by-step guides in the UWGB IT Knowledgebase.

Strategies for Creating “Generative AI-Resistant” Assessments

The use of generative-AI tools in education has recently garnered significant attention, placing educators in a unique position to consider their roles in higher education and how students engage with such tools. In a previous blog post, we introduced AI technologies and their endless capabilities, as well as potential implications for higher education. Additionally, we provided advice on considerations, precautions, and ethical concerns for using generative-AI in the classroom.

While some educators are excited about integrating AI collaboration into their teaching practices, others are apprehensive about its potential misuse by students. To address these concerns, this blog post presents assignment strategies that can be more “generative AI-resistant.” There are no “AI-proof” assessments, but these suggestions should serve as starting points for creating authentic assignments and/or ones that require demonstration of original and critical thinking.

Assessment Strategies

Be specific and personal

Consider creating assessments that involve tasks ChatGPT struggles to do such as referring to personal anecdotes or student reflections, referencing current events and recent field developments, or administering interviews or making references to specific course materials. Asking students to connect specific details from course materials (readings, lectures, experiments, etc.) to their personal lives or career paths can also help students see relevance in their course activities and engage with them on a deeper level.

Go beyond research papers

Instead of asking students to create a research paper that ChatGPT could do for them, ask students to create an annotated reference list that demonstrates their ability to apply proper research methods and analysis of resources collected. Alternatively, consider asking students to write a paper analyzing a case study that you’ve created yourself.

Mix up the medium

Incorporate assignments that make use of multimedia content such as creating, writing, recording, and producing a podcast episode relevant to course content and ideas.

Flip your classroom

Consider using in-class time for activities like classroom debates and/or peer-to-peer feedback on projects. Grade those efforts that are happening in real-time and under your observation (without generative AI). Note that a flipped classroom approach also allows students to practice higher order thinking and application of the content they’ve learned through homework.

Look at grading

Consider reviewing your course grading criteria and use growth-oriented rubrics that prioritize process over product.

Ask students to show their process

Consider adding assignment elements that ask students to think about the process of their work. This could be done by requiring students to submit notes they took on sources to prepare for their papers or presentations. You could also ask students to show their work in progress as they move toward a final draft (e.g., require submission of a project outline or proposal, annotated bibliography, and multiple drafts).

Allow for growth and resubmission

Consider adding in some flexibility when students fall short of an objective by allowing for revisions or resubmissions on certain assignments. This can reduce the “high stakes” nature of assessments and associated pressures.

Make adjustments to current assessments

Review your existing assignments to see if there are areas where you can have students demonstrate their holistic growth and development. For exams, you could add supplemental reflection questions or even consider adopting oral exams.

A Note on Academic Honesty

It can be easy or tempting to spend a lot of effort trying to catch instances of academic dishonesty using tools like ChatGPT. Although there are detection tools available, such as Turnitin, the effectiveness of AI detection reports remains uncertain due to insufficient data. Please review our blog on Considerations for Using Generative AI Tools to learn more and remember how important it is to communicate explicitly with students about if, when, and how they may use AI in your class.

How Can I Learn More?

CATL has curated a list of readings and additional resources about AI in education! If you have questions, concerns, or ideas specific to generative-AI tools in education and the classroom, please email us at catl@uwgb.edu or set up a consultation!

 

 

Considerations for Using Generative AI Tools

Staying updated on the rapidly evolving generative-AI tools can be challenging, and educators may hold divergent (and strong!) views about them. In a previous blog post, we introduced generative-AI technologies, their capabilities, and implications for higher education. While some educators are enthusiastic about incorporating AI into their teaching methodologies, others may harbor doubts, apprehensions, or simply lack interest in exploring these tools. Regardless of one’s stance, understanding the disruptive impact of these technologies is crucial as we grapple with their ethical and pedagogical implications as educators.

In this post, we will explore some considerations for using generative-AI tools in the classroom, including preliminary precautions and ethical concerns. The more we understand these technologies, the better we can adapt to maximize their potential benefits while minimizing their negative impact.

Things to Consider When Using AI-Powered Tools in your Courses

Understand the inevitability of advancing AI technology.

AI, like many other recent technologies (e.g., personal computers or the internet), will continue to advance and not go away. In fact, they will progress and become better than previous models. This is not something we can “outrun.”

Encourage dialogue on the impact of AI in education

Consider discussing AI technology and its implications with your department, colleagues, and students. In what ways will generative-AI tools change the nature of learning outcomes and even careers in your discipline? How are other instructors responding? In what ways can instructors support each other as they each grapple with these questions?

Provide clear communication with your students on expectations

Whichever camp or situation you may fall into, it is always important to provide students with clear expectations for their use of AI in the classroom. Be specific in your syllabi and assignment descriptions about where and when you will allow or prohibit the use of these tools. You should also make sure whatever guidance you provide is also consistent with UWS Chapter 14 and the communications from our Provost Office. For example statements, view our Syllabus Snippets related to generative-AI. 

Use generative-AI tools with caution

Exercise caution when using generative-AI tools because the information provided by them may not always be accurate. AI creators, like OpenAI, are upfront about the fact that ChatGPT’s answers aren’t always correct. Due to their ability to hallucinate facts and resources, it’s best to avoid using these tool as a primary source. Be sure to also watch out for potential bias that can appear in outputs by these tools as they are trained on human-generated data.

Offer alternatives for privacy-minded students

If you are asking students to complete an assignment using generative-AI technology, you will also want to provide an opt-out or alternative assignment because students may legitimately not want to provide personal information to sign-up and use certain AI technologies. Many tools openly state they will sell that information.

AI detection tools are not perfect

When using Turnitin’s AI writing detection indicator, it is important to note that there is currently insufficient data to validate its effectiveness. Therefore, results from such reports should be treated as signals that additional review may be necessary. If you suspect academic misconduct, be prepared to support the claim with additional information beyond the detection tool’s report.

Consider ethical and legal issues when using AI tools

As instructors, it is also important to consider the potential ethical, legal, and security risks of AI technologies. Many generative-AI tools are “trained” on the data we put into them, so we must exercise caution when providing prompts to the tools. For example, never put students’ personal information into an AI-powered tool, as this may violate FERPA. Asking students to submit their work (or doing it yourself) to get feedback from ChatGPT or a similar resource puts their intellectual property into the public domain. This should not be done without their explicit consent.

Prepare students to use AI effectively

If you assign tasks that require students to use AI technology, it is important to provide clear instructions about how to do so and not assume students already know. Consider incorporating a discussion on the benefits, limitations, cautions, and ethics of using generative-AI. This could be a valuable in-class activity.

Don’t get caught up in the smoke

Although the capabilities of generative-AI can be scary or worrying at this point, it is best to not get bogged down in the negatives of AI or focus on how to detect cheating through AI use. Are you worried about what AI tools mean for your course materials? Schedule a consultation with us. CATL is here to help!

How Can I Learn More?

CATL has curated a list of readings and additional resources about AI in education, as well as a blog post that explores strategies for creating more “AI-resistant” assessments. If you have questions, concerns, or ideas specific to AI-text generative tools in education and the classroom, please email us at catl@uwgb.edu or set up a consultation!