Strategies for Creating “Generative AI-Resistant” Assessments

The use of generative-AI tools in education has recently garnered significant attention, placing educators in a unique position to consider their roles in higher education and how students engage with such tools. In a previous blog post, we introduced AI technologies and their endless capabilities, as well as potential implications for higher education. Additionally, we provided advice on considerations, precautions, and ethical concerns for using generative-AI in the classroom.

While some educators are excited about integrating AI collaboration into their teaching practices, others are apprehensive about its potential misuse by students. To address these concerns, this blog post presents assignment strategies that can be more “generative AI-resistant.” There are no “AI-proof” assessments, but these suggestions should serve as starting points for creating authentic assignments and/or ones that require demonstration of original and critical thinking.

Assessment Strategies

Be specific and personal

Consider creating assessments that involve tasks ChatGPT struggles to do such as referring to personal anecdotes or student reflections, referencing current events and recent field developments, or administering interviews or making references to specific course materials. Asking students to connect specific details from course materials (readings, lectures, experiments, etc.) to their personal lives or career paths can also help students see relevance in their course activities and engage with them on a deeper level.

Go beyond research papers

Instead of asking students to create a research paper that ChatGPT could do for them, ask students to create an annotated reference list that demonstrates their ability to apply proper research methods and analysis of resources collected. Alternatively, consider asking students to write a paper analyzing a case study that you’ve created yourself.

Mix up the medium

Incorporate assignments that make use of multimedia content such as creating, writing, recording, and producing a podcast episode relevant to course content and ideas.

Flip your classroom

Consider using in-class time for activities like classroom debates and/or peer-to-peer feedback on projects. Grade those efforts that are happening in real-time and under your observation (without generative AI). Note that a flipped classroom approach also allows students to practice higher order thinking and application of the content they’ve learned through homework.

Look at grading

Consider reviewing your course grading criteria and use growth-oriented rubrics that prioritize process over product.

Ask students to show their process

Consider adding assignment elements that ask students to think about the process of their work. This could be done by requiring students to submit notes they took on sources to prepare for their papers or presentations. You could also ask students to show their work in progress as they move toward a final draft (e.g., require submission of a project outline or proposal, annotated bibliography, and multiple drafts).

Allow for growth and resubmission

Consider adding in some flexibility when students fall short of an objective by allowing for revisions or resubmissions on certain assignments. This can reduce the “high stakes” nature of assessments and associated pressures.

Make adjustments to current assessments

Review your existing assignments to see if there are areas where you can have students demonstrate their holistic growth and development. For exams, you could add supplemental reflection questions or even consider adopting oral exams.

A Note on Academic Honesty

It can be easy or tempting to spend a lot of effort trying to catch instances of academic dishonesty using tools like ChatGPT. Although there are detection tools available, such as Turnitin, the effectiveness of AI detection reports remains uncertain due to insufficient data. Please review our blog on Considerations for Using Generative AI Tools to learn more and remember how important it is to communicate explicitly with students about if, when, and how they may use AI in your class.

How Can I Learn More?

CATL has curated a list of readings and additional resources about AI in education! If you have questions, concerns, or ideas specific to generative-AI tools in education and the classroom, please email us at catl@uwgb.edu or set up a consultation!

 

 

Considerations for Using Generative AI Tools

Staying updated on the rapidly evolving generative-AI tools can be challenging, and educators may hold divergent (and strong!) views about them. In a previous blog post, we introduced generative-AI technologies, their capabilities, and implications for higher education. While some educators are enthusiastic about incorporating AI into their teaching methodologies, others may harbor doubts, apprehensions, or simply lack interest in exploring these tools. Regardless of one’s stance, understanding the disruptive impact of these technologies is crucial as we grapple with their ethical and pedagogical implications as educators.

In this post, we will explore some considerations for using generative-AI tools in the classroom, including preliminary precautions and ethical concerns. The more we understand these technologies, the better we can adapt to maximize their potential benefits while minimizing their negative impact.

Things to Consider When Using AI-Powered Tools in your Courses

Understand the inevitability of advancing AI technology.

AI, like many other recent technologies (e.g., personal computers or the internet), will continue to advance and not go away. In fact, they will progress and become better than previous models. This is not something we can “outrun.”

Encourage dialogue on the impact of AI in education

Consider discussing AI technology and its implications with your department, colleagues, and students. In what ways will generative-AI tools change the nature of learning outcomes and even careers in your discipline? How are other instructors responding? In what ways can instructors support each other as they each grapple with these questions?

Provide clear communication with your students on expectations

Whichever camp or situation you may fall into, it is always important to provide students with clear expectations for their use of AI in the classroom. Be specific in your syllabi and assignment descriptions about where and when you will allow or prohibit the use of these tools. You should also make sure whatever guidance you provide is also consistent with UWS Chapter 14 and the communications from our Provost Office. For example statements, view our Syllabus Snippets related to generative-AI. 

Use generative-AI tools with caution

Exercise caution when using generative-AI tools because the information provided by them may not always be accurate. AI creators, like OpenAI, are upfront about the fact that ChatGPT’s answers aren’t always correct. Due to their ability to hallucinate facts and resources, it’s best to avoid using these tool as a primary source. Be sure to also watch out for potential bias that can appear in outputs by these tools as they are trained on human-generated data.

Offer alternatives for privacy-minded students

If you are asking students to complete an assignment using generative-AI technology, you will also want to provide an opt-out or alternative assignment because students may legitimately not want to provide personal information to sign-up and use certain AI technologies. Many tools openly state they will sell that information.

AI detection tools are not perfect

When using Turnitin’s AI writing detection indicator, it is important to note that there is currently insufficient data to validate its effectiveness. Therefore, results from such reports should be treated as signals that additional review may be necessary. If you suspect academic misconduct, be prepared to support the claim with additional information beyond the detection tool’s report.

Consider ethical and legal issues when using AI tools

As instructors, it is also important to consider the potential ethical, legal, and security risks of AI technologies. Many generative-AI tools are “trained” on the data we put into them, so we must exercise caution when providing prompts to the tools. For example, never put students’ personal information into an AI-powered tool, as this may violate FERPA. Asking students to submit their work (or doing it yourself) to get feedback from ChatGPT or a similar resource puts their intellectual property into the public domain. This should not be done without their explicit consent.

Prepare students to use AI effectively

If you assign tasks that require students to use AI technology, it is important to provide clear instructions about how to do so and not assume students already know. Consider incorporating a discussion on the benefits, limitations, cautions, and ethics of using generative-AI. This could be a valuable in-class activity.

Don’t get caught up in the smoke

Although the capabilities of generative-AI can be scary or worrying at this point, it is best to not get bogged down in the negatives of AI or focus on how to detect cheating through AI use. Are you worried about what AI tools mean for your course materials? Schedule a consultation with us. CATL is here to help!

How Can I Learn More?

CATL has curated a list of readings and additional resources about AI in education, as well as a blog post that explores strategies for creating more “AI-resistant” assessments. If you have questions, concerns, or ideas specific to AI-text generative tools in education and the classroom, please email us at catl@uwgb.edu or set up a consultation!