Making Impactful Use of Canvas Analytics in Your Course

Like many websites, Canvas collects data from users as they navigate their courses. Thankfully, unlike many websites, Canvas collects this data not for the purpose of selling it to advertisers but for the purpose of presenting it to instructors. Canvas presents collected student activity data in a course page titled “New Analytics,” which contains charts and tables designed to help instructors make use of this data. While New Analytics contains well-organized representations of course data, it does not prescribe specific actions or provide a formula for making use of the data. In this post, we summarize the data available in New Analytics and recommend ways you can interpret it to take actions in your course that can help improve student outcomes. 

Detecting Course Trends 

New Analytics Window

New Analytics can help reveal trends in student achievement from assignment to assignment and student engagement from week to week. After launching New Analytics from the course navigation menu or the button on the right side of the course Home page, you’ll see a series of tabs across the top of the page. The first two tabs, “Course Grade” and “Weekly Online Activity” have data views that can help you identify course trends. The Course Grade tab has a chart which shows the average grade for each assignment in your course. Each assignment in your course will be represented by a dot on this chart. The dot’s position on the y-axis represents the average grade for that assignment. A quick glance at this chart can help you identify the assignments where the class atypically excelled or struggled and help you confirm—or refute—suspicions you developed about performance trends while grading assignments. Thinking critically about why the class might have been more or less successful on a particular assignment can lead to ideas for course design improvements. A close look at a successful assignment may lead to insights on what works well in a course; a close look at a less successful assignment may reveal a need to incorporate scaffolding assignments and additional support. Clicking on an assignment’s dot on the chart will reveal additional statistics, including a grade distribution chart and the number of missing and late submissions. 

Clicking the Weekly Online Activity tab will show a chart of the average page views and course participation actions during each week of the course. Viewing this chart can help you identify whether engagement with your Canvas course is waning, holding steady, or growing. Beneath the chart is a table of course resources which shows how many students have viewed each item, how many overall views it’s received, and how many times a student has participated (a list of the actions Canvas counts as a “participation” can be found in this Canvas guide). You can sort this table by any of its columns to identify which elements of your course get the most and least engagement. If an important resource in your course isn’t garnering as many views as you’d like it to, ask yourself “why?” and consider ways to either guide your students to that resource or phase it out and incorporate its key content into the resources your students are reliably viewing (Clum, 2021). Look at the resources that have gotten the most views and participation and check for commonalities to gain insight on what captures your students’ attention. You can click on any data point in the Weekly Online Activity chart to open a panel that shows activity data filtered for that specific week. The data in this panel can give you an idea of whether students are keeping up with the pace of your course or whether they are still working through older resources. 

Checking on Individual Students 

New Analytics can also help you identify students who may benefit from an intervention from a professional adviser because they have disengaged with your course or never engaged at all. The Students tab of the New Analytics page shows a table with the following statistics for each student: 

  • Current grade 
  • Percentage of assignment submissions made on time 
  • Last date of a participation action 
  • Last date the student viewed any page in your course 
  • Count of total page views 
  • Count of total participation actions 

You can click any column header on this table to sort the table by that column. Looking at this table during the first few weeks of a term and sorting it by “Page Views” can help you quickly identify students who have not engaged with the Canvas course. Students with no or very low page view counts have not engaged with your course. You can issue an ad-hoc alert in EAB Navigate to request that UW-Green Bay’s professional advising team reach out and help set a student on a path to academic success. 

Clicking on a student’s name in this table will open a student-specific data view that shows that particular student’s assignment grades and weekly activity over time. If you’ve noticed a downturn in a student’s performance or engagement, this view can help back up your observations with data. Comparing a student’s assignment grades or activity with the class average can help you contextualize any trends you see. You can view an individual student’s data alongside the class average on the same chart by adding that student to the filter field above the chart on the Course Grade or Weekly Online Activity tabs.

Sending Smart Messages 

Sending Smart Messages in Canvas

New Analytics also makes it easy to send messages to students who fit certain performance or activity criteria. As you explore the Analytics tool in your course, keep an eye out for the message icon that can be found on most of the tabs and panels. Clicking this icon will begin composing a Canvas Inbox message which you can send to students that meet a customizable criterion related to an assignment grade, weekly activity, or engagement with a specific resource. Here are a few examples of the types of messages you can target through New Analytics: 

  • Check-in with students who haven’t yet viewed the course this week 
  • Send congratulations to the students who did well on an assignment 
  • Encourage a growth mindset for students who struggled with an assignment and point them to helpful resources 
  • Remind students who have missing assignments to make a submission 

These quick instructor encouragements and interventions can help your students stay engaged with the course and on-target to reach their goals (Bostwick & Becker-Blease, 2018). Especially in online asynchronous courses, sending these targeted check-in messages can help establish your presence and ensure that students know you care about their success. 

Try It Out!

Coupling the data in Canvas New Analytics with the observations you make while teaching can help you make accurate judgments about what works well and not so well in your course. It can also help you identify when a student needs some additional support, and the incorporated messaging tool makes it easy to follow-up. We encourage you to open the New Analytics page in your Canvas courses, explore the data within, and ask yourself whether what you see aligns with your assumptions of how students experience your course. Try sending a congratulatory message to the students that excelled on an assignment and a friendly reminder message to the students who owe you work. We’d love to hear about your experience exploring and interpreting the data! Please feel free to reach out to us at CATL@uwgb.edu to tell us your story, ask a question, or request a consultation!

References 

  • Bostwick, K. C. P., & Becker-Blease, K. A. (2018). Quick, Easy Mindset Intervention Can Boost Academic Achievement in Large Introductory Psychology Classes. Psychology Learning & Teaching, 17(2), 177–193. https://doi.org/10.1177/1475725718766426 
  • Clum, K. (2021, May 14). Using canvas analytics to support student success. KatieClum.org. Retrieved December 5, 2022, from https://katieclum.org/2021/05/14/using-canvas-analytics-to-support-student-success/ 

Call for 2023 OPID Spring Conference – The Joys of Teaching and Learning: Centering Students (Applications Due Monday, Jan. 9)

The UW System Office of Professional & Instructional Development (OPID) has announced the details for their annual spring conference on teaching and learning! The 2023 conference will be held in person in Madison and via Zoom on Apr. 20 & 21, 2023, and the theme for this year is “centering students.” OPID invites you to participate by submitting a proposal about your teaching and learning experiences, ideas, insights, questions, failures, and accomplishments. The call is open to all UW educators, and proposals are due Monday, Jan. 9, 2023.

Learn More & Apply

Theme

The Joys of Teaching & Learning: Centering Students

Description provided by the OPID 2023 Spring Conference on Teaching & Learning website.

From the classroom to department meetings and from learning management systems to addressing mental health and wellbeing, students are the focus of our professional lives. In the past few years, we have increased our attention to centering our teaching practices around the “whole student.” Re-examining assessment strategies, updating curriculum, exploring teaching methods and modalities while increasing flexibility and compassionate responses to students’ needs are just a few examples.

Centering Students is what we do as educators and is tied to our goals, challenges and the rewards of teaching and learning. As we deal with the lingering effects of the COVID-19 pandemic, we have an opportunity to explore what we have learned, and what we still need to learn, about connecting with and supporting students. How might we consider what we need in terms of self-care and care for colleagues so we can feel a sense of well-being and enable us to better care for others around us? How do we cultivate relationships and create a sense of community with our students? How do we bring student voices into our face-to-face, online, and blended learning environments? What opportunities are there to cultivate connections both within and external to our class environments? How can we meet students where they are, while advising and mentoring them to succeed beyond our learning contexts?

We invite you to contribute to the conversation about centering students by presenting at OPID’s 2023 Spring Conference. Please share your experiences, ideas, insights, questions, failures, and accomplishments so we can collaborate and learn together to explore possibilities for centering students in our teaching/learning contexts.

Read more about the theme and plenary speaker on the OPID 2023 Spring Conference on Teaching & Learning site!

Questions?

Programmatic inquiries may be directed to Fay Akindes, Director of Systemwide Professional and Instructional Development, UW System, fakindes@uwsa.edu, (608) 263-2684.

PlayPosit: Time-Saving Tips

What is PlayPosit? And what can PlayPosit do for you?

What is PlayPosit? PlayPosit is a video resource tool integrated with Canvas that allows instructors to create interactive videos. Using PlayPosit terminology, these videos are referred to as bulbs. Instructors can embed questions or other engagement check-points, called interactions, into recorded lecture videos, YouTube videos, or other Kaltura video recordings. For a more detailed summary of PlayPosit, please see this previous blog created by CATL.

What can PlayPosit do for you? PlayPosit can be used to create alternative learning materials for your course and offers more options besides traditional text-based resources for students to engage with.  Using bulb interactions, you can check student knowledge during a recorded lecture video, provide extra materials via external URL links to highlight a key learning point, provide space for students to anonymously ask clarifying questions, or even allow students to record time-stamped comments and notes for later review. A more detailed breakdown of the different types of interactions offered within PlayPosit bulbs as well as a few use cases like creating quizzes, breaking up long lectures, and much more can be found here.

Increasing Dialogue: How can PlayPosit help you collect student feedback?

Another powerful feature of this tool is that you can also use PlayPosit within your Canvas course to get live, synchronous feedback from your students. In the past, clickers or Kahoot! may have been used as live polling tools, or even Zoom Polls or Microsoft Teams. Now, you can use a similar feature included with UWGB’s PlayPosit license called PlayPosit Broadcast. 

If you do not wish to use PlayPosit Broadcast as a live polling feature, you can still increase course dialogue by utilizing the Discussion interaction within your bulbs. This type of interaction allows students to leave timestamped comments and questions within a video, creating a discussion forum within the PlayPosit activity itself. Instructors can modify the discussion forum interaction settings to prevent students from seeing their classmates’ comments until they have posted a comment themselves. You can also moderate discussion forum interactions as the instructor within the PlayPosit interface. Creating PlayPosit discussion forums for points may also offer students an alternative to traditional Canvas Discussions.  

Assignments and Beyond: How can PlayPosit be used for low-stakes or ungraded activities?

A common misconception about PlayPosit is that you can only create PlayPosit bulbs as graded Canvas Assignments. This is not the case. If you would like students to take a PlayPosit assessment or engage with an interactive video activity for points that are reflected within your Canvas gradebook, you can indeed build the PlayPosit bulb as an assignment within Canvas, however you can also build ungraded PlayPosit activities for your students. 

Student self-assessment activities and interactive, supplemental video resources can encourage active learning within the classroom, especially for asynchronous learning environments. Both types of student engagement activities can be created using PlayPosit, and may work best as low-stakes assignments or as ungraded items in Canvas. To create an ungraded PlayPosit bulb, add your PlayPosit bulb as an embedded item in a page or as an external tool within a Module. If you still want students to see some sort of grade for self-assessment purposes, you can assign each bulb interaction a point within the PlayPosit interface. While these interactions will display point values within PlayPosit, the points earned by completing interactions will not push back to Canvas and the PlayPosit activity will not be reflected in the Canvas Gradebook. More information on how to create PlayPosit activities that are graded or ungraded in Canvas can be found in the UWGB IT Knowledgebase, UKnowIt.

How can PlayPosit help save instructors time?

PlayPosit isn’t just a resource that will benefit your students and their learning experience within the classroom. It also has many benefits for instructors. There are several features of this tool that can be time savers for you as an instructor! Not only is building a PlayPosit bulb a quick way to enhance your existing course videos, but PlayPosit automatically saves interactions you make for your bulbs within a personal interaction library. PlayPosit also allows you to create templates for individual interactions or sets of interactions. You can then access these individual interactions, located under My Interactions within the PlayPosit interface, or your saved templates for use in future bulbs to make the bulb creation process even faster! For more information on how to access and use these timesaving PlayPosit features, see this PlayPosit resource. Remember, since UWGB possesses a license for this tool, you as an instructor have access to all of these features.  

Beyond saving the interactions and templates you personally create, PlayPosit also allows you to co-edit bulbs with colleagues using the collaborations feature, or to share out PlayPosit bulbs to fellow instructors by using the folders feature. These sharing features can be used together or separately depending on if you wish to include your colleagues as editors, or to simply provide them with a copy of one of your bulbs. For directions on how to share and copy bulbs, please review this PlayPosit resource. Not only can you share individual bulbs within PlayPosit, but you can also collaborate and share interaction templates with your colleagues! For more information on how to collaborate with other instructors, please see this resource provided by PlayPosit.

Questions?

These are only a few of the features PlayPosit offers instructors and students. If you have any questions about PlayPosit, please feel free to reach out to the UWGB Center for the Advancement of Teaching and Learning through email (catl@uwgb.edu) or for troubleshooting you can contact PlayPosit customer support through their website (PlayPosit Knowledge) by clicking on “Contact” in the upper right corner. For a more detailed discussion of PlayPosit use cases and how you can harness the tool in your own Canvas course, you can schedule a consultation with CATL here. 

Helpful Terms and Hints

Bulb – The term used to refer to a PlayPosit interactive video.

Interaction – The term for the different questions, images, audio, or other media resources which can be embedded into a PlayPosit bulb. There is no limit to how many can be included within a bulb.

PlayPosit Designer – This is the interface used to create PlayPosit bulbs, insert your video source, embed interactions, and select bulb settings.

PlayPosit 3.0 Designer – This refers to the current version of PlayPosit software being used.

Learner Made Content – This refers to PlayPosit bulbs and interactions created by learners and submitted for assessment to instructors.

If you do not wish to work in the PlayPosit interface within Canvas and prefer a larger screen to build and edit your videos, you can open your PlayPosit account in any browser. In order to do so however, you must have already opened PlayPosit within your UWGB Canvas account. If you have not yet accessed PlayPosit at UWGB, follow the instructions below. 

How to log into PlayPosit through your UWGB Canvas Account: 

  • First, log into your UWGB Canvas account in one tab of a browser of your choice. 
  • Navigate to the Assignments section if you wish to build a graded PlayPosit activity or to the Pages section for an ungraded PlayPosit activity. 
  • For a Page, create a New Page by clicking on + Page and then click the down arrow to the left of the plug-in icon in the Rich Content Toolbar. The plug-in icon looks like a two-prong plug with a cord. Then click on View All and select PlayPosit. This will open a window with the words Set Link in the top right corner. Click on the words Enter PlayPosit in the middle of the window or Set Link in green on the right side of the window. You should now be in PlayPosit, skip to the last step in these instructions to open PlayPosit in a browser. 
  • For an Assignment, create a New Assignment by clicking on + Assignment, then under Submission Type, select External Tool. Next, click on Find under "Find an External Tool URL" and scroll down then select PlayPosit. A window with the words Link Resource form External Tool will open, click on either Enter PlayPosit or Set Link in green. You should now be in PlayPosit, skip to the last step in these instructions to open PlayPosit in a browser. 
  • Now, in a separate tab in the same browser where you logged into Canvas, open PlayPosit Knowledge. Click on the PlayPosit logo in the upper right portion of the screen. The PlayPosit logo is the image of the dog. This will open your PlayPosit account provided by UWGB. Here you can build, share, and collaborate on bulbs using the larger screen view provided by the browser. To set the link to your desired bulb for a graded Assignment in Canvas or in a Canvas Page however, you should follow the instructions above to open PlayPosit in Canvas then select your bulb. 

Yes, in PlayPosit you can include several video segments into a single bulb. Do this in the Video Segments screen when creating a new bulb. If you would like to change the order of the video segments within your bulb, you can toggle on the Enable drag and drop recording option at the top of the Video Segments screen. Move videos into the order in which you would like them to be seen. Once you are finished, toggle off the Enable drag and drop recording.

Note: For new PlayPosit playlists, you should reorder your video segments before you add interactions. Interactions in a playlist will not move with the video when it is reordered. 

Yes, with the UWGB institutional license PlayPosit will automatically pull in caption files that are already associated with your videos (such as YouTube videos with captions or Kaltura videos. You can also upload caption files directly to PlayPosit such as .vtt and .srt files. 

To check your video for captions, navigate to the My Bulbs page in PlayPosit and follow the steps below. 

  • In the far right of the screen under Actions, click on the three vertical dots to the right of the video you wish to check and then from the dropdown menu select Edit. 

  • Click on the Video Segments tab in the PlayPosit Designer and click on the edit icon (it looks like a gray pencil) for the video you wish to caption. The edit icon is in the upper right corner of the video segment.  

  • Select Edit Video Segment from the options presented. Then click on the Captions tab in the Edit Video Segment screen. 

  • In this screen, you can now have PlayPosit search for available captions, or you can upload your caption file.  
  • To search for captions, click on the View Available YouTube Captions, then select from the available options PlayPosit was able to fetch by checking the box to the right of the desired language choice. Once your choices are finalized, select Download in the bottom right corner to save your choices. 

Evidence-Based Frameworks and Strategies for Keeping Students Engaged

Keeping students engaged in their learning throughout an entire semester is a challenge that exists across all disciplines and modalities. Though the ways in which you implement strategies for increasing student engagement might vary because of these factors, the good news is that the underlying principles remain the same. Below are some of the key methods and strategies that have emerged as common themes across many studies on the relationships between teaching practices and student engagement.

Foster a Culture of Growth, Trust, and Belonging

Part of a student’s engagement in a course is tied to the affective domain of learning, or a student’s thoughts and feelings about their own learning. Does the student feel like they belong in this learning environment? Are they respected by their peers and the instructor? Do they see their instructor as an ally in the learning journey, or as an adversary?

One aspect of the affective domain is whether an individual has a growth mindset or a fixed mindset. The Center for Learning Experimentation, Application and Research at the University of North Texas has a great list of growth mindset interventions instructors can implement. It is worth noting, however, that research seems to indicate the effectiveness of these interventions is contingent on the instructor’s mindset as well. Studies have shown that instructors with a greater growth mindset (as opposed to a fixed mindset) have smaller racial achievement gaps and inspire more student motivation in their courses.

The affective domain also includes students’ feelings of belonging and trust. While the degree to which you can affect these feelings has limitations, evidence-based practices usually boil down to how you interact with students and facilitate interactions between students. A few examples include using a welcoming tone in your syllabus, modelling inclusive language, and taking the time to get to know your students’ names. Even in asynchronous classes it is important to build trust with your students. For example, you might want to consider using a week-one survey to provide your students with an opportunity to tell you about themselves.

Break Up Lectures & Add Opportunities for Active Learning

When there is a lot of content that needs to be disseminated across the duration of the semester, lectures are a common method for communicating that information quickly and efficiently. But the longer and denser the lecture is, the more instructors risk losing their students along the way due to cognitive load.

One solution is to build pause points into your lectures. Students benefit from structured pauses during lectures as it allows them space to question, process, and reflect on the information that they’ve absorbed. For pre-recorded lectures, the same idea can be achieved by breaking up a long lecture video into multiple short, topical videos (research suggests 6-12 minutes is an ideal length for maintaining student engagement). Fortunately, Kaltura (My Media) makes it very easy to trim and save video clips from right within Canvas.

When adding pauses for students to digest information, it is also beneficial to create opportunities for active learning activities. These activities can be very brief, such as using an anonymous polling tool to check for student understanding during a lecture. For more in-depth active learning, consider making time for small group discussions, written reflections, and other exercises that require students to employ higher order thinking skills. For courses with an asynchronous component, PlayPosit allows instructors to add a variety of engagement activities to pre-recorded lecture videos, while Hypothesis may be useful for incorporating annotation and reflection activities into assigned readings.

Provide Transparency and Support

When a student needs to spend a lot of mental energy figuring out the logistics of how to complete an activity, they have less mental energy left to engage with the course materials themselves. Therefore, transparency and scaffolding are both key elements to designing engaging assignments.

The Transparency in Learning and Teaching (TiLT) framework is designed to help instructors write clear and descriptive instructions for learning materials and assignments. For this framework, lay out the task, purpose, and criteria for each learning activity. If a student knows what they are supposed to do, why they are supposed to do it (how it ties to the course learning outcomes), and how they are going to be assessed, they can go into the activity more confident in their ability to engage with it.

It is common for a student to stop engaging with a course if they feel like they don’t have the means or resources to complete the tasks they’ve been assigned. Proper instructional scaffolding can help counter this issue by bridging some of the cognitive gaps and reducing the number of students that fall through the cracks. For example, if the final assignment in your course is an 8-page research paper, consider breaking up the process into several smaller assignments, such as having students submit their topic, bibliography, and outline at various points throughout the semester. Other ways to provide scaffolding this assignment might include modelling (providing examples of papers that meet the outcomes of the assignment), incorporating instructor or peer feedback for the outline or an early draft of the paper, and providing a robust rubric to guide students on how to meet the assignment outcomes.

Additional Resources

Engaging students is a broad topic that we are only just able to scratch the surface of in this post. Below are some resources for further reading if you’d like to dive in deeper.

Questions?

As always, we welcome you to share your ideas for engaging students by dropping a comment below or emailing us at CATL@uwgb.edu. If you’d like to discuss any of these methods or ideas one-on-one, a CATL member would be happy to meet with you for a consultation as well.

Follow-Up: PlayPosit “Replicate and Repeat” Training

On Nov. 15, 2022, PlayPosit held a training that focused on how to replicate and repeat content in PlayPosit. These features can help create a more streamlined workflow for users that would like to reuse bulb content or share bulbs with other instructors. Some of the content covered in this training includes:

  • How to duplicate/copy a bulb
  • How to reuse an interaction (question, discussion, pause point, etc.) from a previous bulb
  • How to use PlayPosit interaction templates
  • How to save an interaction or a group of interactions as a template
  • How to share a bulb with a collaborator
  • How to send a copy of a bulb to another instructor

A recording of this training is embedded below.

Questions?

As you explore PlayPosit, we encourage you to consult PlayPosit’s extensive knowledgebase of instructor guides, including this guide on building graded bulbs in Canvas. You can contact PlayPosit support directly by clicking the “Contact” link on their support site and filling out their web form. Guides on how to build a bulb, share a bulb with your students, use PlayPosit for peer review, and more, can also be found on the UWGB IT knowledgebase. 

As always, we also welcome you to request a CATL consultation if you’d like to see a demo of PlayPosit or talk through how you might use it in your course!