Implementing Negotiable Grading Schemes

Article by Amy J. Kabrhel, Ph.D., Associate Professor of Chemistry & 2022-23 Instructional Development Consultant

For years I have seen students enter my courses on the first day of classes eager to engage with the course material who then slowly stop doing the homework but still perform well on the exams. I wondered if this was due to exhaustion, being overwhelmed with other demands on their time, or, frankly, just laziness. On the flip side, I have had students who rock it on the homework and fumble on the exams. I know they have learned the material being assessed but their ability to show me what they have learned via my exams is hindered. There are several reasons for this (undiagnosed learning disability, test anxiety, lack of sleep, etc.), but after 16 years of teaching in higher education, I have finally decided to make my course grading scheme more equitable for the wide variety of students I see in my courses. In Fall of 2022, I implemented a negotiable grading scheme in my CHEM 211 (Principles of Chemistry I) course as detailed below.

Negotiable Grading Scheme for CHEM 211
#1-Consistency Commander #2-Exam Rockstar #3-Quiz Master #4-Final Boss
Exams (4): 40% (10% each) 56% (14% each) 24% (6% each) 40% (10% each)
Final Exam: 15%

(equiv. to 1.5 exams)

21%

(equiv. to 1.5 exams)

9%

(equiv. to 1.5 exams)

25%

(equiv. to 2.5 exams)

Online Homework

(42-lowest 2 dropped):

20%

(0.5% each)

5%

(0.125% each)

40%

(1% each)

15%

(0.375% each)

Pre-Lecture Quizzes

(37-lowest 7 dropped):

10%

(~0.33% each)

3%

(0.1% each)

12%

(0.4% each)

5%

(~0.17% each)

Discussion (4 graded): 5% (1.25% per graded week)
Project: 10%

#1–Consistency Commander: Tends to maintain consistent and successful study/learning strategies across the semester, appreciates the use of homework and quizzes to regularly check in and keep motivation up.

#2–Exam Rockstar: Prefers to spend time studying for exams, does not place a high priority on weekly check-in assessments (homework and quizzes).

#3–Quiz Master: Places a high priority on weekly check-in assessments (homework and quizzes) to regularly keep up with the material, places a lower priority on exams.

#4–Final Boss: Prefers synthesizing knowledge across the term and proving their knowledge acquisition at the end of the semester on the cumulative Final Exam, places a lower priority on weekly check-in assessments.

In this negotiable grading system, students select the grading scheme that best matches their abilities, learning preferences, time constraints, and anxieties. On the first day of classes last fall, I introduced these grading schemes, described each in a bit more detail, and then asked each student to fill out a small sheet of scratch paper with their name and their preferred grading scheme. I made it clear that they were not locked into this scheme on Day 1 but that by reflecting on their choice at the beginning of the semester, they knew where to focus their efforts. After Exam 2 (approximately halfway through the semester), we revisited the grading schemes, and students locked in their scheme for the semester.

On Day 1, half of my students picked #1-Consistency Commander and the other half picked #3-Quiz Master. This did not surprise me since a large number of students have some form of test anxiety. However, after seeing their exam scores on Exams 1 & 2, which were quite good this fall, and seeing how a few of them had started not completing the homework and pre-lecture quizzes on time, a few students switched to #2-Exam Rockstar. After the Final Exam, I calculated each student’s final course grade in each grading scheme (easily done via Excel) and found that most students had picked the scheme that best matched their skills and learning preferences. A few, however, had a higher grade in a scheme different than the one they had selected. I discussed this with them (via email or in person) to help them reflect on their metacognition and to help them get a better sense of their strengths (and weaknesses) as a college student. They were very appreciative of this, and I believe this will help them realize where they may need to focus more of their attention in courses that do not use negotiable grading schemes.

This spring semester, I am using a similar negotiable grading scheme in my CHEM 212 (Principles of Chemistry II) course. Most of my CHEM 212 students took CHEM 211 with me last fall, so they were anticipating this grading system, and when I introduced it on Day 1, they were very thankful. Many of them stated that they wished more of their professors used this system, which is what prompted me to write this blog post. I think negotiable grading schemes are a wonderful way to make your course more accessible and equitable to our students who come from varying backgrounds with unique skill sets that speak to some assessment types more so than others. In addition, negotiable grading schemes give students agency in your course and a feeling that they have more control over their course grades. They can more easily balance their workload and put their efforts into the assessments that matter most to them. As you can see from my schemes presented above, all assignments are still included in each overall scheme; it is their weight that changes. In some cases (e.g., Discussion and Project for my course), the assessment is too important for it to have varying weight from scheme to scheme. This can express to students the value of certain assessments.

One minor drawback is that Canvas can only show one grading scheme. I chose #1-Consistency Commander for the scheme I put in my CHEM 211 Canvas page. This means students who chose a different grading scheme had to see me (or email me) to know what their current grade was on their chosen scheme. Thankfully, if you keep your Excel grade book up to date, this is not too difficult to communicate to those students.

Overall, I found this method of grading liberating for students and wonderful for student-instructor rapport. As mentioned, I am using this method in Spring 2023, and I plan to continue using this method in most of my courses from now on. If you have any questions for me about negotiable grading scheme, I would be more than happy to chat with you about them.

Events on AI, Machine-Generated Content, and ChatGPT (Feb. 10, Feb. 17, Mar. 24 & Apr. 7, 2023)

Have you heard the term “ChatGPT” and wondered what everyone was talking about? Are you thinking about how artificial intelligence and machine-generated content could help you as a teacher or complicate your ability to assess true student learning? Experts from across UW-Green Bay are coming together to help you! Please read on to learn more about the sessions being offered in Spring 2023.

ChatGPT Workshop (Feb. 10 & 17, 8 – 9:30 a.m.)

We are excited to announce that the Cofrin School of Business, with support from CATL, is hosting a workshop on ChatGPT! Come learn about ChatGPT by Open AI. Join CSB faculty in this interactive workshop to experience the most advanced chatbot and discuss implications for teaching and learning.

The workshop is moderated by Oliver Buechse, Executive in Residence, Cofrin School of Business. It will be offered on two different Fridays, Feb. 10 and 17, from 8 – 9:30 a.m. in the Willie D. Davis Finance and Investment Lab on the first floor of Wood Hall. The workshops are free and open to all UWGB employees.

If you need an accommodation for any of the sessions that are a part of the “ChaptGPT Workshop” please contact Kathryn Marten (martenk@uwgb.edu).

AI, Teaching, & Learning Series (Feb. 17, Mar. 24, & Apr. 7, 11:40 a.m. – 12:30 p.m.)

UW-Green Libraries, CATL, The Learning Center, and UWGB faculty are all coming together to offer a series of three workshops on machine-generated content applications and artificial intelligence tools such as ChatGPT and their potential impacts on teaching and learning. Participants will have the option to attend this series in-person or via Zoom. 

Teaching and Learning in the Time of ChatGPT | Friday, Feb. 17, 11:40 a.m. – 12:30 p.m.

UW-Green Bay instructors with expertise in artificial intelligence and machine learning will introduce us to AI-content generating tools, like ChatGPT, and their potential uses and pitfalls. Join other instructors for an engaging discussion about the impact on teaching and learning and a brief opportunity to test the tools themselves. 

Writing Assignments and Artificial Intelligence | Friday, Mar. 24, 11:40 a.m. – 12:30 p.m.

ChatGPT and other text-generating tools have raised concerns among instructors whose curriculum relies upon writing assignments from creative writing to lab reports and research papers. In this session, we’ll focus on the implications of these tools on writing and pedagogy, assessment, and curriculum design.  

Designing and Managing Authentic Assessments | Friday, Apr. 7, 11:40 a.m. – 12:30 p.m.

Students may inevitably use artificial intelligence and text-generating tools, but there are strategies instructors can explore and use to alleviate instructional stress around student learning. In this session, we will explore strategies for planning and developing authentic assessments to help students actively engage in their learning. This session will also offer instructors resources to help navigate the issues surrounding artificial intelligence and discuss ways to create assessments that embrace or acknowledge the use of AI and text-generating tools.

If you need an accommodation for any of the sessions that are a part of the “AI, Teaching & Learning Series,” please contact Kate Farley (farleyk@uwgb.edu).

Revising—and Reframing—Your Teaching Philosophy

Article by Tara DaPra, Assistant Teaching Professor & 2022-23 Instructional Development Consultant

Why should you write a teaching philosophy? Chances are, you already have, even if it was way back in graduate school or when you applied for the job you now hold. But if you are going up for promotion, as many of us in the teaching professor category may now do, or if—happy days—someone nominates you for a teaching award, your teaching philosophy may need updating. You may be dreading this. You may continually move it to the end of a long list of more pressing tasks. You may ask yourself if anyone will really read this. Leonard Cassuto says what many of us are thinking when he writes, “Teaching philosophies account for some of the most tiresome reading that academe has to offer (and that’s saying something).” But must they be? Rather than a chore or a high-stakes assessment, why not re-frame what a teaching philosophy can—or perhaps should—be? What if you instead treated your teaching philosophy as a celebration of your time in the classroom and a vision for the future?

In an article for The Chronicle of Higher Education, James Lang argues that teaching philosophies “fall under the genre of creative nonfiction,” a genre of writing that privileges techniques like voice, narrative arc, and compelling details while insisting on a non-negotiable commitment to the truth. Lang warns writers of teaching philosophies not to fall into the default mode we so often see in student writing—telling rather than showing. So instead of regurgitating your course learning objectives or points from your CV, Lang advises that we zoom in and describe a day when those objectives were lived in a particularly meaningful way. He writes, “Readers remember and respond to your stories, not your explanations.”

Another hallmark of creative nonfiction is to distinguish between what the writer knows and does not know—and to lean in to the latter. In her essay “Memory and Imagination,” Patricia Hampl writes, “It still comes as a shock to realize that I don’t write about what I know: I write in order to find out what I know.” Teaching philosophies are, essentially, a personal essay, a space for writers to puzzle over a complicated question and attempt to answer it from many angles. The word essay itself means “trial.” What, then, is the question you most want to discover, as it relates to your teaching? What parts of that question have you answered and what parts remain a mystery?

Writing a teaching philosophy can help us to reflect upon and articulate our ideas about what makes for effective teaching. And doing this can help to ensure that what we do in our classes is consistent with those beliefs—but it can also acknowledge pieces of the teaching puzzle that we have yet to fit together. And so, while teaching philosophies should certainly highlight a teacher’s strengths and successes, good teachers might also acknowledge what they hope to learn next.

If you’d like to read more about writing effective and reflective teaching philosophies, CATL has gathered some resources.

Making Impactful Use of Canvas Analytics in Your Course

Like many websites, Canvas collects data from users as they navigate their courses. Thankfully, unlike many websites, Canvas collects this data not for the purpose of selling it to advertisers but for the purpose of presenting it to instructors. Canvas presents collected student activity data in a course page titled “New Analytics,” which contains charts and tables designed to help instructors make use of this data. While New Analytics contains well-organized representations of course data, it does not prescribe specific actions or provide a formula for making use of the data. In this post, we summarize the data available in New Analytics and recommend ways you can interpret it to take actions in your course that can help improve student outcomes. 

Detecting Course Trends 

New Analytics Window

New Analytics can help reveal trends in student achievement from assignment to assignment and student engagement from week to week. After launching New Analytics from the course navigation menu or the button on the right side of the course Home page, you’ll see a series of tabs across the top of the page. The first two tabs, “Course Grade” and “Weekly Online Activity” have data views that can help you identify course trends. The Course Grade tab has a chart which shows the average grade for each assignment in your course. Each assignment in your course will be represented by a dot on this chart. The dot’s position on the y-axis represents the average grade for that assignment. A quick glance at this chart can help you identify the assignments where the class atypically excelled or struggled and help you confirm—or refute—suspicions you developed about performance trends while grading assignments. Thinking critically about why the class might have been more or less successful on a particular assignment can lead to ideas for course design improvements. A close look at a successful assignment may lead to insights on what works well in a course; a close look at a less successful assignment may reveal a need to incorporate scaffolding assignments and additional support. Clicking on an assignment’s dot on the chart will reveal additional statistics, including a grade distribution chart and the number of missing and late submissions. 

Clicking the Weekly Online Activity tab will show a chart of the average page views and course participation actions during each week of the course. Viewing this chart can help you identify whether engagement with your Canvas course is waning, holding steady, or growing. Beneath the chart is a table of course resources which shows how many students have viewed each item, how many overall views it’s received, and how many times a student has participated (a list of the actions Canvas counts as a “participation” can be found in this Canvas guide). You can sort this table by any of its columns to identify which elements of your course get the most and least engagement. If an important resource in your course isn’t garnering as many views as you’d like it to, ask yourself “why?” and consider ways to either guide your students to that resource or phase it out and incorporate its key content into the resources your students are reliably viewing (Clum, 2021). Look at the resources that have gotten the most views and participation and check for commonalities to gain insight on what captures your students’ attention. You can click on any data point in the Weekly Online Activity chart to open a panel that shows activity data filtered for that specific week. The data in this panel can give you an idea of whether students are keeping up with the pace of your course or whether they are still working through older resources. 

Checking on Individual Students 

New Analytics can also help you identify students who may benefit from an intervention from a professional adviser because they have disengaged with your course or never engaged at all. The Students tab of the New Analytics page shows a table with the following statistics for each student: 

  • Current grade 
  • Percentage of assignment submissions made on time 
  • Last date of a participation action 
  • Last date the student viewed any page in your course 
  • Count of total page views 
  • Count of total participation actions 

You can click any column header on this table to sort the table by that column. Looking at this table during the first few weeks of a term and sorting it by “Page Views” can help you quickly identify students who have not engaged with the Canvas course. Students with no or very low page view counts have not engaged with your course. You can issue an ad-hoc alert in EAB Navigate to request that UW-Green Bay’s professional advising team reach out and help set a student on a path to academic success. 

Clicking on a student’s name in this table will open a student-specific data view that shows that particular student’s assignment grades and weekly activity over time. If you’ve noticed a downturn in a student’s performance or engagement, this view can help back up your observations with data. Comparing a student’s assignment grades or activity with the class average can help you contextualize any trends you see. You can view an individual student’s data alongside the class average on the same chart by adding that student to the filter field above the chart on the Course Grade or Weekly Online Activity tabs.

Sending Smart Messages 

Sending Smart Messages in Canvas

New Analytics also makes it easy to send messages to students who fit certain performance or activity criteria. As you explore the Analytics tool in your course, keep an eye out for the message icon that can be found on most of the tabs and panels. Clicking this icon will begin composing a Canvas Inbox message which you can send to students that meet a customizable criterion related to an assignment grade, weekly activity, or engagement with a specific resource. Here are a few examples of the types of messages you can target through New Analytics: 

  • Check-in with students who haven’t yet viewed the course this week 
  • Send congratulations to the students who did well on an assignment 
  • Encourage a growth mindset for students who struggled with an assignment and point them to helpful resources 
  • Remind students who have missing assignments to make a submission 

These quick instructor encouragements and interventions can help your students stay engaged with the course and on-target to reach their goals (Bostwick & Becker-Blease, 2018). Especially in online asynchronous courses, sending these targeted check-in messages can help establish your presence and ensure that students know you care about their success. 

Try It Out!

Coupling the data in Canvas New Analytics with the observations you make while teaching can help you make accurate judgments about what works well and not so well in your course. It can also help you identify when a student needs some additional support, and the incorporated messaging tool makes it easy to follow-up. We encourage you to open the New Analytics page in your Canvas courses, explore the data within, and ask yourself whether what you see aligns with your assumptions of how students experience your course. Try sending a congratulatory message to the students that excelled on an assignment and a friendly reminder message to the students who owe you work. We’d love to hear about your experience exploring and interpreting the data! Please feel free to reach out to us at CATL@uwgb.edu to tell us your story, ask a question, or request a consultation!

References 

  • Bostwick, K. C. P., & Becker-Blease, K. A. (2018). Quick, Easy Mindset Intervention Can Boost Academic Achievement in Large Introductory Psychology Classes. Psychology Learning & Teaching, 17(2), 177–193. https://doi.org/10.1177/1475725718766426 
  • Clum, K. (2021, May 14). Using canvas analytics to support student success. KatieClum.org. Retrieved December 5, 2022, from https://katieclum.org/2021/05/14/using-canvas-analytics-to-support-student-success/ 

PlayPosit: Time-Saving Tips

What is PlayPosit? And what can PlayPosit do for you?

What is PlayPosit? PlayPosit is a video resource tool integrated with Canvas that allows instructors to create interactive videos. Using PlayPosit terminology, these videos are referred to as bulbs. Instructors can embed questions or other engagement check-points, called interactions, into recorded lecture videos, YouTube videos, or other Kaltura video recordings. For a more detailed summary of PlayPosit, please see this previous blog created by CATL.

What can PlayPosit do for you? PlayPosit can be used to create alternative learning materials for your course and offers more options besides traditional text-based resources for students to engage with.  Using bulb interactions, you can check student knowledge during a recorded lecture video, provide extra materials via external URL links to highlight a key learning point, provide space for students to anonymously ask clarifying questions, or even allow students to record time-stamped comments and notes for later review. A more detailed breakdown of the different types of interactions offered within PlayPosit bulbs as well as a few use cases like creating quizzes, breaking up long lectures, and much more can be found here.

Increasing Dialogue: How can PlayPosit help you collect student feedback?

Another powerful feature of this tool is that you can also use PlayPosit within your Canvas course to get live, synchronous feedback from your students. In the past, clickers or Kahoot! may have been used as live polling tools, or even Zoom Polls or Microsoft Teams. Now, you can use a similar feature included with UWGB’s PlayPosit license called PlayPosit Broadcast

If you do not wish to use PlayPosit Broadcast as a live polling feature, you can still increase course dialogue by utilizing the Discussion interaction within your bulbs. This type of interaction allows students to leave timestamped comments and questions within a video, creating a discussion forum within the PlayPosit activity itself. Instructors can modify the discussion forum interaction settings to prevent students from seeing their classmates’ comments until they have posted a comment themselves. You can also moderate discussion forum interactions as the instructor within the PlayPosit interface. Creating PlayPosit discussion forums for points may also offer students an alternative to traditional Canvas Discussions.  

Assignments and Beyond: How can PlayPosit be used for low-stakes or ungraded activities?

A common misconception about PlayPosit is that you can only create PlayPosit bulbs as graded Canvas Assignments. This is not the case. If you would like students to take a PlayPosit assessment or engage with an interactive video activity for points that are reflected within your Canvas gradebook, you can indeed build the PlayPosit bulb as an assignment within Canvas, however you can also build ungraded PlayPosit activities for your students. 

Student self-assessment activities and interactive, supplemental video resources can encourage active learning within the classroom, especially for asynchronous learning environments. Both types of student engagement activities can be created using PlayPosit, and may work best as low-stakes assignments or as ungraded items in Canvas. To create an ungraded PlayPosit bulb, add your PlayPosit bulb as an embedded item in a page or as an external tool within a Module. If you still want students to see some sort of grade for self-assessment purposes, you can assign each bulb interaction a point within the PlayPosit interface. While these interactions will display point values within PlayPosit, the points earned by completing interactions will not push back to Canvas and the PlayPosit activity will not be reflected in the Canvas Gradebook. More information on how to create PlayPosit activities that are graded or ungraded in Canvas can be found in the UWGB IT Knowledgebase, UKnowIt.

How can PlayPosit help save instructors time?

PlayPosit isn’t just a resource that will benefit your students and their learning experience within the classroom. It also has many benefits for instructors. There are several features of this tool that can be time savers for you as an instructor! Not only is building a PlayPosit bulb a quick way to enhance your existing course videos, but PlayPosit automatically saves interactions you make for your bulbs within a personal interaction library. PlayPosit also allows you to create templates for individual interactions or sets of interactions. You can then access these individual interactions, located under My Interactions within the PlayPosit interface, or your saved templates for use in future bulbs to make the bulb creation process even faster! For more information on how to access and use these timesaving PlayPosit features, see this PlayPosit resource. Remember, since UWGB possesses a license for this tool, you as an instructor have access to all of these features.  

Beyond saving the interactions and templates you personally create, PlayPosit also allows you to co-edit bulbs with colleagues using the collaborations feature, or to share out PlayPosit bulbs to fellow instructors by using the folders feature. These sharing features can be used together or separately depending on if you wish to include your colleagues as editors, or to simply provide them with a copy of one of your bulbs. For directions on how to share and copy bulbs, please review this PlayPosit resource. Not only can you share individual bulbs within PlayPosit, but you can also collaborate and share interaction templates with your colleagues! For more information on how to collaborate with other instructors, please see this resource provided by PlayPosit.

Questions?

These are only a few of the features PlayPosit offers instructors and students. If you have any questions about PlayPosit, please feel free to reach out to the UWGB Center for the Advancement of Teaching and Learning through email (catl@uwgb.edu) or for troubleshooting you can contact PlayPosit customer support through their website (PlayPosit Knowledge) by clicking on “Contact” in the upper right corner. For a more detailed discussion of PlayPosit use cases and how you can harness the tool in your own Canvas course, you can schedule a consultation with CATL here

Helpful Terms and Hints

Bulb – The term used to refer to a PlayPosit interactive video.

Interaction – The term for the different questions, images, audio, or other media resources which can be embedded into a PlayPosit bulb. There is no limit to how many can be included within a bulb.

PlayPosit Designer – This is the interface used to create PlayPosit bulbs, insert your video source, embed interactions, and select bulb settings.

PlayPosit 3.0 Designer – This refers to the current version of PlayPosit software being used.

Learner Made Content – This refers to PlayPosit bulbs and interactions created by learners and submitted for assessment to instructors.

If you do not wish to work in the PlayPosit interface within Canvas and prefer a larger screen to build and edit your videos, you can open your PlayPosit account in any browser. In order to do so however, you must have already opened PlayPosit within your UWGB Canvas account. If you have not yet accessed PlayPosit at UWGB, follow the instructions below. 

How to log into PlayPosit through your UWGB Canvas Account: 

  • First, log into your UWGB Canvas account in one tab of a browser of your choice. 
  • Navigate to the Assignments section if you wish to build a graded PlayPosit activity or to the Pages section for an ungraded PlayPosit activity. 
  • For a Page, create a New Page by clicking on + Page and then click the down arrow to the left of the plug-in icon in the Rich Content Toolbar. The plug-in icon looks like a two-prong plug with a cord. Then click on View All and select PlayPosit. This will open a window with the words Set Link in the top right corner. Click on the words Enter PlayPosit in the middle of the window or Set Link in green on the right side of the window. You should now be in PlayPosit, skip to the last step in these instructions to open PlayPosit in a browser. 
  • For an Assignment, create a New Assignment by clicking on + Assignment, then under Submission Type, select External Tool. Next, click on Find under "Find an External Tool URL" and scroll down then select PlayPosit. A window with the words Link Resource form External Tool will open, click on either Enter PlayPosit or Set Link in green. You should now be in PlayPosit, skip to the last step in these instructions to open PlayPosit in a browser. 
  • Now, in a separate tab in the same browser where you logged into Canvas, open PlayPosit Knowledge. Click on the PlayPosit logo in the upper right portion of the screen. The PlayPosit logo is the image of the dog. This will open your PlayPosit account provided by UWGB. Here you can build, share, and collaborate on bulbs using the larger screen view provided by the browser. To set the link to your desired bulb for a graded Assignment in Canvas or in a Canvas Page however, you should follow the instructions above to open PlayPosit in Canvas then select your bulb. 

Yes, in PlayPosit you can include several video segments into a single bulb. Do this in the Video Segments screen when creating a new bulb. If you would like to change the order of the video segments within your bulb, you can toggle on the Enable drag and drop recording option at the top of the Video Segments screen. Move videos into the order in which you would like them to be seen. Once you are finished, toggle off the Enable drag and drop recording.

Note: For new PlayPosit playlists, you should reorder your video segments before you add interactions. Interactions in a playlist will not move with the video when it is reordered. 

Yes, with the UWGB institutional license PlayPosit will automatically pull in caption files that are already associated with your videos (such as YouTube videos with captions or Kaltura videos. You can also upload caption files directly to PlayPosit such as .vtt and .srt files. 

To check your video for captions, navigate to the My Bulbs page in PlayPosit and follow the steps below. 

  • In the far right of the screen under Actions, click on the three vertical dots to the right of the video you wish to check and then from the dropdown menu select Edit. 

  • Click on the Video Segments tab in the PlayPosit Designer and click on the edit icon (it looks like a gray pencil) for the video you wish to caption. The edit icon is in the upper right corner of the video segment.  

  • Select Edit Video Segment from the options presented. Then click on the Captions tab in the Edit Video Segment screen. 

  • In this screen, you can now have PlayPosit search for available captions, or you can upload your caption file.  
  • To search for captions, click on the View Available YouTube Captions, then select from the available options PlayPosit was able to fetch by checking the box to the right of the desired language choice. Once your choices are finalized, select Download in the bottom right corner to save your choices.