Category Archives: assessment

Open Workshops for polling/clickers today

Echo360 (which bought Turning Technologies) will be on campus today (9/12/23) to run two workshops and to assist walkup students with their clickers/mobile licenses.  Workshops are in the Faculty Center in the Melville Library 10-11 and 3-4 (beginner and advanced).  Students should go  to the SINC site for the walk up assistance.

 

Roadmap for Voicethread. Some nice new features on the horizon:

Image of a folded map with a VT logo superimposed

The arc of change in the teaching and learning universe may be long, but it bends towards a more accessible, equitable, inclusive, and human-centric world. We plan on shortening that arc just a little bit in the coming year by introducing the biggest updates to VoiceThread in more than a decade.

A “New VoiceThread” will be available in the coming months, and we’ll have lots of details to share, but what we really want to share now is our redesign philosophy:

  • Significantly more accessible

  • Add a number of pro features, but be simpler to use

  • Designed based on research and user feedback

  • Make it easier for people to have authentic, high-quality, human to human interaction

  • Give everyone time to try it out before fully transitioning to the new version

In addition to the new VoiceThread, we have lots of new goodies on the way:

  • New integrations for Zoom, Google, and Microsoft

  • New assignment type allowing students to comment on classmates’ submissions for a formal grade

  • More powerful closed caption preferences

  • Lots of new mobile updates

Thank you for all your feedback, collaboration, and enthusiasm throughout 2022. None of this work could be possible without you.

– The VoiceThread Team

CHAT GPT

I’ve been using this tool since it became publically available to mess around with, and boy oh boy is it a game changer.  For me, I am trying to wrap my head around how this forms the future of education.  I’m not as concerned about how we will stop cheating – but of course that is the immediate question that many of you will have.  Rather than paraphrase what is already out there; I’m going to share with you a recent response that I think sums it up nicely from the EDUCAUSE Connect listserv:

“There are a few responses to ChatGPT (besides panic) that I’ve seen and walked folks through, and it kind of goes by what level of intervention you want to work with.

By tool:

  • Huggingface.co’s output detector: https://huggingface.co/openai-detector
    Also developed by OpenAI, and it’s not 100% effective, but will at least be a somewhat efficient method if there’s something suspicious

 

By question:

  • Ask questions that are very, very specific or require application of a concept to a unique problem or phenomena. The more specific, and more recent, you can be the better. ChatGPT’s data is about a year old, so asking about something more recent means it won’t have good information about it. In addition, asking for specific information from a tool meant to give general information increases the likelihood of misapplication (which would be easy for an instructor to notice).
  • Ask questions ChatGPT can’t discuss. It’s programmed to be limited (for now at least) to avoid controversial topics like the current war in Ukraine. If the course material allows for and it’s appropriate, adding in questions that the bot can’t respond to will mitigate its use.
  • Focusing on process questions rather than informational ones. “Which applies better and why”, “explain a statement and why you think it means that”, “which solution to a problem is more appropriate and why”. The chatbot can’t coherently explain its rationale to specific problems the way a human can.

 

By activity:

  • Authentic assessment can get over some of this by engaging students in activities that the bots can’t experience and draft a response. And there would be (typically) multiple components as part of the demonstration of mastery. This can be accompanied by application essays, “What I learned doing X”.
  • Scaffold work so that written papers are only a component of the final assessment. Even if its including initial and final drafts of work so a paper can’t be generated quickly.
  • Involve ChatGPT. Ask students to generate a paper from prompts about a topic and use their knowledge about the topic to correct it. This could include identifying and correcting misinformation, including citations, etc… Hopefully this would also discourage their use of the tool for academic cheating as they see how easy it is to find problems.

Long term, I think it’s going to take a lot of thinking about what it means to study and assess learning in the age of the chatbots.

As a fun test, I also gave the prompt “What should instructors do to prevent cheating using ChatGPT?” to ChatGPT, and this is the response it gave:

ChatGPT is a chatbot that uses natural language processing (NLP) to generate responses based on a given prompt. It could potentially be used to cheat on exams or assignments by generating answers to questions. Here are some strategies that instructors can use to prevent cheating using ChatGPT or other similar tools:

  1. Make it clear that cheating, including the use of chatbots or other AI tools, is not acceptable and will result in consequences.
  2. Use a variety of assessments, such as open-book exams, take-home exams, or oral exams, to make it more difficult for students to cheat.
  3. Use plagiarism detection software, such as Turnitin, to detect copied work and ensure that students are submitting their own original work.
  4. Monitor students closely during exams to ensure that they are not using ChatGPT or other technologies to cheat.
  5. Consider using proctored exams, in which a proctor monitors students during the exam to prevent cheating.
  6. Educate students about the consequences of cheating and the importance of academic integrity.

Overall, it is important for instructors to be proactive in preventing cheating, including the use of chatbots or other AI tools, and to take appropriate action if they suspect that a student has cheated.

Best,
Dan


Daniel Cannity (he/him)
Team Lead, Instructional Design, Engagement, and Support (IDEAS)
University of Massachusetts Amherst
e: dcannity@umass.edu”

I too actually asked the ChatAI about running submissions through plagiarism checkers and got some interesting answers as well.  Also, I love an AI that has been designed to detect whether a writing was written by another AI.  It is all very interesting.  Hold on to your seats and enjoy this rapidly changing world!

 

All Those Test Options in Blackboard & How to Give a Synchronous Test*

This blog entry is going to focus on the options in Blackboard that have to do with the timing of an test.

When you are first creating the Test.. these options are found under the Test Information area and span a few sections.  If you have already made the test you can find these options by clicking the chevron next to the test name and clicking “Edit the Test Options”.

Force Completion


When you set this option, if the student looses the connection or accidentally closes the browser, they will be unable to go back and finish the test. (Without you having to intervene anyway.)  We don’t recommend enabling this setting.

Set Timer

This option gives the student a visible countdown timer during the test. It begins after the test description and instructions have been displayed. If Auto-Submit  is selected, at the end of the count down, it ends the test, no matter where they were.  If Auto-Submit is not checked, you will see an exclamation point in the grade center and have the option to adjust the grade, if they went long.

If the Force Completion is not set, and a student looses their connection or accidentally closes the browser, they will be able to continue taking the test, and the timer will continue from when it initially started. (eg., If they loose the connection for 10 minutes, they loose that 10 minutes.)

Display After and Until

A better way of handling whether students can see the test, rather than the “Make the Link Available” option.  Also consider, they can’t start what they cannot see.  *So if you want everyone to be done by 1pm and you have a 30 minute timer with auto-submit enabled, consider Display Until to end around 12:30. 

Due Date

Due dates (and times) do not affect the test availability (unless you choose the Do not allow students to start the Test if the due date has passed option), but rather provide a flag on the test if it was started or ended after the due date/time.

Test Availability Exceptions

This section allows you to make test rule exceptions for people that need accommodations, or have other needs depending on language or technology situations.

If these settings exist for a test or survey, you can create these exceptions:

  • Number of attempts
  • Timer
  • Availability: Date and time the test is available to the student or group
  • Force completion
  • Restrict location

 

Have any interesting testing stories to tell?  What other testing options do you have questions about?  Please comment below!

This blog is a cross post from https://you.stonybrook.edu/academictechnologyservices

Accepting Videos as an Alternative form of Course Assessment

This is about using a echo360 mashup tool to accept video submissions inside of Blackboard and which instructor will be able to grade under Needs Grading in the Grade Center.  This is an excellent alternative to high stakes grading via traditional exams.

First you will want to create an assignment. You will go to your Assignments area and go to Assessments -> Assignment.

Give it a name and add instructions for the students to follow.

Create a due date and points possible for the presentation.

Make the assignment available to the students.

Submit.

 

What the students see:  (You can also see this yourself using the student preview mode, entered by clicking on this icon in the upper right part of the screen in blackboard:

Under assignments, they locate your assignment and click in it’s name.

They see the points possible and the instructions that you wrote previously.

They need to click on Write Submission to get to the Blackboard WYSIWYG editor. They should type the name of their assignment into this text box and then select the Mashups button.

Then they click on Mashups -> Echo360 Video Library

This opens a new window for them where they have three choices.    They can choose any video already in their echo360 video library. (That is Choose From My Home), they can create something new (Create New Media) or Upload a video they have on their computer. This is what the different options look like:

Choose from home allows the student to either browse or search for files in their echo360 library.

Create New Media will give them the option to Launch Universal Capture from their computer.

Where they can name the video and start recording from their webcam, desktop and audio.

and finally Upload Existing:

Here they can grab videos from their cloud storage locations or browse from their computer.

After they have typed the name of their presentation and selected the video, they will click submit.

After submitting they will get a submission confirmation:

As the instructor, you can find the student submission under Needs Grading in the Grade Center:

…where I will see the list of submitted assignments and I can either chose Grade All or go through them one by one.  Here is the assignment I submitted and you can view the presentation, grade it and leave feedback for the learner right here.

Have a used clicker?

Some used clickers are coming from classroom kits where, because they are used differently than we do here at SBU, have had their clicker IDs changed and they no longer match the ID printed on the back on the device.  This will result in your course results not processing correctly.

To check to see if you device ID is set correctly…

 

press the wrench button
then the go right button twice
press the button under where it says OK
press under OK one more time
You should see Device ID: and whatever the device is set to will show here.
see if that matches what is on the back, printed on the clicker.

IF IT DOES NOT MATCH;  please email sliebschner@turningtechnologies.com   

After contacting Susan, follow her instructions to have this resolved.

 

 

 

 

Missing Clicker Grade? Check this:

I have written about this before, but the clicker looks different, so I thought it was worth going over again.

There are two different ways that a student can use a clicker to send information to the instructor.  The first is the normal use of the clicker in the classroom… the poll response.  When a student uses this, the screen looks like this,

And when the student answers, they get a confirmation that the answer was received, and as long as the poll was given some grade, they may also get points in their blackboard grade book.

The second thing that students can send with their clickers are Messages.  The student enters into this mode by pressing the wrench button on the clicker,

and then sending the message

The student also gets a happy confirmation that this has been sent.. and messages can only be sent when the polls are open. But there are no grades or points associated with this activity, and if they believe they have answered a poll, they will get a zero.

As the instructor, you can check to see if this is happening in your class by opening the TurningPoint 8 software, go to the Manage tab, select a session file and click on Reports.

If you, like me get this error – ignore it

just click ok

and use the pulldown to select the report type Session Log

 

If you see entries that look like:

“Doe, John (8D5678) sent a message to the presenter: D”

You have students that think they are answering polls, but are really sending messages.  If you see things like:

“Doe, John (8D5678) sent a message to the presenter: Can you talk more about Mitosis?”

You have students who are sending messages, thinking you will see them and respond.

If you would like to see messages during class – you can.

You can click on the button as seen above that looks like a comic dialog bubble..  and that brings up a chat area that looks like this:

I hope this helps, and if you have any questions, feel free to reach out to either TLT @ tlt@stonybrook.edu or Turning Technologies at support@turningtechnologies.com

 

Right now – SBU is using Turning Point Cloud for clickers in our classrooms.  As of tomorrow (May 31st), Turning Technologies will be releasing a new version of the software called Turning Point 8.  It will show up as a download from your instructor user account through Turning Technologies:

 

 

Turning Point 8 is NOT backwards compatible.  Any assessment and quizzes made with Turning Point 8 will NOT work in our classrooms and lecture halls.  (See above in the screen shot where it says “Before you download, please check with your institution…”)

The new version also will not be compatible with loading grades into blackboard until we decide to switch to the new version… so even if you only teach with your own laptop, you will not want to use anything but Turning Point Cloud at this time.

 

Interested in Data-Driven Instruction?

Screen Shot 2015-03-23 at 2.08.42 PM

You might be interested in the Lynda.com course:

Teaching Fundamentals: Data-Driven Instruction

with Riyaz Gayasaddin” where I grabbed this screen shot.

Here is a link that will work great for Stony Brook University faculty:  http://www.lynda.com/Excel-tutorials/Teaching-Fundamentals-Data-Driven-Instruction/173755-2.html?org=stonybrook.edu

Exercise files include a great mastery spreadsheet template.

Also… have you used Item Analysis in Blackboard??  It is very very helpful:

 

 

 

 

Jumped the Shark

Turning Technologies will last a few more seasons, but Fall 2014 will be the year when they jumped the shark.  It’s too close to the advent of newer methods of student responses for such a large hiccup.  Really a shame they couldn’t have gone out more peacefully.

I’m happy to say that it is supposed to work much better this spring. (Installing the new version on my computer as we speak.)  You can check to see if you have the newest version by opening up your application, then clicking on the TurningPoint Cloud logo at the bottom on the screen.  A window will appear and one of the buttons is Check for Updates.

 

fonz