Category Archives: Measurable learning

Writing to Learn in STEM

By Kimberly Bell, Ph.D.
Teaching Assistant Development Specialist
kimberly.bell@stonybrook.edu

Writing to Learn (WRL) is a pedagogy approach that incorporates short low-stakes written assignments, peer-review, and feedback to help students gain conceptual understanding. A literature review of more than 200 studies that reported using WTL strategies in STEM courses summarizes that this approach has been shown to help students meet learning objectives related to content knowledge, conceptual understanding, scientific method, critical thinking, effective communication, metacognition, and professionalization (Reynolds et. al., 2002). Despite the evidence, WTL is still not as widely used as it could be.
Join us this Wednesday for a panel discussion with faculty that have used WTL in their STEM courses. 

Writing to Learn in STEM Panel Discussion
Wednesday, Nov. 30, 2022 at 1 p.m. ET.
In person: CELT Faculty Commons E1332 Melville Library and Zoom

Register today!

(Coffee and cookies provided in the Commons.)
You can also join us on Zoom.

Panelists:

  • Mona Monfared, Associate Professor of Teaching, Molecular & Cellular Biology, UC Davis
  • Ginger Shultz, Associate Professor, Chemistry, University of Michigan
  • Joi Walker, Associate Professor, Chemistry, East Carolina University

Research from Ginger Schultz’s group provides advice for implementing WTL widely in high enrollment introductory STEM courses (Finkenstaedt-Quinn SA, 2021). 

Student in a lab coat with a microscope and taking noets.
Research shows that using Writing to Learn strategies in STEM courses helps students gain communication and critical thinking skills.

References

Finkenstaedt-Quinn SA, Petterson M, Gere A, Shultz G. Praxis of Writing-to-Learn: A Model for the Design and Propagation of Writing-to-Learn in STEM. Journal of chemical education. 2021;98(5):1548-1555. doi:10.1021/acs.jchemed.0c01482

Reynolds JA, Thaiss C, Katkin W, Thompson RJ Jr. Writing-to-learn in undergraduate science education: a community-based, conceptually driven approach. CBE Life Sci Educ. 2012 Spring;11(1):17-25. doi: 10.1187/cbe.11-08-0064. PMID: 22383613; PMCID: PMC3292059.

Learning Goals, Objectives, or Outcomes?

By Kristin Hall, Ph. D.
Instructional Designer
Center for Excellence in Learning and Teaching (CELT)
kristin.hall@stonybrook.edu

Ever wonder what the difference is between learning goals, learning outcomes and learning objectives? These terms are often used interchangeably but at other times they are referencing different concepts. This can cause a bit of confusion. So what exactly are these terms and how do you tell the difference? More importantly, what do you need to know as an instructor when you are planning your course design?

Elizabeth Barkley and Claire Howell Major decipher these three concepts in Learning Assessment Techniques: A Handbook for College Faculty (2016).  According to Barkley and Major: 

  • Learning Goals– include what you intend for students to learn. This can be seen as a macro view of what you want students to achieve after instruction. For example: the student will learn to drive a car.
  • Learning Objectives– include identifying the steps students need to reach the learning goal. These are specific steps we expect students will achieve as they work toward  the learning goal. For example: the driving student will be able to identify common traffic signs.
  • Learning Outcomes– includes the action taken to determine if and how students achieved the learning goal. In other words, outcomes are what students actually achieved after instruction and can be determined based on evidence (assessment) of their learning. An example might be: during a road test, the driving student will demonstrate that they can safely and accurately perform parallel parking. 

If you search for these terms, you will come across different definitions. Some educational accrediting agencies will use very specific terms. It can be perplexing but our best advice is don’t get caught up in semantics. Until there is a better consensus among educators, you can loosely call of these statements learning outcomes or learning objectives. They generally point to the same thing, which is a measurable learning activity. In other words, what do you plan to teach and how will you and your student know if the learning took place?

Perhaps if you want to put a finer point on this, the best learning outcomes should be student-focused and contain a concrete learning verb. That is a critical difference when planning instruction. So instead of only focusing on what you will teach, it is perhaps more important to plan for what students will learn and how you (and they) will show that it has been learned and to what degree. This is key no matter if you are planning an in-person, online, or hybrid course. The SUNY Online Course Quality Review Rubric (OSCQR) Standard #9 addresses this explicitly: “Course objectives/outcomes are clearly defined, measurable, and aligned to learning activities and assessments.”

Again, for the purposes of effective instruction, you want to make sure these statements are specific and measurable. Why? For both the learner and the instructor, there must be some concrete guidelines that steer the teaching/learning experience and show in a transparent way whether learning has been achieved–or not. Here are a few best practices when writing learning outcomes/objectives for your courses.

Best Practices in Writing Learning Outcomes/Objectives

  1. Use one specific and measurable verb. Avoid using more than one verb as students may be able to achieve one part of the outcome/objective but not the other.  
  2. Avoid using the following word/phrases as these are often open to interpretation and not measurable: “understand, know, demonstrate an understanding, learn, be familiar with, be aware of, appreciate, have knowledge of . . .” Instead ask yourself these questions: How will I be able to determine if students know or understand?  What will they need to do?  These questions will often help you identify the specific and measurable verb.
  3. Well-written learning outcomes/objectives use student-centered specific, clear and concise language. Avoid using ambiguous words or phrases. Instead put the focus of the action the student can show or perform, not what the instructor can show or perform.
  4. Learning outcomes/objectives should be designed to be achieved within the specific time frame of the semester or (time frame of instruction). In this way, there is a deadline or endpoint both you and the student must work toward. This aspect can help you determine what content must be included in your curriculum so that students can reach that goal. Ask yourself: is it nice to know or need to know?
  5. Avoid references to course activities and specific assessments. For example, it would not be appropriate to state, “Students will be able to achieve a passing grade on the midterm exam.”  This is not a learning outcome/objective for the course.

Additional Resources:

CELT: Articulating Student Learning Outcomes and Bloom’s Taxonomy
SUNY Online Course Quality Review Rubric (OSCQR) Standard #9: Course objectives/outcomes are clearly defined, measurable, and aligned to learning activities and assessments.

If you would like assistance in writing or revising your learning outcomes/objectives for your courses, contact CELT at celt@stonybrook.edu to schedule a consultation with an instructional designer. Do you have questions or comments? Please post them below or on our Twitter handle: @CELT_SBU.

Reference:
Barkley, E. F., & Major, C. H. (2016). Learning assessment techniques: A handbook for college faculty. John Wiley & Sons.