The Types of Questions we Ask: which categories of questions should we focus on?

I think we can all agree that there are many different ways for our students to show what they know or understand, and that some problems ask for deeper understanding than others. In fact, many standardized math assessments, like PISA, aim to ask students questions at varying difficult levels (PISA uses 6 difficulty levels) to assess the same concept/skill. If we can learn one thing from assessments like these hopefully it is how to expect more of our students by going deeper… and in math class, this means asking better questions.

Robert Kaplinsky is a great example of an educator who has helped us better understand how to ask better questions. His work on Depth of Knowledge (DOK) has helped many teachers reflect on the questions they ask and has offered teachers examples of what higher DOK questions/problems look like.

In Ontario though we actually have an achievement chart that is aimed to help us think more about the types of questions/problems we expect our students be able to do. Basically, it is a rubric showing 4 levels of achievement across 4 categories. In Ontario it is expected that every teacher evaluate their students based on each the these categories. Many teachers, however, struggle to see the differences between these categories. Marian Small recently was the keynote speaker at OAME where she helped us think more about the categories by showing us how to delineate between the different categories of questions/problems:

  • Knowledge
  • Understanding
  • Application
  • Thinking

Knowledge vs. Understanding

Below are a few of Marian Small’s examples of questions that are designed to help us see the difference between questions aimed at knowledge and questions aimed at understanding:

As you can see from the above examples, each of the knowledge questions ask students to provide a correct answer. However, each of the understanding questions require students to both get a correct answer AND be able to show that they understand some of the key relationships involved. Marian’s point in showing us these comparisons was to tell us that we need to spend much more time and attention making sure our students understand the math they are learning.

Each of the questions that asks students to show their understanding also help us see what knowledge our students have, but the other way around is not true!

Hopefully you can see the potential benefits of striving for understanding, but I do believe these shifts need to be deliberate. My recommendation to help us aim for understanding is to ask more questions that ask students to:

  • Draw a visual representation to show why something works
  • Provide an example that fits given criteria
  • Explain when examples will or won’t work
  • Make choices (i.e., which numbers, visual representations… will be best to show proof)
  • show their understanding of key “Big Ideas” and relationships

Application vs. Thinking

Below are a few examples that can help us delineate the differences between application and thinking:

These examples might be particularly important for us to think about. To begin with, application questions often use some or all of the following:

  • use a context
  • require students to use things they already should know
  • provide a picture(s) or example(s) for students to see
  • provide almost all of the information and ask the student to find what is missing

Thinking questions, on the other hand, are the basis for what Stein et. al called “Doing Mathematics“. In Marian’s presentation, she discussed with us that these types of questions are why those who enjoy mathematics like doing mathematics. Thinking and reasoning are at the heart of what mathematics is all about! Thinking questions typically require the student to:

  • use non-algorithmic thinking
  • make sense of the problem
  • use relevant knowledge
  • notice important features of the problem
  • choose a possible solution path and possibly adjust if needed
  • persevere to monitor their own progress

Let’s take a minute to compare questions aimed at application and questions aimed at thinking. Application questions, while quite helpful in learning mathematics concepts (contexts should be used AS students learn), they typically offer less depth than thinking questions. In each of the above application questions, a student could easily ignore the context and fall back on learned procedures. On the other hand, each of the thinking questions might require the student to make and test conjectures, using the same procedures repeatedly to find a possible solution.

Ideally, we need to spend more time where our students are thinking… more time discussing thinking questions… and focus more on the important relationships/connections that will arise through working on these problems.

Final Thoughts

Somehow we need to find the right balance between using the 4 types of questions above, however, we need to recognize that most textbooks, most teacher-made assessments, and most online resources focus heavily (if not exclusively) on knowledge and occasionally application. The balance is way off!

Focusing on being able to monitor our own types of questions isn’t enough though. We need to recognize that relationships/connections between concepts/representations are at the heart of expecting more from our students. We need to know that thinking and reasoning are HOW our students should be learning. We need to confront practices that stand in the way of us moving toward understanding and thinking, and set aside resources that focus mainly on knowledge or application. If we want to make strides forward, we need to find resources that will help US understand the material deeper and provide us with good examples.

Questions to Reflect on:

  • What did your last quiz or test or exit card look like? What is your current balance of question types?
  • What resources do you use? What balance do they have?
  • Where do you go to find better Understanding or Thinking questions?
  • What was the last problem you did that made you interested in solving it? What was it about that problem that made you interested? Likely it was a Thinking question. What was it about that problem that made it interesting?
  • Much of the work related to filling gaps, intervention, assessment driving learning… points teachers toward students’ missing knowledge. How can we focus our attention more toward understanding and thinking given this reality?
  • How can we better define “mastery” given the 4 categories above? Mastery must be seen as more than getting a bunch of simple knowledge questions correct!
  • Who do you turn to to help you think more about the questions you ask? What professional relationships might be helpful for you?

If you haven’t already, please take a look at Marian Small’s entire presentation where she labels understanding and thinking as the “fundamentals of mathematics”

I’d love to continue the conversation about the questions we ask of our students.  Leave a comment here or on Twitter @MarkChubb3

Aiming for Mastery?

The other day, a good friend of mine shared this picture with me asking me what my thoughts were:

mastery

On first glance, my thoughts were mixed.  On one hand, I really like that students are receiving messages about mistakes being part of the process and that there is more than one opportunity for students to show that they understand something.

However, there is something about this chart that seems missing to me…  If you look at the title, it says “How to Learn Math” and the first step is “learn a new skill”.  Hmmm…… am I missing something here?  If the bulletin board is all about how we learn math, the first step can’t be “learn a new skill”.  For me, I’m curious about HOW the students learn their math?  While this is probably the most important piece (at least to me), it seems to be completely brushed aside here.

I want you to take a look at the chart below.  Which teaching approach do you think is implied with this bulletin board?  What do you notice in the “Goals” row?  What do you notice in the “Roles” row?  What do you notice in the “Process” row?

Teaching Approaches - New

If “Mastery” is the goal, and most of the time is spent on practicing and being quizzed on “skills” then I assume that the process of learning isn’t even considered here.  Students are likely passively listening and watching someone else show them how… and the process of learning will likely be drills and practice activities where students aim at getting everything right.


I’d like to offer another view…

Learning is an active process.  To learn math means to be actively involved in this process:

  • It requires us to think and reason…
  • To pose problems and make conjectures…
  • To use manipulatives and visuals to represent our thinking…
  • To communicate in a variety of ways to others our thinking and our questions…
  • To solve new problems using what we already know
  • To listen to others’ solutions and consider how their solutions are similar or different than our own…
  • To reflect on our learning and make connections between concepts…

It’s this process of learning that is often neglected, and often brushed aside.


 

While I do understand that there are many skills in math, seeing mathematics as a bunch of isolated skills that need to be mastered is probably neither a positive way to experience mathematics, nor will it help us get through all of the material our standards expects.  What is needed are deeper connections, not isolating each individual piece… more time spent on reasoning, not memorizing each skill… richer tasks and learning opportunities, not more quizzes…

“One way to think of a person’s understanding of mathematics is that it exists along a continuum. At one end is a rich set of connections. At the other end of the continuum, ideas are isolated or viewed as disconnected bits of information. A sound understanding of mathematics is one that sees the connections within mathematics and between mathematics and the world”
TIPS4RM: Developing Mathematical Literacy, 2005

So, while I don’t think putting up a bulletin board (or not) is really going to do much, I really do hope we are spending more of our time thinking about HOW our students learn and WHAT our goals are for our students (see the chart above again).

I still wonder what it means to be good at math?  I wrote about my questions here, but I am still looking for ways to show others how important mathematical reasoning is for students to develop.  Skills without reasoning won’t get you very far.  Maybe more about this another time…