December 2021 – Education & Teacher Conferences Skip to main content
The Best Kind of Practice for Students Depends on the Learning Goal
Andrew Watson
Andrew Watson

In some ways, teaching ought to be straightforward. Teachers introduce new material (by some method or another), and we have our students practice (by some method or another).

Result: THEY (should) LEARN.

Alas, both classroom experience and psychology/neuroscience research suggest that the process is MUCH more complicated.

For instance:

When we “introduce new material,” should we use direct instruction or more of an inquiry/problem-based pedagogy? *

When we “have our students practice,” what’s the very BEST kind of practice?

Around here, we typically offer two answers to that 2nd question: retrieval practice and interleaving.

Retrieval practice has gotten lots of love on this blog — for instance, here. I have written less about interleaving, mostly because we have less research on the topic.

But I’ve found some ripping good — and very practical — research to share here at the end of 2021.

“What?,” “Why?,” and Other Important Questions

Let’s start with definitions.

Let’s say I teach a particular topic today: “adjectives.” And tomorrow I teach “adverbs.” Next day, “prepositions.” Next: “coordinating conjunctions.”

How should I structure students’ homework?

They could do 20 adjective practice problems tonight. Then 20 adverb problems the next night. Then 20 prepositions. And so forth.

Let’s call that homework schedule blocking.

Or, they could do 5 adjective problems a night for the next 4 nights. And 5 adverb problems a night starting tomorrow night. And so forth.

If I go with this system, students will practice multiple different topics (adjectives, adverbs, prepositions…) at the same time. So, let’s call that homework schedule interleaving.

For the most part, when we compare these two approaches, we find that interleaving results in more learning than blocking. (Lots of info here. Also in this book.)

That’s an interesting conclusion, but why is it true?

In the first place, probably, interleaving is a desirable difficulty. Students must THINK HARDER when they interleave practice, so they learn more.

In the second place, well, we don’t exactly know. Our confusion, in fact, stems in part from an arresting truth: interleaving usually helps students learn, but not always.

Of course, NOTHING ALWAYS WORKS, so we’re not fully surprised. But if the exceptions helped explain the rule, that could be mightily helpful…

An Intriguing Possibility…

Two scholars — Paulo F. Carvalho and Robert Goldstone — have been studying a potential explanation.

Perhaps blocking and interleaving enhance different kinds of memories. And so, research produces contradictory results because researchers use different kinds of memory tests.

Specifically, they propose that:

During blocked study, attention and encoding are progressively directed toward the similarities among successive items belonging to the same category,

whereas during interleaved study attention and encoding are progressively directed toward the differences between successive items belonging to different categories.

In other words: blocking focuses students on the properties of a particular category (“adjectives”). Interleaving focuses students on the distinctions among different categories (“adjectives, adverbs, prepositions”).

And so: if I want students to DEFINE ONE topic or idea or category (“adjectives”), blocking will help them do that well.

If I want students to COMPARE/CONTRAST MANY topics or ideas or categories, interleaving will help them do that well.

To repeat the title of this blog post: “the best kind of practice for students depends on the learning goal.”

In their most recent study, Carvalho and Goldstone test this possibility.

Sure enough, they find that students who block practice do better at defining terms, whereas those who interleave practice do better at multiple-choice questions.

The study gets splendidly intricate — they work hard to disprove their own hypothesis. But once they can’t do so, they admit they they just might be right.

Caveats and Classroom Implications

Caveat #1: “one study is just one study, folks.” (Dan Willingham.)

Although, to be fair, Carvalho and Goldstone have been building a series of studies looking at this question.

Caveat #2: The researchers worked with adults (average age in the 30s) studying psychology topics.

Does their conclusion hold true for K-12 students learning K-12 topics? Maybe…

Caveat #3: Practically speaking, this research might focus on a distinction that evaporates over time.

In truth, I always want my students to know specific definitions — like “tragedy” — well. And, I want them to compare those well-known definitions flexibly to other definitions — like, say, “comedy.”

An an English teacher, I — of course! — want my students to define adjective. AND I — of course!! — want them to compare that definition/concept to other related ideas (adverbs; participles; prepositional phrases acting as adjectives).

In other words, I suspect the ultimate teaching implication of this research goes like this:

We should have students BLOCK practice until they know definitions to some degree of confidence, and then have them INTERLEAVE practice to bring those definitions flexibly together.

To be clear: I’m extrapolating, based on my classroom experience and on my reading in this field.

Until my interpretation gets more research behind it, Carvahlo and Goldstone’s research suggests this general plan:

START BY DECIDING ON THE GOAL.

If you mostly want your students to know individual concepts, have them block their practice.

If you mostly want them to bring several topics together, have them interleave practice.

As your goal changes, their homework changes too.

As is so often the case, this research doesn’t tell teachers what to do. It helps us think more clearly about the work we’re doing.

In my view, that’s the most helpful research of all.


* I think that’s a false choice; both approaches make sense under different circumstances. More on that in another blog post.


Carvalho, P. F., & Goldstone, R. L. (2021). The most efficient sequence of study depends on the type of test. Applied Cognitive Psychology35(1), 82-97.

When Does Technology Distract Students? The Benefits of Research that Contradicts My Beliefs
Andrew Watson
Andrew Watson

I spoke with several hundred students last week about research-based study strategies.

As always, students were fascinating to hear about psychology and neuroscience research: for instance, the benefits of retrieval practice.

And, as always, they did not love my alarming news about multi-tasking. My advice goes like this:

“If you want to study less and learn more, do one thing at a time.”

No insta-snap-gram-tweet-flix-chat-tok while you’re studying. One thing at a time.

Since that talk, I’ve found some interesting research about the LIMITS of that advice, so I thought I’d share it here.

Tech Problems, Tech Benefits

Our reasons to worry about technology use during class seem perfectly obvious. If I am paying attention to my tweets, I am not paying attention to my academic work.

Divided attention = less learning. Obviously.

At the same time, we can easily see ways that technology benefits learning.

If — during a lecture — students text one another to reinforce their understanding of the material (“What did the prof just say?”), they might solidify their learning.

If they look up complementary information on the interwebs, their quest might boost their comprehension. (I’ve been surprised how often my students want to do this in class, and I occasionally allow them to do so.)

So, we need a more precise question than “is technology good or bad?” We need to know — under what precise circumstances does it help? Or hurt?

Technology and Higher Order Thinking

For instance: does off-topic texting during a lecture interfere with both “lower order” and “higher order” thinking, as defined by Bloom?

And, by the way, what role does note-taking play?

A study from 2018 explores this question.

The details, of course, get complicated, but the short version goes like this. Students watched a 24 minute lecture about psychiatric diagnoses: PTSD, ADHD, OCD, and so forth. They also took notes.

Some students received and answered off-topic texts during the lecture — one about every 2 minutes.

After the lecture, students took a test.

Some of those test questions focused simply on recalling details: “How long must an individual display symptoms of PTSD in order to be diagnosed?”

The researchers designed these questions to measure knowledge and comprehension — that is, “Bloom’s level 1 & 2.”

Four questions, however, focused on deeper understanding: “Compare PTSD and ADHD. How do these disorders differ? Are there ways in which they are similar?”

That is: these questioned aimed to measure application and analysis: Bloom’s level 3 & 4.

So: what effect did the OFF-TOPIC TEXTS have on the students’ NOTES, and on their UNDERSTANDING?

The Envelope Please

The researchers’ results surprised them — and certainly surprised me.

Unsurprisingly, students distracted by texts took less complete notes.

And, also unsurprisingly, they did substantially less well on the factual questions. Texters averaged a 62 on those questions, while non-texters averaged a 71.  (If you speak stats, the Cohen’s d was 0.64. That’s an impressively large difference, at least to me.)

Here’s the surprise: researchers did NOT find a statistically significant difference between students’ scores on the application and analysis questions.

How do we explain this finding?

First: let’s admit the possibility that texting distractions do interfere with factual recall but not analysis.

Honestly, I would not have anticipated that finding, but it could be true.

Second: perhaps the timing matters. That is: these students took the test immediately after the lecture. Perhaps application and analysis — unlike mere factual recall — require more time for steeping.

That is, if the “higher order thinking skills” had been tested the next day, perhaps we would have seen a difference in those scores.

Third: perhaps the number of questions mattered. Because the researchers asked only 4 application/analysis questions, they might not have had enough data to discern a difference.

Perhaps a greater number of questions would have revealed a difference.

The Big Picture(s)

Based on this research, will I tell students “it’s okay to text during lectures”?

NO I WILL NOT.

Here’s why:

First, facts matter. If off-topic texting interferes with factual learning, that finding itself means that texting during lectures is bad.

Second, taking notes properly (almost certainly) matters. If texting  interferes with good note-taking, that finding itself should dissuade students from doing so.

Third, I’m willing to believe that texting doesn’t interfere with application/analysis, but only if other studies — with more questions and later tests — consistently demonstrate that result.

Another point also jumps out at me from this research. This study contradicts my firmly held belief that multitasking vexes learning.

I genuinely believe that IT’S A GOOD THING when research contradicts my firmly held beliefs.

If research never contradicted my beliefs, then I would never learn anything from it.

In fact, I would never need to look at research because it shows me only what I already know.

Research might prove most useful to us when it contradicts our beliefs.

Who knows, maybe I’ll go back to those students and update my advice…


Waite, B. M., Lindberg, R., Ernst, B., Bowman, L. L., & Levine, L. E. (2018). Off-task multitasking, note-taking and lower-and higher-order classroom learning. Computers & Education120, 98-111.

Learning Science for Instructional Designers by Clark Quinn
Erik Jahner, PhD
Erik Jahner, PhD

Learning Science for Instructional Designers: From Cognition to Application is a wonderful synthesis of the learning sciences for those who would like to engage in purposeful reflection and make design choices in their practice. Clark Quinn takes the perspective that the professional educator is most effective when they have built an internal model of the learner. When they understand why they are making instructional choices, the educators can adjust material or practices to adapt to a variety of learners and the contexts.

Having the professional facility to rapidly adjust to changing circumstances has been highlighted in recent years as the context of teaching has been transient at best: in-person, online, hybrid, and the “new normal.” It is difficult to find a constant approach that will work, but the principles introduced here apply across circumstances. Remember, however, that the current situation is not unique; student populations, culture, content, and policy have always been in flux. Some have said this has been an opportunity to reimagine education. Moreover, without reflecting on practice, we have sometimes become complacent and have gone through the motions without considering or affecting the desired outcome. This book offers guides for this reimagining.

Educators entered the field because of an amazement with learning, and this book offers a refreshing lens with which to engage and adapt. Readers will be engaged with ideas of how to think about existing materials and a desire to exercise instructional creativity. But this book is not a set of instructions; Quinn does not take you by the hand and tell you what to do. Instead, he empowers you to make those creative leaps guided by principled reasoning from decades of scientific research. He asks what you will do with the compendium knowledge he has synthesized for you.

The book is loaded with great nuggets of information that bring one to pause throughout and consider implications of the well-presented ideas, covering topics from creating diagrams that minimize cognitive load, to learning through reinforcement schedules, and productively using collaboration for learning. He even offers basic scaffolds for the reader to hang these ideas on. Moreover, even though the book has been marketed for instructional design, the principles apply to learning in general, allowing the reader to consider their own habit formation, problem solving skills, personal motivation, and self-improvement. This makes the text not only professionally informative but also personally valuable.

The structure of the book also makes it a great book for the busy person who can only secure small free moments or even for those of us with an attention span to short to return to tomes of theory. Each section is concise and stands alone allowing the reader to engage in small bursts of interest. Additionally, for those that prefer reading with strategic use of visuals the text also has plenty of diagrams that scaffold and ground the ideas presented.

While written to be accessible to the novice, it is technical enough to be a useful reminder to the expert instructor or researcher who will also find some utility in the clear and concise writing style. I even found quite a few familiar ideas presented in new ways that inspired me to rethink old problems. Although this is not a theory laden book, Quinn brings the theory alive, not with overwhelming narratives, but through reflective questions at the end of each section that inspire and generate curiosity. I believe he will reinvigorate the sense of adventure and experimentation that led the educator to the field in the first place and can return us to a state of wide-eyed engagement with learning as a science.

Why I Still Love Learning and the Brain Conferences
Andrew Watson
Andrew Watson

I attended my first Learning and the Brain in 2008; I believe the topic was “The Science of Attention.”

Since then, I’ve attended at least two dozen: in New York, Chicago, Washington, San Francisco. Discussing Stress, and Memory, and Ethics, and Technology. And, of course, learning.

At some point, you might reasonably think, I’d get tired of the handouts and the slides and the coffee.

But, no: I still can’t get enough.

Reason #1: Old Friends

Being an interdisciplinary endeavor, the field of Mind, Brain, and Education is dramatically large…and comfortably small. When you come back, you start recognizing folks right away.

John Almarode presents regularly (and, with his bow tie, vivaciously) about applying cognitive science to the classroom. A post-presentation chat with John is one of the great learning experiences you’ll ever have.

I met Sarah Flotten — currently the interim Director of the Peter Clark Center for Mind Brain Education — through a friend several years ago. It’s now an annual event to catch up with her insights, her school, and her center.

Joanna Christodoulou (a former professor of mine) combines knowledge of neuroscience, knowledge of reading, and enthusiasm so compellingly that I’m still learning from her. I get to catch up with here every year or so at LatB.

This list could go on at length: Pooja Agarwal and Ellen Anderson, and even David Daniel (who doesn’t like it when I mention him in the blog).

In brief: if you want to find colleagues who think the way you do about teaching and learning, you’ll find them here. Even better: you’ll build relationships and coalitions that grow over the years.

Reason #2: New Friends

Once you enter the world of Mind, Brain, and Education — on this blog, on twitter, at the conferences — you’ll start meeting people from (literally) across the globe.

At this most recent conference in Boston, I FINALLY got to meet people I’ve been online chatting with for years.

Beth Hawks (twitter handle @PhysicsHawk) — a science teacher, who blogs here — offers a rare twitter presence. She is encouraging, wise, well-informed, and unwilling to be bamboozled by uplifting-but-empty slogans. I’ve been liking her posts for years, and got to meet her in Boston.

Kristin Simmers (@KristinASimmers) — currently studying the intersection of neuroscience and education — reached out to me about my first book AGES ago, and we’ve been in e-conversation ever since. Perhaps 2 years after that first e-exchange, we got to have lunch at the conference. Where else would I get to meet her in person?

Your MBE colleagues are out there — sometimes a continent away. You can meet them at the conferences.

Reason #3: SO MUCH TO LEARN

Of course, depending on your interests, this could be reason #1.

Even after 14 years, I still have so much to learn in this field. The speakers explore their research and insights — challenging me (and each other) to rethink settled ideas in light of new information.

For instance: on the very first day of the Boston conference, two speakers (politely, curiously) squared off on this important question: can we use conscious strategies to respond to stressful environments?

If the answer is “yes,” then we can guide our students (and our colleagues, and ourselves) down one path.

If the answer is “no” — because “stress turns off the pre-frontal cortex” — then we need a different path entirely.

What’s the correct answer? Honestly: check out Judson Brewer and Bessel van der Kolk to see whose analysis you find more persuasive.

https://www.youtube.com/watch?v=gv-CmqMecVY

https://www.youtube.com/watch?v=d_YApSkqsxM

The best place I know to hear these debates and have these conversations: Learning and the Brain.

Beyond FOMO

If you’re worried that you’ve missed out, I’ve got good news: the schedule for the February Conference in San Francisco has been posted!