Your Rotation Is Your Board Prep: How to Prepare for COMAT and Shelf Exams

Maya Brooks

Hi everyone, and welcome back to the AI Med Tutor podcast. I’m Maya Brooks, your AI-generated fourth-year medical student co-host. I’m here to bring the student perspective to these conversations—the questions we ask, the challenges we run into, and the things that can make medical school and board preparation feel harder than they need to be. And as always, I’m joined by Dr. Randy Clinch. Dr. Clinch, today I want to talk about something that becomes part of the rhythm of third year pretty quickly. You start a rotation. You’re trying to learn how that service works, take care of patients, prepare for rounds, complete whatever your school requires, and somehow you’re also supposed to prepare for a COMAT or Shelf exam at the end. And then someone reminds you that all of this is supposed to be preparing you for Level 2 or Step 2 eventually. I remember wondering whether I was studying for the rotation, studying for the COMAT or Shelf, or supposed to be studying for boards.

Dr. Randy Clinch

Hi everyone. I’m Dr. Randy Clinch, a DO family medicine physician and medical educator. And I think the answer is that ideally, those shouldn’t be three completely separate things. One of the biggest ideas we’ve developed throughout this podcast is that your clinical education and your board preparation should increasingly become part of the same learning system. Your patients give you clinical patterns. Your reading and other resources help you understand those patterns. Your question bank tests whether you can recognize and apply them. Your COMAT or Shelf gives you another measure of how well that knowledge is coming together. And eventually, Level 2 or Step 2 asks you to integrate what you’ve accumulated across all of those rotations. So today, instead of asking how to cram for your COMAT or Shelf, I’d rather have us explore how to use the entire rotation to prepare for that exam while building knowledge you’ll still have later. And before Maya and I go further, this episode is for education, not medical advice, and nothing we discuss is sponsored by any resource or vendor.

Maya Brooks

I like that distinction because I think students sometimes treat the exam as something waiting for us at the end of the rotation. We’re doing our clinical work for several weeks, and then suddenly we realize the Shelf or COMAT is Friday.

Dr. Randy Clinch

And that’s when preparation can become a rescue operation. Instead, I want students thinking about the exam from the beginning of the rotation. Schools use different rotation lengths, so there isn’t one universal schedule. But let’s use a four-week rotation as our example today because it’s easy to visualize. If your rotation is longer, you can stretch the same principles across your schedule.

Maya Brooks

Okay. It’s Monday morning of week one. I just started internal medicine, pediatrics, surgery, or another core rotation. What should I be doing?

Dr. Randy Clinch

Start with the rotation. Learn your patients. Learn the common presentations. Pay attention to what your residents and attending physicians are teaching. Complete your school’s required learning activities. But I also want you to start doing questions early. Not because I expect you to know everything already. Quite the opposite. Early in a rotation, questions can be part of how you learn.

Maya Brooks

That’s worth emphasizing because students can be reluctant to start the q-bank when they know their percentage may be pretty rough at first. There’s a temptation to tell ourselves that we’ll study the material first and start questions once we’re ready.

Dr. Randy Clinch

And when will that be?

Maya Brooks

Probably never.

Dr. Randy Clinch

That’s usually the problem. Questions aren’t merely a final examination of what you’ve already learned. They can expose what you need to learn. They introduce common presentations. They show you how concepts get tested. They reveal the distinctions you haven’t learned to make yet. So during that first week, your q-bank can function partly as a teacher.

Maya Brooks

And students may be using different banks. For a lot of osteopathic students preparing for COMAT exams, that might be TrueLearn. For students preparing for NBME Shelf exams, UWorld is very common. And some students may have access to both.

Dr. Randy Clinch

Right. And I don’t want this episode to become TrueLearn versus UWorld. Both are tools. The better question is what educational job you’re asking the resource to perform. TrueLearn has dedicated COMAT banks organized around the individual COMAT subjects and mapped to the COMAT blueprint. Students can build custom quizzes, use different testing modes, and examine performance analytics. UWorld has Shelf Review content organized around the clinical clerkships, so a student can work within the subject that corresponds to the current rotation rather than simply pulling questions randomly from the entire Step 2 bank. The specific features of these products can change over time, but the educational principle remains the same. During the rotation, use the portion of your question bank that corresponds to what you’re actually learning.

Maya Brooks

So if I’m on pediatrics, I’m not trying to prove that I can do a completely random Step 2 block during week one.

Dr. Randy Clinch

Correct. You’re building pediatrics. And this is where I think question-bank mode matters too.

Maya Brooks

This is something students debate all the time. Should I use tutor mode or timed mode? Some people will say you should always use timed mode because you have to simulate the test. Other people say you should use tutor mode because you’re still learning. Where do you come down?

Dr. Randy Clinch

I think they’re asking the wrong question. Don’t ask which mode is universally best. Ask what job the questions are performing today. If I’m early in the rotation and using questions partly to learn, tutor mode can make a lot of sense. I answer the question and commit to my reasoning. Then I receive feedback while the thought process is still fresh. I can consider why my answer was correct or incorrect, which clue I missed, why the competing answers were wrong, and what I need to repair.

Maya Brooks

So in our four-week example, week one might lean more heavily toward tutor mode.

Dr. Randy Clinch

It might. But I don’t want students turning that into another rigid rule. You don’t have to switch modes just because Tuesday of week two arrived. Change the mode when the educational job changes.

Maya Brooks

I like that because maybe I’ve already had some pediatrics experience or I have a strong pediatrics foundation. I may progress faster than someone encountering a lot of this material for the first time.

Dr. Randy Clinch

Precisely. Your performance should help determine the progression. But broadly, I think of the q-bank as changing jobs across the rotation. Early in the rotation, it functions more like a teacher. As you progress, it becomes a coach. As the exam gets closer, it increasingly becomes a simulator.

Maya Brooks

I really like teacher, coach, and simulator. Let’s talk about that coach phase because I think that’s probably where students spend a lot of the rotation.

Dr. Randy Clinch

As you move through the rotation, you should increasingly be applying what you’re learning. Now questions aren’t just introducing patterns. They’re helping you discriminate between them. You might need to distinguish bronchiolitis from bacterial pneumonia, iron deficiency anemia from thalassemia, or preeclampsia with severe features from gestational hypertension or chronic hypertension. You begin asking which clue changes what you do next. Now you’re developing clinical reasoning. This is also where patients become tremendously valuable. You saw one of these conditions yesterday, and now a q-bank gives you a variation of it. That’s a powerful learning combination.

Maya Brooks

Which sounds a lot like what we’ve talked about in our illness-script and Pattern Card episodes.

Dr. Randy Clinch

It is. If you’re early in third year and still learning how to organize clinical presentations, go back to “Illness Scripts: The Clinical Reasoning Tool for Third-Year Rotations.” And if you want a compact way to preserve an important pattern from a patient or question, listen to “Pattern Cards: Turn What You’re Learning Into What You’ll Recognize Later.” But remember something important. Don’t make a Pattern Card for every q-bank question you miss.

Maya Brooks

Because then by Friday I’ll have created another textbook.

Dr. Randy Clinch

And you’ll probably stop using it. Let the cards earn their place. Maybe a patient taught you something important. Maybe you repeatedly confuse two presentations. Maybe a question exposed a weakness that keeps recurring. Those are good reasons to capture a pattern.

Maya Brooks

Let’s talk about question volume because this is where students can get anxious. Suppose my q-bank has 250 questions for the rotation and I have four weeks. My first instinct is to divide those questions by the number of study days and decide that’s my daily requirement. Is that reasonable?

Dr. Randy Clinch

It can be useful as a planning estimate. You do need enough volume to cover the breadth of the discipline. But I wouldn’t let arithmetic become the educational strategy. Let’s say your schedule calls for twenty questions tonight. You complete twenty questions and miss six. The important issue is what happens to those six questions before you rush ahead to tomorrow’s set.

Maya Brooks

The stressed medical-student answer is probably that I need to hurry through the review because I still have another twenty questions waiting for me tomorrow.

Dr. Randy Clinch

And that’s exactly where learning can break down. Before you rush forward, figure out why you missed those questions. Was the problem content, reasoning, or mechanics?

Maya Brooks

So we’re bringing back our Miss Log framework.

Dr. Randy Clinch

Yes, although you don’t necessarily need to log every miss. If you want the deeper approach, listen to “Mastering Miss Logs: A Simple System to Capture and Retest Exam Mistakes.” Imagine you missed a question about acute pancreatitis because you genuinely didn’t know the relevant management. That’s content. Another question might be missed because you couldn’t distinguish pancreatitis from another cause of epigastric pain. That’s reasoning. Then you might miss another because the stem asked for the next best step and you answered with the diagnosis. That’s mechanics. Those misses don’t deserve the same repair.

Maya Brooks

And I think this is where the pressure to finish the q-bank can become counterproductive. Students talk about question-bank completion all the time. We ask each other how much of UWorld we’ve finished or how much TrueLearn we’ve completed.

Dr. Randy Clinch

Completion matters because you need sufficient exposure. But completion isn’t the same as conversion.

Maya Brooks

Okay, I want you to explain what you mean by conversion.

Dr. Randy Clinch

Think about what happened to the question after you completed it. Did it simply become a checkmark, or did it become improved knowledge or reasoning? The useful sequence is that you answer a question, identify the gap, repair it, retrieve the information again, retest yourself, and eventually recognize the pattern when it appears later. That’s question conversion.

Maya Brooks

So twenty questions that actually change how I think may be more valuable than forty questions that I race through just to keep my completion percentage moving.

Dr. Randy Clinch

That’s the idea. Although I don’t want students using that as permission to do five questions a day forever. You need breadth. You need repetition. And eventually you need endurance. We’re trying to balance volume with learning.

Maya Brooks

Okay, so we’re moving through our four-week rotation. During week one, the q-bank may function more as a teacher. During week two and perhaps into week three, it’s increasingly a coach. What starts happening as the exam gets closer?

Dr. Randy Clinch

Now I want the bank increasingly functioning as a simulator. That means we gradually remove some of the supports. Maybe you’re no longer getting immediate feedback after every question. You’re doing larger sets. You’re introducing timed conditions. You’re forcing yourself to retrieve without knowing exactly what pattern is coming next.

Maya Brooks

So I shouldn’t wait until the night before my COMAT or Shelf to discover that forty timed questions feels completely different from ten questions in tutor mode.

Dr. Randy Clinch

I would prefer that discovery earlier. You can know the medicine and still have difficulty demonstrating it under examination conditions. Pacing matters. Attention matters. Working memory matters. Reading the task correctly matters. Recognizing urgency matters. That’s why we’ve spent time on test-taking mechanics in prior episodes. If you find yourself running out of time or rushing through the end of blocks, listen to “Stop End-of-Block Panic: A Smarter Timed Question Workflow.” And remember our basic approach. Read the task sentence first and know what the question is asking. Then read the stem with that task in mind. Screen for instability and urgency. Form your provisional answer. Then examine the choices.

Maya Brooks

I can imagine a student hearing this and thinking that once week four arrives, it’s time to redo every question they missed, reread all their notes, watch every unfinished video, and probably add another resource.

Dr. Randy Clinch

That’s usually not the week-four plan I would recommend.

Maya Brooks

I suspected that.

Dr. Randy Clinch

By the final week, I want your performance data helping you decide where your remaining time goes. Look at what keeps showing up and what you’re still confusing. Determine which misses represent content problems, which represent reasoning problems, and which represent mechanics. Decide what needs one more focused repair and what is already good enough that you should leave it alone. This is where the philosophy from our recent episode “Your Board Prep Plan Should Learn From You” becomes very practical. Your plan should change because your performance has changed.

Maya Brooks

So maybe something that was weak in week one is now performing well in mixed questions. I don’t need to keep treating it as my biggest weakness just because it started that way.

Dr. Randy Clinch

Correct. Move it toward maintenance. Spend your limited time where the current data tell you it matters.

Maya Brooks

What about using two question banks? Let’s say my school provides TrueLearn, but I’ve also purchased UWorld. Should I be trying to finish both during every rotation?

Dr. Randy Clinch

Not automatically. Return to the question of what job each bank is performing. If you’re preparing for a COMAT, a dedicated COMAT bank can give you practice aligned with that examination’s content blueprint and style. If you’re also using UWorld because you value its Shelf or Step 2-oriented questions and explanations, decide what role it’s playing. Maybe one is your primary rotation bank and the other provides selected additional questions or targeted practice. Owning two q-banks does not automatically mean you must complete two q-banks.

Maya Brooks

That’s probably reassuring to somebody who has 300 unfinished questions in one bank and 200 staring at them from another.

Dr. Randy Clinch

The goal is not to defeat the software. The goal is to learn medicine and demonstrate that learning.

Maya Brooks

And I think there’s another practical question. What happens on the really busy clinical day? I planned twenty questions, but I got home exhausted at eight-thirty. Do I force myself through twenty questions because the spreadsheet says twenty?

Dr. Randy Clinch

This is where sustainability matters. Maybe that night you do fewer questions well. Maybe you retrieve a Pattern Card from a patient you saw that day. Maybe you repair one important miss from yesterday. Maybe you move some planned volume to a less demanding day. A study plan should guide you, not punish you. The danger is when one difficult day becomes several days of avoiding retrieval altogether. So maintain the learning loop even when the volume has to change.

Maya Brooks

That feels much more realistic to third year. Some days you leave at three. Some days you definitely don’t.

Dr. Randy Clinch

Clinical education doesn’t always respect your study calendar.

Maya Brooks

So let’s say I take my COMAT or Shelf on Friday. The exam is over and the rotation is almost over. What happens to everything I just learned?

Dr. Randy Clinch

This may be one of the most important parts of today’s conversation. Don’t throw the rotation away.

Maya Brooks

Meaning I shouldn’t mentally put pediatrics in a box labeled finished.

Dr. Randy Clinch

Correct. Level 2 or Step 2 isn’t going to ask whether you’re currently on pediatrics. It’s going to mix pediatrics with internal medicine, surgery, psychiatry, obstetrics and gynecology, family medicine, and everything else. So after the exam, do a brief Rotation Reset. Start by asking yourself what you learned that you want to keep. Then consider which patterns still confuse you, which mistakes kept recurring, and what deserves maintenance during your next rotation. We’ve devoted an entire episode to this called “The Rotation Reset: Carry Forward What Matters.” The goal isn’t to carry the whole rotation forward. Carry forward the learning that will change what you recognize and what you do next.

Maya Brooks

So when I start my next rotation, the old material doesn’t disappear. It just changes roles.

Dr. Randy Clinch

Right. Your new rotation becomes primary. An important weakness may remain repair. Selected learning from previous rotations becomes maintenance. And gradually, rotation after rotation, you’re building an integrated knowledge base. That’s why I don’t want students thinking that they first study for rotations, then separately study for COMATs or Shelves, and then someday begin studying for Level 2 or Step 2. Those shouldn’t be three disconnected educational projects.

Maya Brooks

Let me see if I can put the whole episode together. Start with the patient and use the rotation to build clinical patterns. Start your rotation-specific question bank early. Early in the rotation, let the q-bank function more like a teacher. As your knowledge develops, let it become a coach that helps you apply information and distinguish look-alike presentations. Then, as the exam approaches, increasingly let it become a simulator with larger sets, mixed retrieval, and timed conditions. When you miss questions, don’t just count them. Diagnose whether the problem is content, reasoning, or mechanics. Repair what matters and retest it. Then, after the COMAT or Shelf, carry selected learning forward instead of starting from zero on the next rotation.

Dr. Randy Clinch

That’s the system. I’d summarize it in five steps. Start with the patient, use questions, repair what the questions expose, practice performing, and then carry the important learning forward.

Maya Brooks

And whether your school uses four-week rotations, six-week rotations, eight-week rotations, or something different, the exact calendar can change. The progression doesn’t have to.

Dr. Randy Clinch

Correct. Don’t become overly attached to which week you’re in. Pay attention to what your learning needs to accomplish. Early, you’re building. Then you’re applying and discriminating. As the exam approaches, you’re increasingly demonstrating performance. And throughout the entire rotation, you’re repairing what the data reveal.

Maya Brooks

I think that also changes how we look at the COMAT or Shelf itself. It isn’t just the obstacle at the end of the rotation. It’s one checkpoint in a much longer learning process.

Dr. Randy Clinch

And that’s the perspective I hope students carry forward. Prepare seriously for the exam in front of you. You need to pass your rotations, and you want to perform well. But don’t sacrifice long-term learning for short-term cramming. The clinical patterns you build now are the same patterns you’ll need when you’re preparing for Level 2 or Step 2 and, more importantly, when you’re caring for patients.

Maya Brooks

So if you’re starting a rotation this week, you don’t need three separate study plans. Start with the rotation you’re actually on. Learn from your patients. Open the appropriate part of your question bank early. Let the questions show you what you know and what you still need to repair. Change how you use the bank as the rotation progresses. And when the exam is over, keep the learning that’s worth keeping. Start with the patient. Use questions. Repair what those questions expose. Practice performing. Then carry the important learning forward. Thanks for joining us for another episode of the AI Med Tutor podcast. And remember, stay curious, and keep learning.