One Rotation at a Time: Building Toward Shelf, COMAT, and Boards

Maya Brooks

Hi everyone, and welcome back to the AI Med Tutor podcast. I’m Maya Brooks, your AI-generated fourth-year medical student co-host, here to help you make sense of preparing for med school in the clinics and on exams. As always, I’m joined by Dr. Randy Clinch. Today, we’re talking specifically about third-year students. You’re on clinical rotations. Your days may start early and end late. You’re trying to learn from patients, contribute to the team, prepare for your upcoming Shelf or COMAT exam, complete whatever assignments your school requires, and maybe occasionally eat dinner and get some sleep. And somewhere in the back of your mind is another thought. COMLEX Level 2 or USMLE Step 2 is coming. Maybe not next month. Maybe not for quite a while. But it’s coming. So should you already be preparing for it? And if the answer is yes, how are you supposed to add board preparation to everything else you’re already doing? Dr. Clinch, where should students start?

Dr. Randy Clinch

Hi everyone. I’m Dr. Randy Clinch, a DO family medicine physician and medical educator. And I think the first thing we should do is take something off the student’s plate rather than add something to it. I do want you preparing for Level 2 or Step 2 throughout your third year. But I do not want you creating a completely separate Level 2 or Step 2 study program while you’re also trying to survive your rotations and prepare for your Shelf or COMAT exams. Done well, those activities should reinforce each other. The patient you see today can help you with your upcoming rotation exam. The questions you answer tonight can help you understand tomorrow’s patient. And the clinical patterns you build during this rotation can become part of the knowledge base you eventually bring into Level 2 or Step 2. So the goal isn’t to do two study programs. It’s to make the work you’re already doing serve more than one purpose.

Maya Brooks

And that sounds different from thinking, “I’m on pediatrics right now, so I’ll learn pediatrics. Then I’ll forget about pediatrics and move on to surgery.”

Dr. Randy Clinch

It is. Think about third year as a year of accumulating clinical patterns. Every rotation adds another layer. Pediatrics doesn’t disappear when you start surgery. Surgery doesn’t disappear when you move to internal medicine. By the end of the year, you want those specialties increasingly connected rather than stored in separate compartments. I think there are three layers that can make this manageable. Your current rotation is your primary learning layer. Previous rotations become a small maintenance layer. And recurring weaknesses create a repair layer. Primary. Maintenance. Repair. That’s really the structure I want you to remember.

Maya Brooks

Let’s start with the primary layer, because that’s probably where most of a third-year student’s attention should be.

Dr. Randy Clinch

Absolutely. If you’re on pediatrics, pediatrics should receive most of your study attention. If you’re on internal medicine, internal medicine should receive most of your attention. You have a Shelf or COMAT coming, and your clinical experiences are happening in that specialty right now. Take advantage of that alignment. And this is where I want to bring back something we’ve talked about in previous episodes: the Rule of One. You do not need to create detailed notes about every patient you see. Instead, find one patient—or even one clinical pattern—from the day that is worth keeping. Maybe you saw an older adult with pneumonia who never developed a fever. Maybe you saw heart failure presenting with wheezing that initially sounded like COPD. Maybe you saw a child with abdominal pain where appendicitis and gastroenteritis were both reasonable possibilities. Ask yourself: What was the presentation? What were the key clues? What mechanism helped explain what I was seeing? What else could this have been? And what finding helped distinguish those possibilities? That encounter can become an illness script or a compact Pattern Card. Now you’ve converted a patient encounter into something you can retrieve later.

Maya Brooks

And the patient gives the pattern some context that you probably wouldn’t get from simply reading about the diagnosis.

Dr. Randy Clinch

That’s an important part of it. Patients give medicine a story. You remember the person with shortness of breath who turned out not to have the diagnosis you initially expected. You remember the patient whose laboratory result changed the differential. You remember the attending who asked one question that made you reconsider your entire assessment. Those experiences create memory anchors. Then your studying helps you organize and test what you learned from them. That’s why I’ve said before: patients teach, and question banks assess.

Maya Brooks

So where does the question bank fit into this primary layer?

Dr. Randy Clinch

It should remain one of your main tools for preparing for your Shelf or COMAT exam. But be deliberate about how you use it. If you’re early in a rotation and still building knowledge, targeted questions and tutor mode may be useful. If you discover a specific weakness, create a focused set and repair it. As the rotation progresses, increase your exposure to mixed questions within the specialty and increasingly use timed conditions. You want to move gradually from learning toward performance. And when you review those questions, don’t just ask whether you got them right or wrong. Ask why. Was the problem content? Did you genuinely not know something? Was it reasoning? Did you know the facts but build the wrong clinical story or miss the hinge clue? Or was it mechanics? Did you misread the task, overlook an urgency qualifier, ruminate too long, or let the answer choices pull you away from your initial reasoning? That diagnosis determines what you should do next.

Maya Brooks

And there’s another resource we’ve discussed before that seems particularly useful when a patient encounter generates a very specific learning need.

Dr. Randy Clinch

There is, and that’s OpenEvidence. We discussed this in an earlier AI Med Tutor episode because there’s a practical limitation to using your subscription question bank for every targeted learning need. Your question bank has a finite number of questions. If you see a particular patient and want to immediately work through several very specific variations of that presentation, you can burn through the small number of questions your q-bank has on that narrow topic pretty quickly. That’s where a tool such as OpenEvidence can supplement your question bank. You can use it to explore a very specific clinical question and, when available within the tool, generate focused questions around exactly what you’re trying to discriminate or retrieve. Suppose today’s patient made you realize that you have difficulty distinguishing pulmonary embolism from pneumonia in a patient with pleuritic chest pain. You may want several very focused questions that force you to compare those two patterns while that clinical encounter is fresh. That’s different from what I want your subscription question bank doing most of the time. Preserve your q-bank for broader assessment, interleaving, mixed practice, and the performance analytics that allow you to track how you’re doing over time. Use a supplemental resource when you need very narrow retrieval around the patient or problem in front of you. And remember that generated educational content should be checked against reliable clinical sources. Don’t put protected patient information into an AI tool.

Maya Brooks

So that’s the primary layer: learn from the current rotation, connect patients to patterns, and use questions to retrieve and apply what you’re learning. What happens to the rotations you’ve already finished?

Dr. Randy Clinch

That brings us to maintenance. And I want to emphasize the word small. You do not need to continue studying every previous specialty at the same intensity. If you finished pediatrics and now you’re on surgery, surgery becomes primary. Pediatrics moves into maintenance. Maybe a small portion of your weekly questions includes material from previous rotations. Maybe you periodically retrieve a few high-value Pattern Cards. Maybe you revisit selected Miss Log entries that identified weaknesses you don’t want to lose. The purpose isn’t to master pediatrics all over again. The purpose is to prevent complete disappearance. Because otherwise, students can spend four weeks learning something, perform well on the Shelf or COMAT, move to the next rotation, and then barely retrieve that material for six months. Then dedicated arrives and they feel as though they have to learn everything again. I’d rather keep a small pilot light burning.

Maya Brooks

And I imagine this is where interleaving becomes increasingly valuable.

Dr. Randy Clinch

Very much so. As you accumulate rotations, you have more opportunities to compare clinical presentations across specialties. Think about shortness of breath. That could involve pulmonary medicine, cardiology, infectious disease, hematology, even anxiety or metabolic disease. Or abdominal pain. That could involve surgery, internal medicine, pediatrics, obstetrics and gynecology, or emergency medicine. Instead of organizing everything around specialties forever, you can increasingly organize some of your practice around presentations. Dyspnea. Chest pain. Edema. Weakness. Anemia. Abdominal pain. Altered mental status. Now you’re practicing something closer to what happens both on board examinations and in clinical medicine. The patient doesn’t arrive with the specialty written across their forehead.

Maya Brooks

So we have primary and maintenance. What about repair?

Dr. Randy Clinch

Repair is driven by your performance. Your question bank, your Shelf or COMAT performance, your clinical experiences, and eventually your practice assessments will show you recurring weaknesses. Those become repair targets. And this is where I want you to resist broad studying. If your Miss Log repeatedly shows that you’re confusing nephritic and nephrotic presentations, don’t decide that you need to review all of nephrology. Make the problem smaller. Build or revise a Pattern Card. Identify the hinge clues. Do a small targeted set. Then interleave the two patterns with other renal presentations. And retest later. Or perhaps your problem isn’t content at all. Maybe you repeatedly identify the diagnosis correctly but miss the next best step. Then your repair should focus on decision-making. Task. Stability. Discriminating data. Safest high-yield action. Repair what is actually failing.

Maya Brooks

I like that because it means the student’s weekly study plan can stay relatively simple. Current rotation is primary. Older rotations get some maintenance. And recurring problems get targeted repair.

Dr. Randy Clinch

That’s the system. And there will be weeks when the balance changes. If your Shelf or COMAT is approaching, primary work may dominate almost everything else. That’s appropriate. If you just finished an examination and have a little more room, perhaps you add some maintenance. If your analytics reveal a recurring problem that spans several specialties, repair may temporarily get more attention. This isn’t supposed to be a rigid percentage formula. It’s a way of deciding what deserves your limited time.

Maya Brooks

How does this change as Level 2 or Step 2 gets closer?

Dr. Randy Clinch

Gradually. And this is where another concept from previous AI Med Tutor episodes becomes useful: the Dedicated Pivot. Throughout most of third year, you are building. You’re building illness scripts. You’re building Pattern Cards. You’re learning from patients. You’re repairing weaknesses. You’re maintaining older material. As your board examination approaches, the balance begins to shift. You increasingly need to demonstrate that you can retrieve all of this information when nobody tells you what specialty the question belongs to. So you increase mixed practice. You increase random practice. You increase timed practice. Your question bank increasingly becomes a performance environment. And then those mixed blocks reveal the remaining leaks. Maybe a random block tells you that obstetric hypertension is still weak. Maybe you’re repeatedly confusing two causes of anemia. Maybe you’re losing points because of pacing rather than knowledge. Then you temporarily step out of performance mode, repair that specific problem, and return to mixed practice. So dedicated preparation doesn’t have to begin with, “Now I need to relearn third year.” Ideally, it begins with, “I’ve spent third year building this system. Now I need to make sure it performs under board conditions.”

Maya Brooks

That seems like a very different way of looking at the year. Instead of each rotation being a separate course that ends after the Shelf or COMAT, each rotation becomes another piece of Level 2 or Step 2 preparation.

Dr. Randy Clinch

That’s how I would encourage students to think about it. And it also changes how you define a successful rotation. Yes, you want to do well clinically. Yes, you want to perform well on your Shelf or COMAT. But I’d also ask: What clinical patterns did I add? Which illness scripts became stronger? What reasoning errors did I discover? What recurring weaknesses did I repair? What knowledge from this rotation do I want to keep alive? If you can answer those questions at the end of every rotation, you are accumulating something much more valuable than an isolated exam score. You are building an integrated clinical knowledge system.

Maya Brooks

Can we finish with something students can actually remember when Monday morning arrives and they’re heading back to the hospital or clinic?

Dr. Randy Clinch

Sure. I’d make it very simple. Every clinical day, learn deeply from one patient when you can. Every study session, let the current rotation remain your primary focus. Every week, keep a small amount of older material alive. When performance identifies a recurring weakness, repair it specifically rather than expanding your entire study plan. And with each new rotation, add to what you’ve already built instead of replacing it. Then, as Level 2 or Step 2 gets closer, gradually shift toward mixed, random, timed performance. You could summarize the whole third-year strategy in four words: Build. Repair. Maintain. Integrate. Build during the rotation. Repair what performance reveals. Maintain enough older material that it doesn’t disappear. And integrate increasingly as your board examination approaches.

Maya Brooks

And maybe the most reassuring part is that this doesn’t require students to create another entire study program on top of an already demanding third year.

Dr. Randy Clinch

It shouldn’t. If your board-preparation strategy consistently requires you to choose between learning from your rotation, preparing for your Shelf or COMAT, and preparing for Level 2 or Step 2, I would look closely at the system. Those activities should increasingly reinforce one another. The patient you see today can become the Pattern Card you retrieve next week. The question you miss tonight can reveal the reasoning weakness you repair tomorrow. The Shelf or COMAT preparation you’re doing this month can become part of the knowledge you maintain for the rest of the year. And when dedicated arrives, those months of accumulated clinical patterns give you something to integrate rather than something to rebuild from scratch. That’s the goal. Not another study plan. A connected learning system.

Maya Brooks

That’s it for today’s episode of the AI Med Tutor podcast, everyone. Thanks so much for listening. If you’re in your third year right now, remember: you don’t need to choose between learning from your patients, preparing for your Shelf or COMAT, and building toward COMLEX Level 2 or USMLE Step 2. Learn deeply from the rotation you’re in. Keep a little of what you’ve already learned alive. Repair the patterns that continue to cause trouble. And let each rotation add another layer to the clinician—and the test taker—you’re becoming. One rotation at a time. And, until next time, stay curious, and keep learning.