Using COMSAE Phase 2 Reports to Study Smarter for COMLEX Level 2

Maya Brooks

Hello everyone, and welcome back to the AI Med Tutor Podcast. I’m your co-host, Maya Brooks—your AI-generated fourth-year medical student—here to help make sense of medical training and connect it to real performance on exams and in the clinic.

Dr. Randy Clinch

And I’m Dr. Randy Clinch, a DO family medicine physician and medical educator. Today’s episode is for students preparing for COMLEX Level 2 who are using COMSAE Phase 2 as a benchmark and feeling frustrated because the score report often doesn’t show the actual questions you missed—especially when the exam is school-administered. The good news is that you can still use that report to make your next week of study dramatically smarter. We’re going to teach you how to use COMSAE Phase 2 score reports that do and do not include item review, and how to combine that information with your question bank analytics to find real performance trends and fine-tune your study plan. Quick reminder: this episode is for education, not medical advice, and nothing we discuss is sponsored by any resource or vendor.

Maya Brooks

This is such a helpful topic because students either ignore the report because they can’t see the questions, or they overreact to it and try to study everything at once.

Dr. Randy Clinch

Right. Today we’re going to give you a calm, repeatable process. I want you to hear the main idea up front: your COMSAE report tells you where points are leaking; your question bank tells you which patterns inside that category are leaking. When you cross those two data sources, you get a plan you can actually execute.

Maya Brooks

Let’s start by making sure students know what they’re looking at. What kinds of categories are typically on a COMSAE Phase 2 report?

Dr. Randy Clinch

Students typically see performance across three views. The first view is competency domains—categories like osteopathic principles and practice, patient care and procedural skills, application of knowledge for osteopathic medical practice, practice-based learning and improvement, interpersonal and communication skills, professionalism, and systems-based practice. The second view is clinical presentations—things like respiratory, circulatory and hematologic, gastrointestinal and nutritional health, genitourinary and renal, nervous system and mental health, endocrine and metabolism, musculoskeletal, integumentary, and a few broader categories like community health and human development/reproduction/sexuality. The third view is disciplines—clinical areas like internal medicine, surgery, family medicine, pediatrics, OB/GYN, psychiatry, emergency medicine, and osteopathic principles and practice. Your report will usually show you whether you’re above, at, or below a national reference group in those categories, and that’s enough to drive smart decisions.

Maya Brooks

So even if you don’t see the exact missed questions, you still have a map—three different ways of describing where your performance is weaker.

Dr. Randy Clinch

Exactly. It’s a map, not a microscope. Your question bank becomes the microscope.

Maya Brooks

Now, students may have two different situations. Sometimes they get a score report without any item review, and sometimes they purchase an exam themselves and can see missed items. How should we teach them to handle both?

Dr. Randy Clinch

We’ll teach two pathways. Pathway A is “no answer key.” Pathway B is “answer key available.” The good news is that both pathways end at the same place: a focused plan for next week built around overlap with your question bank performance.

Maya Brooks

Let’s do Pathway A first: no answer key. The student has category bars—above, at, below—but no questions to review. What do they do?

Dr. Randy Clinch

Here’s the no-answer-key workflow. Step one: circle your lowest categories, but keep it small. I want you to pick two or three “priority flags” total. A good default is: one or two clinical presentation categories, plus one discipline category. If you want a third, pick a competency domain that looks consistently weak. Step two: crosswalk those flags into your question bank analytics. Step three: build two mirrored practice sets that match the weakness and test the discrimination. Step four: schedule a retest later in the week to prove improvement.

Maya Brooks

That’s really clear. Let’s slow down on the “crosswalk,” because that’s the part students may not know how to do.

Dr. Randy Clinch

Crosswalk just means: take the COMSAE category label and find the closest matching category in your question bank. Some question banks use similar terms—clinical presentation, system, discipline, blueprint categories—or have filters that mirror the practice exam language. If your report says you’re below in Respiratory, go into your question bank and pull your Respiratory performance. If the report says Circulatory and Hematologic, pull cardio plus heme breakdowns. If it says Nervous System and Mental Health, check neuro and psych. If it says Internal Medicine or Surgery is low, look at the disciplines or the content that tends to live inside those vignettes.

Maya Brooks

And then students should look for trends inside that category, not just a percentage.

Dr. Randy Clinch

Exactly. Inside that category, I want students to ask: “What are the top three repeating patterns I keep missing?” For respiratory, that might be PE workup, pneumonia variants, COPD versus heart failure discrimination, asthma management, acid-base/ventilation interpretation. For circulatory/heme, it might be chest pain decision-making, shock patterns, anemia pattern discrimination, anticoagulation complications. The COMSAE report points you to the neighborhood; the qbank tells you which houses you keep getting lost in.

Maya Brooks

Now tell us about these “mirrored practice sets.” What does that mean?

Dr. Randy Clinch

It means you create two kinds of sets for each priority flag. The first is a targeted set: questions filtered to the weak category so you get reps in the exact area the COMSAE report flagged. The second is a discrimination set: an interleaved set that forces you to tell look-alikes apart. For example, if respiratory is weak, your discrimination set might alternate PE versus pneumonia versus heart failure versus COPD in shortness-of-breath stems. If renal is weak, you might alternate nephritic versus nephrotic patterns, or acid-base mixed with pulmonary compensation. This prevents you from improving only in a narrow, predictable context.

Maya Brooks

So targeted set builds strength, and the discrimination set makes that strength usable in new stems.

Dr. Randy Clinch

Exactly. One builds the muscle; the other tests whether the muscle works when the question looks different.

Maya Brooks

Okay, Pathway B: the answer key is available. This is more common if the student purchases their own practice exam. What changes?

Dr. Randy Clinch

You add an item-level layer. The workflow becomes: item triage, then category clustering, then the same mirrored sets and retesting. Item triage means every missed question gets sorted into one bucket: content, reasoning, or mechanics. Content means you didn’t know or understand the concept or mechanism. Reasoning means you chose the wrong story or missed the hinge clue. Mechanics means you missed the task, missed an urgency or stability cue, or got pulled into an answer-choice trap. After you triage 15–20 misses, you’ll often see a theme emerge: “I’m missing respiratory, but it’s mostly because I’m shaky on PE decision-making,” or “my cardio misses are mostly next-step errors in unstable presentations.”

Maya Brooks

And then they map those misses back to the same categories they see on the COMSAE report.

Dr. Randy Clinch

Exactly. That’s category clustering. You tag each miss with one clinical presentation category and, if helpful, one discipline category. Then you look for clusters: where are most of my misses landing? Those clusters become your primary and secondary targets for the week.

Maya Brooks

Now I want you to emphasize the “overlap rule” you mentioned earlier, because that’s what prevents students from chasing every weakness.

Dr. Randy Clinch

The overlap rule is simple: prioritize what is weak on COMSAE and weak in your question bank analytics. If COMSAE flags respiratory and your question bank also flags respiratory, that’s a target area you should pay attention to. If COMSAE flags a category but your question bank shows you’re strong there, don’t panic—sub-category reporting can be noisy. Your plan should follow consistent signals, not one isolated bar.

Maya Brooks

So we’re using two data sources to reduce the chances of chasing a mirage.

Dr. Randy Clinch

Exactly. Two independent signals are more trustworthy than one.

Maya Brooks

Let’s give a concrete example students can picture. Let’s say their COMSAE shows below average in Respiratory and Circulatory/Hematologic, and maybe one discipline category is low too. What do they do next?

Dr. Randy Clinch

Here’s how that turns into a week plan. First, they pick a primary and secondary. Primary might be Respiratory if it’s the lowest and also low in the question bank. Secondary might be Circulatory/Heme. Maintenance might be a category they’re at or above average in, kept warm through mixed blocks. Then they build two mirrored sets for the primary. For Respiratory: a targeted set filtered to respiratory plus key subtopics, and an interleaved discrimination set that alternates shortness-of-breath look-alikes—PE, pneumonia, heart failure, COPD/asthma. For Circulatory/Heme: a targeted set on chest pain, shock, anemia patterns, and an interleaved set that alternates MI versus pericarditis versus PE decision-making, or microcytic versus macrocytic anemia stems. Then they schedule one retest late in the week: a timed mixed block to see if the improvements hold up when questions are shuffled. The goal is not perfection; the goal is measurable movement in the categories that matter.

Maya Brooks

And if their report flags a competency domain like “patient care and procedural skills,” how would that show up as a study action?

Dr. Randy Clinch

That’s usually a clue that next-step decision-making, prioritization, and management sequencing may be the issue. In that case, students should build targeted “most appropriate next step” sets using their qbank filters and focus their review on stability cues, urgency cues, and what single data point changes management. That’s a mechanics-and-reasoning blend. The category label points to the style of thinking to practice. Students can check-out our prior podcast episode on "Mastering Next-Step Questions" for more tips on how to approach those type of questions.

Maya Brooks

Let’s talk about a common frustration: “My COMSAE says I’m below average in a category, but I don’t know what questions caused that.” How do we keep students from spiraling?

Dr. Randy Clinch

We give them a rule: do not try to solve the entire category at once. Solve the top patterns inside the category. Use the question bank to find the top three repeating misses inside the weak category, then run a small loop: targeted set, repair, retest. If you do that for two or three patterns, the category score moves. Category bars are not solved by massive, vague studying. They move when you fix repeating patterns.

Maya Brooks

Now we need to make sure students know how to use question bank filters that mirror practice exam language. What should they look for?

Dr. Randy Clinch

They should look for any of the following in their qbank: system-based filters, blueprint or clinical presentation filters, discipline filters, or tagged learning objectives. If the qbank uses “Respiratory System” or “Genitourinary/Renal,” that’s a direct crosswalk. If it uses disciplines like internal medicine or surgery, that’s also helpful. Some banks allow keyword search on topics like “hypotension,” “shock,” “airway,” “PE,” “anion gap,” “murmur,” which can create small targeted sets when your category flag is broad. The key is to align the language between the score report and the qbank so you’re comparing apples to apples.

Maya Brooks

What about students who are using multiple resources? How do we keep them from turning this into a resource overload situation?

Dr. Randy Clinch

Keep the loop tight. Use the COMSAE report to choose targets, use the qbank to generate reps and analytics, and use a single core reference for precision content repair when needed. If a student adds more and more resources after every report, they lose time and coherence. The score report should narrow the plan, not widen it.

Maya Brooks

Quick-start version. If a student took a COMSAE today and wants to use it tonight, what should they do?

Dr. Randy Clinch

Tonight, they do this. First, pick two or three priority flags from the report: one or two clinical presentation lows and one discipline low. Second, open the qbank analytics and find the matching categories. Third, identify the top three repeating patterns inside the primary category. Fourth, schedule two sets for that category this week: one targeted set and one interleaved discrimination set. Fifth, schedule a timed mixed retest later in the week. If they have item review available, they add the extra step of triaging misses into content, reasoning, or mechanics and letting that guide the repair strategy.

Maya Brooks

Recap time. What do you want students to remember?

Dr. Randy Clinch

COMSAE score reports are useful even without item review. They tell you where your performance is relatively lower across competency domains, clinical presentations, and disciplines. If you don’t have missed questions, treat the report like a map, then use your question bank analytics to find the repeating patterns inside the weak categories. Build mirrored sets—a targeted set and an interleaved discrimination set—and retest later in the week. If you do have item review, add item triage and category clustering. In both cases, follow the overlap between COMSAE lows and qbank lows, and keep your plan focused: fix repeating patterns, prove improvement, then adjust next week.

Maya Brooks

That’s it for today’s episode of the AI Med Tutor Podcast. If you know someone who took COMSAE Phase 2 and doesn’t know what to do next, send them this episode.

Dr. Randy Clinch

And remember: your score report isn’t a verdict. It’s a targeting tool.

Maya Brooks

We’ll see you next week everyone! And in the meantime—stay curious and keep learning!