skip to main content
iatroX JournalGamification

Answer First, AI Second: A Practical Way to Study Clinical Reasoning

Featured image for Answer First, AI Second: A Practical Way to Study Clinical Reasoning

An AI explanation can be helpful without showing what you understood before reading it. A practical way to preserve that distinction is to make an initial attempt, state the reason and then use assistance to examine the part that remains unclear.

The sequence is simple: attempt, explain, compare, question, verify and try again in a changed context. Its purpose is to make the learning activity more deliberate, not to turn AI into a compulsory stage after every medical question.

This article describes a proposed study method using fictional material. It is not a validated protocol for preventing diagnostic error or deskilling, and it is not a reason to withhold necessary advice or supervision during real patient care.

Start with the task you want to practise

Choose a task that requires an answer you can explain. That might be a diagnosis, a priority, a next action or a relationship between concepts.

In stat, the three scenes are independent decisions. Read whether you are being asked who needs attention first, what should happen next or what should change in a proposed plan. A reasonable answer to a different question is still a problem worth noticing.

Do not begin by asking AI to summarise the case and choose an option. That would remove the initial interpretation you intend to examine.

Instead, write a short statement of the problem. Include the relevant setting and the information that appears to drive the decision. Where a fact is missing, leave it missing rather than filling the gap with the feature you expect to see in a familiar case.

A worked example: an absence that was never established

Consider this original fictional teaching note:

An adult describes intermittent dizziness. The note records that several episodes occurred after standing. It does not state whether other episodes occurred at rest, whether there were palpitations or whether blood pressure was assessed during symptoms.

The learning task is deliberately narrow: which information is known, and which apparent negative findings would be assumptions? It is not a request to diagnose or manage the patient from this short paragraph.

An initial learner explanation might be: "This must be a purely postural problem because there are no episodes at rest, no palpitations and no abnormal observations."

The note does not support those three negative statements. It describes some episodes after standing and leaves the other questions unanswered.

The first useful correction is therefore not another diagnosis. It is a more faithful description of the available information: "Some episodes have a postural association; the remaining pattern and relevant observations have not been established."

That correction creates a better question for subsequent discussion.

Keep confidence separate from the explanation

A confidence judgement can help preserve how the first attempt felt. It should not determine whether the reasoning is accepted.

stat allows a confident-or-unsure selection separately from the points awarded. That can be useful when reviewing why a familiar-looking question seemed straightforward or why a correct choice still felt uncertain.

In the fictional example, the learner might have been confident because the phrase "after standing" resembled a previously encountered case. That is something to investigate, not proof that a particular bias has been diagnosed.

The useful record remains small: the answer, the reason and the degree of uncertainty you actually felt. There is no need to invent a probability such as 87% when that precision does not represent a considered judgement.

Compare with the explanation before opening an AI conversation

Read the authored debrief first. Identify the smallest meaningful difference between it and your own account.

In the example, the difference is not simply that the published answer was longer. It is that your explanation treated unrecorded findings as though they had been assessed and found absent.

A useful comparison sentence is: "My conclusion depended on three negatives that the note did not provide."

That sentence gives the AI a defined educational task. It is more productive than asking for a complete textbook review of dizziness or requesting an answer that will make your first choice look correct.

The focused-review guide explains the same principle for missed decisions and connections: establish what needs repairing before selecting more material.

Ask AI to examine the uncertainty, not defend your first answer

A suitable prompt for the fictional note is:

Treat this as an educational example, not a real consultation. Separate explicit facts from inferences and unanswered questions. Compare my explanation with the note. Identify which step is unsupported, then ask me one question that would help me revise it. Do not add symptoms, observations or test results.

This is a proposed prompt, not a guarantee that the system will follow it correctly. Check whether the response actually preserves the distinction.

If the AI replies that the patient definitely has no palpitations, it has repeated the problem rather than repaired it. Ask where that claim came from and return to the original text.

A second useful prompt is:

Give two plausible interpretations of the information that is actually supplied. Explain what additional information would distinguish them. Keep possibilities separate from established findings, and do not select a final diagnosis from insufficient information.

The point is to inspect assumptions. A long list of possibilities without explaining their relationship to the case may add volume without resolving the learning need.

Check clinical claims at the source

When the discussion moves from interpreting a paragraph to making a medical claim, inspect the source supporting that claim.

Ask whether the source concerns the same population and setting, whether it supports the actual statement and whether an important exception has been omitted. A real citation can still be irrelevant to the conclusion attached to it.

Ask-iatroX provides a separate source-linked reference route, while Socratic Tutor supports reasoning-focused discussion. Their roles should remain distinct from certifying that another AI's answer is correct.

A source disagreement should remain visible until resolved. Do not ask several systems the same question and treat a majority vote as independent clinical verification when they may be repeating the same premise.

For study, use fictional or appropriately de-identified material. A learning prompt does not need an identifiable patient record to explore the general distinction illustrated here.

Explain the revision in your own words

After the conversation, close or hide the explanation. State what changed without copying the AI's wording.

For the example: "The presence of one trigger did not establish the absence of other triggers. I need to distinguish a described feature from a question that was never answered."

That is more useful than "AI explained dizziness well" because it identifies the relationship the learner has reconsidered.

The explanation can also preserve remaining uncertainty. You might understand the information gap while still needing to review how a particular finding would affect a differential. Record that as the next question rather than implying that the whole topic is now mastered.

A good stopping point is a clearer account that you can defend, not the moment the chatbot stops producing additional suggestions.

Test the idea in a fresh problem

Now change the teaching material.

A second fictional note states that symptoms occur both when standing and when sitting. The learner should no longer use an exclusively postural description. Another version explicitly records that palpitations were asked about and denied. That negative can now be included, while its clinical significance still requires interpretation.

These are manually prepared variations. Their purpose is to test whether the distinction survives a change in wording and information, rather than whether you remember the original preferred option.

For an association task, use clinical connections. Before reading a revealed category, explain why the terms belong together. Afterwards, ask whether you used a mechanism, an anatomical location or merely a broad resemblance.

The same study sequence applies: make the relationship explicit, compare it with the explanation and examine a term that would change the category.

What the evidence supports, and what it does not

Repeated testing with feedback has been studied separately from AI tutoring. Larsen and colleagues found better delayed retention than repeated study in a small resident study. That does not validate every stage of the sequence proposed here.

AI capability also should not be confused with the benefit its users obtain. A 2024 randomised diagnostic-reasoning trial involving 50 physicians did not find a significant improvement from access to the tested LLM compared with conventional resources in that vignette setting.

That result does not settle the value of newer tools or a deliberately structured teaching interaction. It does show why an impressive model answer and improved clinician learning are separate claims.

The more detailed medical-games evidence review distinguishes engagement, retained knowledge and clinical outcomes.

Keep the method useful rather than compulsory

Some questions need only an authored explanation. Others need an original source or a discussion with a supervisor. A practical examination skill needs appropriate hands-on teaching, not a longer text conversation.

Use AI where it helps expose a misunderstanding, generate a clearly labelled variation or ask a useful follow-up. Stop when the interaction becomes repetitive or begins supplying unsupported detail.

The sequence should leave you better able to explain the problem independently. It should not create a new habit in which every answer, including an already understood one, needs a chatbot's approval.

Frequently asked questions

Must I avoid all help before answering a clinical question?

No. This method concerns protected educational exercises. Necessary clinical support and supervision should never be withheld from real patient care to preserve an unaided attempt.

Does an AI-generated explanation prove that my revised answer is correct?

No. Check the reasoning against the supplied facts and appropriate sources. A second fluent answer can repeat the same unsupported assumption.

Is answer-first learning proven to prevent AI-related deskilling?

That claim would require direct evidence. The proposed sequence makes an attempt and its revision visible, but it is not presented as a validated prevention programme.

Make an independent decision before reading today's stat explanation

More from the Journal