skip to main content
iatroX JournalExam revision

Expert-Written Cases vs AI-Generated Cases: Which Produces Better OSCE Practice?

Featured image for Expert-Written Cases vs AI-Generated Cases: Which Produces Better OSCE Practice?

Expert-written and AI-generated OSCE cases solve genuinely different problems, and the productive question is not which approach is superior in the abstract, it is which stage of a candidate's preparation each is actually suited to, and what specific risks generated content carries that a candidate should watch for directly.

The advantages of expert-written cases

Controlled learning objectives: a case built deliberately to test a specific competency, written with that objective explicitly in mind rather than emerging incidentally from a generation process. Stable patient state: the simulated patient's history, presentation and behaviour remain consistent and internally coherent, since a human author has deliberately constructed a coherent underlying case. Deliberate distractors: red herrings and complicating factors placed intentionally to test a candidate's ability to prioritise correctly, a genuinely difficult thing to construct well and easy to get wrong through automated generation. Defined mark scheme: a marking structure built specifically for the case's content, rather than a generic scheme applied to whatever content a generation process happened to produce. Clinical and examination review: expert-written cases typically pass through a deliberate review process checking clinical accuracy and examination-format appropriateness before release. And better comparability between learners: since every candidate working through the same expert-written case encounters identical content, supporting meaningful performance comparison in a way variably generated content cannot.

The advantages of AI-generated cases

Rapid variation: generation can produce large numbers of superficially different cases quickly, addressing the repetition and memorisation risk this cluster's coverage of unlimited practice raises directly. Personalisation: generated cases can plausibly be tailored to a specific candidate's identified weak areas in a way a fixed expert-written bank cannot adapt to automatically. Large case volume: generation scales case count in a way manual expert writing cannot match at comparable speed. Adaptation to local curricula: generated content can potentially be shaped around a specific institution's or examination's particular emphasis more flexibly than a fixed commercial bank. And ability to target very narrow knowledge gaps: generating a case specifically built around one identified weakness, a genuinely useful capability for late-stage, highly targeted revision.

The risks of generation, named directly

Clinically incoherent combinations: a generated case combining a presentation, history and examination findings that would not plausibly occur together in a real patient, teaching a candidate an internally inconsistent picture without either the candidate or the platform necessarily recognising the inconsistency. Incorrect treatment: management recommendations generated without the same deliberate clinical review an expert-written case undergoes, risking a candidate absorbing an inaccurate management plan as though it were correct. Unrealistic demographics: generated patient characteristics that do not reflect genuine population patterns, a specific instance of the representativeness concern this cluster's equity coverage treats in depth. Information leakage: generated content inadvertently revealing the diagnosis or key findings prematurely, a case-writing failure expert review is specifically designed to catch and generation may not reliably avoid. Mark schemes that reward facts not present in the scenario: a generated marking structure misaligned with the actual generated case content, penalising or rewarding a candidate for information the specific case never actually contained. And different difficulty across ostensibly equivalent cases: generated cases nominally testing the same competency varying unpredictably in genuine difficulty, undermining the comparability expert-written banks are specifically built to preserve.

How different platforms handle this trade-off

Simsbuddy emphasises expert-written examination banks specifically, positioning itself on the controlled, reviewed side of this comparison. MLAbuddy permits users to build their own stations and upload guidance documents, a genuinely different content-provenance model bringing the generation-related risks above into sharper relief, worth checking specifically for what quality-control process, if any, governs user-created content. SCA Prep emphasises generated SCA cases specifically, a platform whose case-writing model should be evaluated against the specific risks this article names rather than assumed safe by default. And SimPatient and MedAscend allow educator-controlled authoring and review, an institutional model where generation, where used, sits within a faculty-governed review process rather than reaching learners unreviewed.

The recommended verdict

Use expert-written cases for calibration and high-stakes preparation, where the controlled, reviewed content and reliable comparability matter most, particularly in the weeks closest to an actual examination. Use generated variation for deliberate practice once a candidate already understands what good performance looks like, where the volume and targeting benefits of generation add genuine value without the same risk of absorbing incorrect content as a foundational understanding, since a candidate who already knows the correct answer is better positioned to notice and discount an occasional generation error than one encountering the content for the first time.

Frequently asked questions

How can a candidate tell if a generated case contains an error?

By verifying any management recommendation or clinical detail against current UK guidance independently, the same discipline this cluster's iatroX-workflow analysis recommends for every simulation platform's output regardless of whether the underlying case was expert-written or generated.

Are all AI-generated cases equally risky?

No: platforms with a defined review process governing generated content before it reaches learners carry meaningfully less risk than platforms permitting unreviewed user-generated or purely automated content, making the specific quality-control process worth checking directly rather than assuming all generation is equivalent.

Should a candidate avoid generated-case platforms entirely?

Not necessarily, particularly once foundational knowledge is established and the specific value of large-volume, targeted practice outweighs the generation risks, though the verification habit this article recommends should apply consistently regardless of which platform's content a candidate is working through.

The evidence-literacy series continues →

More from the Journal