skip to main content
iatroX JournalClinical insight

Can Multiple Healthcare AI Agents Amplify the Same Mistake?

Featured image for Can Multiple Healthcare AI Agents Amplify the Same Mistake?

Yes. Multiple agents can carry the same error into different parts of a care pathway, particularly when each relies on information prepared by the previous one. Their agreement may reflect a shared assumption rather than independent verification. That is a reason to test the architecture carefully, not a conclusion that every multi-agent system is less safe than a single model.

A fictional chain with no independent confirmation

Imagine a patient responding to an appointment offer: they cannot attend that location and ask whether another site is possible. A hypothetical intake agent summarises this as "patient declined assessment". A planning agent then removes the planned appointment, while a messaging agent prepares advice based on the assumption that the patient no longer wants the assessment.

Each later action could be internally consistent with the summary it received. The appearance of agreement does not establish that any agent considered the patient's original meaning. The consequential error occurred when a practical obstacle became a clinical preference.

Now suppose a fourth agent checks whether the message is consistent with the plan. It may correctly answer yes while missing the original misinterpretation. This check tests consistency between derived documents, not fidelity to the patient interaction.

The scenario is fictional. It does not describe a documented integration or incident involving any named healthcare company.

Different names do not establish different errors

Research provides a reason not to assume independence simply from model diversity. Kim and colleagues' paper, submitted on 9 June 2025 and accepted to ICML 2025, examined correlated errors across language models using benchmark and non-clinical tasks. It found substantial shared errors, including among models from different providers.

That work was not a clinical trial of healthcare agents. It does not establish a particular error rate for a proposed medical workflow. Its relevance is narrower: using a different model does not, by itself, prove that the second opinion provides independent protection.

There are also architectural reasons for dependence that do not require models to share training. If every agent receives the same incorrect summary rather than the originating information, each may reason sensibly from a false premise. Improving the downstream model does not automatically restore a fact that has been removed.

Decide what each check is supposed to establish

A useful system specification distinguishes source fidelity, clinical applicability, authorisation and execution. In the fictional example, source fidelity concerns what the patient actually said. Clinical applicability concerns whether the altered plan is appropriate. Authorisation concerns whether the software may change it. Execution concerns what happened in the booking system.

These should not be represented by a single "verified by multiple agents" claim. A check can succeed at one level and leave another completely unexamined.

A proposed design might require the agent responsible for interpreting patient preference to identify the supporting passage, while a separate control prevents cancellation without the required approval. Another process would establish whether the booking system actually cancelled anything. The safety argument should explain what each component contributes and what remains outside its scope.

That is more informative than counting agents, prompts or layers. A simple, well-defined check can be more useful than several reviewers answering the same ambiguous question.

Preserve a route back to the original information

HL7's FHIR R4 Provenance specification provides a framework for describing the origins and transformation of information. As reviewed on 10 October 2026, it illustrates how systems can represent lineage; using the standard does not prove that a derived clinical statement is true.

For the proposed appointment workflow, the important practical requirement is traceability. A reviewer should be able to distinguish the patient's words, the intake interpretation, the approved decision and subsequent operational events. If a statement has been copied repeatedly, those copies should not be presented as separate corroborating sources.

The system should also preserve meaningful disagreement. A later agent that finds the original request inconsistent with the summary should not be required to force a consensus before continuing. It needs a supported route to stop the affected action and obtain appropriate review.

Too much material can make review harder, so provenance should expose the relevant origin rather than dump an undifferentiated log on the clinician. The design needs testing for actual error recognition, not only completeness of technical records.

Keep permissions outside conversational agreement

The NCSC's guidance on prompt injection, published on 8 December 2025, emphasises managing residual risk and constraining consequential actions through non-LLM safeguards. This matters when agents read external content and can operate connected tools.

For the fictional system, agreement between agents should not expand the permission to cancel care. An operational control can require a specified authorisation regardless of how confidently the models describe their conclusion. Untrusted documents and messages should not be able to define new authority for the workflow.

Such controls address permission, not every clinical error. A correctly authorised action can still be inappropriate if the underlying patient preference was misread. A complete assessment therefore needs both information checks and limits on what the software can do with the result.

Test a wrong premise before testing a polished final answer

A proposed evaluation should deliberately introduce errors at different points in a synthetic pathway. In one case, the originating information is correct but the first summary changes its meaning. In another, the source itself contains a contradiction. In a third, the plan is sound but the external action fails.

The evaluator should record which component detects the issue, what evidence it uses and whether the affected action is prevented or appropriately corrected. A final answer that acknowledges uncertainty is insufficient if a consequential action has already occurred unnoticed.

Compare the multi-agent design with a simpler workflow using the same information and endpoint. Extra agents may improve performance, add unnecessary delay or create new failure paths. Those possibilities need measurement rather than an architectural presumption of benefit or harm.

Also test disagreement that does not indicate an error. More review should not mean endless escalation of reasonable clinical alternatives. The service needs a way to make an accountable decision when the evidence supports more than one acceptable option.

Teach clinicians to ask what is genuinely independent

A useful learning exercise presents several agreeing outputs and asks the learner to trace them to their sources. Did the supposed confirmations inspect different evidence, or simply rephrase one initial interpretation? What would a real check need to examine?

As described by iatroX in October 2026, Ask-iatroX can support general source exploration and Brainstorm can structure discussion of a fictional case. This article is published by iatroX, and consulting its AI is not automatically independent verification of another AI's answer.

For a clinician, the priority is the originating evidence and an appropriate decision. For a product team, the priority is identifying shared dependencies and testing consequential transitions. Multiple agents are potentially useful components, but their number is not a safety outcome.

Frequently asked questions

Does agreement between several AI agents mean a clinical plan is correct?

No. The agents may share the same source, missing information or unsupported interpretation, so agreement must be assessed against the evidence each actually examined.

Does using models from different providers guarantee independent checking?

No. Research has identified correlated errors across providers, and different models can still depend on the same incorrect input.

Should healthcare teams avoid all multi-agent systems?

Not necessarily. They should evaluate the complete workflow against a suitable simpler alternative, including error detection, authority, recovery and the burden of unnecessary escalation.

Examine the shared assumptions in a fictional clinical workflow →

More from the Journal