A completed appraisal checklist is not an implementation plan. JBI resources can support several stages of evidence-based practice, but the resource for examining one paper is not necessarily the resource for bringing evidence together or changing a service. Start by identifying which of those tasks your team is actually doing.
This guide uses a fictional discharge-information project to make the distinction practical. The proposed activities and records are teaching examples, not reported project results. JBI product and resource descriptions were checked on 20 September 2026; iatroX publishes this article and is included only as a supporting clinical-learning resource.
The project begins with an observation, not a chosen solution
A ward nurse and occupational therapist notice that some patients cannot explain who to contact after discharge. One colleague suggests a different leaflet. Another wants a telephone follow-up. A third believes that staff should check understanding before the patient leaves.
At this point the team has several possible interventions and an incompletely defined problem. It should first establish what is uncertain. Are instructions absent, difficult to understand, inconsistent between documents or poorly matched to the person's needs? Different explanations would lead to different searches and different changes.
An initial project note might say: "We want to understand which approaches help adults leaving this service know the agreed next action and the appropriate contact route." That is a proposed question, not evidence that any particular intervention works.
Define the setting and intended outcome before collecting papers. Otherwise, the first attractive study may determine the project simply because it is easy to find.
Stage one: appraise the relevant paper
JBI's critical-appraisal collection, checked on 20 September 2026, offers tools for different study designs and notes that several have been revised. The current collection includes design-specific resources for trials, observational studies, qualitative research and evidence syntheses. A checklist downloaded years ago should not automatically be treated as the current version.
Choose the tool after identifying the design. A trial evaluating an intervention and an interview study exploring patient experience do not answer identical questions. Applying the same checklist to both can obscure what each contributes.
In the fictional project, imagine a paper comparing two discharge-information approaches. Before accepting its conclusion, the team should identify how participants entered the groups, how understanding was assessed and whether missing follow-up could affect interpretation. Those are proposed appraisal questions; they do not describe an actual study's flaws.
Now imagine a qualitative paper about why patients find discharge instructions difficult. The team needs to examine the relationship between the research question, recruitment, data collection and interpretation. It should not reject that paper merely because it does not estimate an intervention effect.
Record judgements with reasons
A useful appraisal record explains what the reader found and where it appears. A tick without a supporting note is difficult for another reviewer to interpret. An unclear judgement should name the information that could not be established rather than silently treating uncertainty as evidence that a method was absent.
For teaching, ask two reviewers to appraise the same paper independently and discuss one disagreement in detail. One may have interpreted an incomplete methods description as a serious limitation; the other may have found clarifying information elsewhere in the paper. The conversation should resolve what is documented before deciding how it affects confidence.
Do not turn a collection of checklist ticks into a universal pass mark unless the chosen methodology specifies and justifies that approach. An important weakness can matter more to the project than several minor reporting strengths. The aim is a reasoned appraisal, not a decorative score.
Stage two: synthesise, rather than pile up appraisals
JBI's resources and methodological manuals, checked on 20 September 2026, distinguish evidence synthesis from implementation. The appropriate synthesis method depends on the review question and evidence being considered; the JBI Manual for Evidence Synthesis provides methodological guidance rather than a single universal procedure.
For the fictional project, separate intervention studies from evidence about experience and feasibility. An intervention may appear promising under study conditions while patient interviews reveal a delivery problem relevant to the local service. These findings can inform the same decision without being forced into the same numerical analysis.
Build a synthesis record around contributions, not article summaries. For each source, write which aspect of the question it addresses, the relevant population, its main limitations and what it cannot establish. Then examine where the sources agree, where they differ and whether the difference reflects context or method.
Calling this a systematic review would require a suitable protocol, search, selection and reporting process. A small educational exercise should be labelled as such. JBI terminology should not be used to give an informal reading list a methodological status it has not earned.
Stage three: plan implementation around a defined change
Suppose the fictional team decides to investigate checking patients' understanding before discharge. This remains a proposed service change, not a recommendation derived from evidence reported in this article. The team should specify what staff would do differently, who is responsible and what information patients would receive.
An implementation plan also needs to distinguish failure of the proposed approach from failure to deliver it. If staff cannot find the correct contact details, a communication technique alone will not resolve the problem. If the assessment excludes people who need an interpreter, a reassuring average may conceal an important gap.
JBI's implementation resources provide a methodological starting point for moving evidence into practice. The team should use the current guidance and its organisation's approval processes, rather than assuming that a positive appraisal authorises immediate change.
Before starting, agree what would be observed, how it would be recorded and what would prompt revision. No improvement percentages should be assigned in advance.
A worksheet that keeps the stages separate
The following is an original teaching worksheet, not an official JBI instrument.
| Stage | Question to record | Useful output |
|---|---|---|
| Define | What problem are we trying to understand? | A bounded question and intended population |
| Appraise | What can this paper support? | Design-specific judgements with reasons |
| Synthesise | What does the collection of evidence contribute? | Agreements, differences and unresolved questions |
| Adapt | What changes in our setting? | A documented account of practical constraints |
| Implement | Who will do what differently? | A deliverable process and responsibilities |
| Review | Did the change occur, and what followed? | Observations, limitations and the next decision |
The worksheet is deliberately not a success checklist. A well-run project may conclude that the evidence is insufficient, that the proposed change does not fit or that another question needs answering first.
Where clinical learning fits without taking over the method
A nurse might need to understand the clinical significance of a follow-up instruction. An occupational therapist may need clarification of the medical context behind a functional limitation. Those are appropriate learning questions alongside the project, but they do not replace appraisal or implementation methods.
As published on 20 September 2026, iatroX's CPD workflow allows profession and practice context to be selected, followed by relevant supported learning and a draft record for the learner to review. An honest record can describe the concept clarified and the remaining question for the team. It should not claim that the service improved before any evaluation occurred.
For a methods decision, use the relevant JBI guidance and appropriate expertise. For an organisational change, involve the service's governance and clinical leads. For a specific gap in clinical understanding, targeted reference or question-based learning may help. Keeping those roles separate makes the project more credible, not less ambitious.
Frequently asked questions
Can one JBI checklist be used for every paper?
No, select a tool appropriate to the study design and check its current version. Different designs contribute different forms of evidence.
Does completing critical appraisal mean a change is ready to implement?
No, appraisal is only one part of the process. Evidence synthesis, local applicability, responsibilities and evaluation still need consideration.
Can an iatroX record document participation in the project?
It can support a reviewed record of genuine learning, but it does not establish that project activities or outcomes occurred. The learner must describe their actual contribution and retain the relevant evidence.