Building an Instructor Debrief Record for PAUT and TOFD Simulation Exercises

Record how the learner reasoned, not only the answer

A simulation exercise can end with the expected answer while revealing little about how the learner reached it. The learner may have interpreted the evidence carefully, recognized a familiar picture or followed an instructor hint. A debrief record distinguishes those paths. It captures the scenario presented, the learner's observations, the reasoning offered, the help received and the next learning action. That record makes a later teaching decision more defensible than a score alone.

For PAUT and TOFD learning, the debrief should remain an educational record. It does not validate a production technique, establish equipment performance or authorize a person to perform an examination. This guide describes how an instructor can organize feedback about reasoning and communication. It provides no scan procedure, instrument settings or acceptance rules. The relevant employer and qualification arrangements determine whether and how an educational record contributes to any broader assessment process.

Define the scenario and its limits before the session

Give each scenario a stable identifier, revision and learning purpose. Record the represented component context, information supplied to the learner, intended task and known simplifications. If a simulation omits a physical effect, uses idealized data or provides a fixed geometry, that should be part of the instructor's scenario note. Learners should not carry an assumption from a simplified exercise into an unrelated real application because the limitation was never made explicit.

The introductory NDT overview in IAEA Training Course Series 52 describes phased-array ultrasonics and time-of-flight diffraction as distinct ultrasonic techniques with different underlying approaches. That provides background for treating their learning evidence carefully rather than merging all responses under one generic ultrasonic score. The actual exercise should be reviewed by the responsible subject instructor, who decides what the scenario can demonstrate. Confirm the simulation's supported content and available records before planning an activity that depends on features not yet established.

Separate observed behaviour from instructor interpretation

Create one field for what the learner said or did and another for the instructor's interpretation. An observation might be that the learner compared two displayed views before describing a location uncertainty. An interpretation might be that the learner is beginning to connect the views but needs more practice explaining the relationship. Keeping both fields prevents a broad label such as weak interpretation from replacing the evidence needed to support useful feedback.

Use short, specific notes rather than a transcript of every action. Identify the relevant exercise moment or saved image where available. If the learner revises an answer, preserve the initial explanation and the reason for the revision. Changing an answer after recognizing missing information can be valuable learning evidence. Changing it only after the instructor supplies the conclusion means something different. The debrief should make that distinction visible without treating uncertainty as a personal failure.

Capture the assistance that shaped the result

Record prompts in a small, agreed vocabulary. A neutral prompt asks the learner to explain their evidence. A directional prompt points to a particular feature or missing relationship. A supplied explanation gives part of the reasoning or answer. These categories are proposed teaching aids, not formal assessment grades. They help instructors distinguish independent performance from supported practice and avoid comparing results that were reached under very different levels of assistance.

Explain the debrief approach to learners before the activity. Tell them that the record will include questions, revisions and help received so they understand why the instructor is taking notes. Knowing the educational purpose can make it easier to discuss a mistaken assumption openly and engage with the next practice task.

Note when technical or interface help was required. Difficulty locating a control in an unfamiliar simulator may interrupt the task without showing a misunderstanding of the NDT concept. Conversely, a learner who navigates the interface quickly may still offer an unsupported interpretation. Keep interface support separate from subject-matter prompting. If an exercise is being used within a formal assessment arrangement, follow the applicable assessment rules rather than introducing this informal prompting approach without review.

Ask for the evidence behind a conclusion

A useful debrief question asks the learner to identify what in the supplied information supports their statement and what remains uncertain. Ask them to distinguish observation, interpretation and the next question they would raise. Do not require an operational recommendation when the scenario only supports a limited educational inference. A learner should be able to say that the available evidence is insufficient and identify the additional information needed, rather than guessing to satisfy an expected answer.

Include communication to a non-specialist recipient where it fits the learning purpose. The learner might write a short note explaining what the simulated result illustrates and what the exercise does not establish. Review whether the wording preserves scope and avoids declaring a component acceptable without an applicable basis. This is a communication task within the exercise, not a production report. It can reveal whether a learner understands the difference between a displayed indication, an interpretation and a decision requiring other authority.

Hypothetical worked example: two learners reach the same conclusion

In a hypothetical session, two learners receive the same instructor-reviewed simulation scenario S-24 revision 2. The task is to explain a supplied set of PAUT and TOFD educational views and identify questions left unresolved by the scenario. The exercise contains no production acceptance decision. Both learners eventually state that further information is needed to support a confident location description. A simple answer key would mark them alike, but the debrief reveals different learning needs.

Learner A identifies the relevant view relationship, states a location uncertainty and asks whether the scenario's geometry description is complete. The instructor uses only a neutral prompt to ask for the evidence. The record includes the learner's initial explanation, the displayed view references and the stated uncertainty. The follow-up action is a second scenario with different context, designed to see whether the reasoning transfers without relying on the same visual pattern.

Learner B first gives a precise location without explaining its basis. The instructor asks a neutral question, then points to a missing relationship between the supplied information. After a brief explanation, the learner revises the answer and describes the limitation correctly. The record shows the initial claim, the directional prompt and the corrected reasoning. The next action is supported practice in separating what is observed from what is inferred, followed by another attempt with reduced prompting.

During the debrief, both learners write a short handover note. Learner A's note omits the scenario revision; Learner B's note clearly labels the result as simulated but overstates what the displayed data establish. These become separate communication feedback items. Neither learner receives a claim of production competence from the exercise. The hypothetical example shows why a useful debrief can identify distinct next steps even when the final verbal conclusion is the same.

Design the record around decisions the instructor will make

A compact debrief form can contain scenario identity, learning objective, learner response, evidence reference, assistance, feedback and next action. Add fields only when they support a real teaching decision. For example, record whether a misunderstanding concerns terminology, evidence relationships, scope communication or an interface issue if those categories lead to different practice. Avoid a long checklist of vague traits that instructors cannot observe reliably during the exercise.

Write the next action with a completion condition. Review terminology is less useful than explain the distinction using a new example and identify where the earlier wording became misleading. A practice task should be small enough to complete and specific enough for the next instructor to recognize. Assign a follow-up owner and an expected review point where the programme allows it. Otherwise, a detailed debrief can become an archive of observations that never influence learning.

Preserve the relationship between evidence and scenario version

Saved screenshots, learner notes and simulator exports should identify the scenario version and exercise session. If the scenario changes, keep earlier records linked to the version actually used. A corrected answer key should not make an earlier learner response appear wrong or right under information that was not available at the time. Record the correction and review any affected feedback. This is particularly important when several instructors share a scenario library.

Use the minimum evidence needed to support the debrief and follow the organization's handling rules for learner information. A complete screen recording may contain more personal information than necessary, while a single image may omit the reasoning sequence. Choose deliberately. If the simulation cannot export a desired record, agree an alternative such as a referenced instructor note; do not claim that the tool provides a capability merely because it would make the workflow convenient.

Calibrate instructor judgments through shared examples

Before a cohort session, have instructors review a few fictional learner responses and compare the feedback they would give. Discuss what counts as an observation, which prompts are directional and what evidence justifies a proposed next action. The aim is consistent language and useful feedback, not forced agreement on every teaching choice. Preserve examples of common ambiguities so new instructors can understand the reasoning behind the form.

After delivery, review a small selection of debrief records together. Look for unsupported labels, unclear assistance notes and next actions that are too broad to complete. Also check whether the exercise itself caused confusion. If many learners misunderstand the same instruction, the problem may lie in the scenario wording or missing context. Revise the material where appropriate and record the change. Learner difficulty should not automatically be attributed to a lack of knowledge when the task design has not been examined.

Recognize common debrief failures

One failure is recording only the final answer and losing the path that produced it. Another is rewarding confident language even when the evidence is weak. A third is converting every uncertainty into an error instead of asking whether the learner identified a real limitation. These patterns discourage the careful explanation that an educational exercise should develop. The debrief needs room for justified uncertainty as well as clear correction of unsupported claims.

Other failures concern the boundary of the record. A simulated score may be presented as proof of production capability, an idealized scenario may be described as representative of every application, or a saved image may circulate without its educational label. Prevent those misunderstandings through explicit scope statements and controlled sharing. Where the employer wants a formal assessment outcome, agree that separate purpose and its governing requirements before the exercise rather than retrospectively assigning authority to an informal debrief.

Practical checklist for an instructor's completed debrief

Use this checklist immediately after the discussion while the reasoning is still clear. The record should be understandable to another instructor who was not in the room. It should also be fair to the learner, showing the task and support provided rather than presenting an isolated judgment with no context.

• Identify the scenario, revision, session and specific learning objective, including relevant simplifications or omitted information.
• Describe the learner's observable response separately from the instructor's interpretation of the learning need.
• Retain the basis of an initial conclusion and explain any later revision without rewriting the original response.
• Record neutral prompts, directional prompts, supplied explanations and interface assistance distinctly.
• Link the feedback to an exercise moment, image or note that supports it without collecting unnecessary personal data.
• Check whether the learner's handover wording preserves the simulated context, scope and unresolved questions.
• Set a focused next action and identify how a later activity will show whether the feedback was understood.
• Confirm that the record makes no unsupported claim about production authorization, certification or technical procedure validity.

Use follow-up to distinguish recall from transfer

A repeat attempt with the same picture may show that a learner remembers the explanation. A later exercise with changed context can provide a better opportunity to observe whether the reasoning transfers. Choose the variation to match the learning objective and keep its limitations explicit. The instructor should record why the follow-up differs and which earlier feedback it is intended to test, rather than adding novelty for its own sake.

Compare the new response with the earlier debrief in terms of evidence use, clarity and assistance needed. Describe improvement only within the tasks observed. If uncertainty remains, identify the next focused activity or refer the question to the responsible programme owner. The debrief then becomes a useful teaching record: it connects one exercise to the next while retaining a clear boundary between learning evidence and decisions that require a different process.