Project

Diagnostic Imaging Phantom QA Validation Project

Biomedical engineering project for building a diagnostic imaging phantom QA validation package with image-quality metrics, dose-output checks, uncertainty guard bands, trend review, failure modes, and release evidence.

This project builds a diagnostic imaging phantom quality-assurance validation package. The goal is to produce a reviewable engineering deliverable: intended imaging task, controlled acquisition setup, phantom measurements, image-quality calculations, dose-output checks where ionizing radiation is involved, uncertainty guard bands, trend review, failure modes, corrective actions, and release decision.

The project is educational and engineering-focused. It is not clinical advice, not regulatory advice, not a patient-specific imaging recommendation, and not a substitute for qualified medical physics, clinical engineering, radiology, institutional, or manufacturer procedure review.

Project Objective

Prepare a phantom QA validation package for a diagnostic imaging system after installation, software update, detector service, or recurring constancy review. The final deliverable should answer:

  1. Which diagnostic or measurement task is being protected by the QA check?
  2. Which acquisition protocol, reconstruction version, display path, phantom, and measurement method are controlled?
  3. Do spatial sampling, contrast-to-noise ratio, uniformity, geometric accuracy, dose output, latency, and data integrity meet the acceptance criteria?
  4. Are the results far enough from limits after measurement uncertainty is considered?
  5. Does the trend show drift even when the current single measurement passes?
  6. Which failure modes require corrective action before clinical or laboratory release?

The output is not only a table of phantom numbers. It is a release package that lets an engineering review board see what was measured, why it was measured, which task it protects, how uncertainty was handled, and what action follows from the evidence.

Project Boundary

Use this simplified boundary.

ItemProject value
System typediagnostic imaging system with phantom QA workflow
Main example modalityCT-like cross-sectional imaging system
Transferable checksultrasound, optical, detector-array, and image-guidance systems after changing modality-specific limits
Intended engineering taskpreserve task-based image quality after configuration change or recurring QA
Userstrained technologists, clinical engineers, imaging physicists, service engineers, and supervising clinicians
Evidence boundaryphantom acquisition, raw or reconstructed image record, measurement worksheet, dose-output evidence, version record, trend chart, deviation log, and release decision
Out of scopeclinical diagnosis, patient-specific dose estimate, regulatory submission, purchasing decision, and complete modality-specific standard procedure

The simplified numerical example uses a CT-like phantom because it allows clear calculations for spatial sampling, contrast-to-noise ratio, geometric scale, uniformity, and radiation output. The same structure applies to ultrasound or optical diagnostics when the metrics are replaced by depth accuracy, axial and lateral resolution, probe-element checks, optical power, detector saturation, wavelength calibration, or task-specific reference images.

Baseline Requirements

Use the following simplified requirements for the project.

RequirementAcceptance criterion
Configuration controlscanner, protocol, reconstruction, workstation, display preset, phantom and analysis version recorded
Pixel size for the task phantomat most 0.50\ \text{mm/pixel}
Target samplingat least 4 pixels across a 2.0\ \text{mm} target
Low-contrast phantom CNRat least 4.0 after uncertainty guard band
Image uniformity deviationat most 8\% after uncertainty guard band
Geometric scale errorat most 1.0\ \text{mm} after uncertainty guard band
Radiation output difference, if applicableat most 10\% from expected output after uncertainty guard band
Acquisition-to-review latencyless than 250\ \text{ms} for image-guided workflow
QA drift triggermore than 10\% CNR decrease from commissioned baseline requires investigation
Data integrityno missing image slices, corrupted metadata, or untraceable software version in the QA record

These are simplified engineering criteria. Real diagnostic imaging QA must use modality-specific standards, manufacturer procedures, local radiation protection rules, institutional acceptance limits, qualified reviewer judgement, patient-safety controls, and task-specific clinical evidence.

Deliverables

Prepare these deliverables before the release review:

  1. QA protocol basis and intended task statement.
  2. Configuration record with scanner, source, detector, protocol, reconstruction, display, phantom, software, and analysis versions.
  3. Phantom acquisition record and image set.
  4. Image-quality worksheet with pixel size, target sampling, CNR, uniformity, geometry, dose-output check where applicable, and latency check where applicable.
  5. Uncertainty and guard-band table.
  6. Trend chart against commissioned baseline.
  7. Failure-mode and corrective-action matrix.
  8. Release decision with accepted scope, restrictions, open actions, and next QA interval.

The deliverable should be reproducible. Another competent engineer should be able to rerun the same acquisition and understand why the decision was made.

Step 1: Lock the Configuration

Before measuring the phantom, lock the configuration.

Configuration itemExample record
Scanner identifierCT-02
Tube-output or source moderoutine abdomen QA mode
Field of view220\ \text{mm}
Image matrix512 \times 512
Reconstruction kernelstandard soft-tissue QA kernel
Slice thickness2.5\ \text{mm}
Phantomtask phantom ID P-CT-14
Analysis scriptimage-qa-v3.2
Workstation display presetQA window/level preset
Software change under reviewreconstruction patch R-2026.06

Engineering Comment

Configuration control is not paperwork decoration. Image quality can change with field of view, reconstruction kernel, slice thickness, detector calibration, display settings, analysis region, phantom position, and software version. If the configuration is not locked, a pass result may not correspond to the released clinical or laboratory state.

Step 2: Spatial Sampling Check

The phantom scan uses:

FOV=220\ \text{mm}

and:

N=512

Pixel size is:

\displaystyle p=\frac{FOV}{N}

Therefore:

\displaystyle p=\frac{220}{512}=0.430\ \text{mm/pixel}

The task target diameter is:

d=2.0\ \text{mm}

The number of pixels across the target is:

\displaystyle N_p=\frac{d}{p}=\frac{2.0}{0.430}=4.65

Acceptance Check

QuantityResultCriterionStatus
Pixel size0.430\ \text{mm/pixel}\leq 0.50\ \text{mm/pixel}pass
Target sampling4.65 pixels\geq 4 pixelspass

Engineering Comment

The target is sampled by more than four pixels, so the configuration passes the simplified sampling criterion. This does not prove true spatial resolution. Point-spread function, focal spot size, detector aperture, reconstruction kernel, motion, slice thickness, partial-volume effects, and segmentation method can still reduce effective resolution. The result is a configuration screen, not a universal resolution claim.

Step 3: Contrast-to-Noise Ratio

The phantom contains a low-contrast insert. The measured values are:

\mu_t=1340

for the target region, and:

\mu_b=1188

for the background region. Background noise is:

\sigma_b=34

Use:

\displaystyle CNR=\frac{|\mu_t-\mu_b|}{\sigma_b}

Difference in mean signal:

|\mu_t-\mu_b|=|1340-1188|=152

Contrast-to-noise ratio:

\displaystyle CNR=\frac{152}{34}=4.47

The expanded uncertainty of the CNR estimate from ROI placement, repeat acquisition, phantom reference, and analysis repeatability is:

U_{CNR}=0.25

For a lower-bound requirement, use the guarded value:

CNR_{guarded}=CNR-U_{CNR}

Thus:

CNR_{guarded}=4.47-0.25=4.22

Acceptance Check

QuantityResult
Measured CNR4.47
Expanded uncertainty0.25
Guarded CNR4.22
Acceptance limit\geq 4.0
Decisionpass

Engineering Comment

The CNR passes even after the uncertainty guard band. This is stronger evidence than comparing the nominal value alone. If the measured CNR had been 4.10 with U_{CNR}=0.25, the nominal value would pass but the guarded value would fail. A phantom QA report should make that distinction visible.

The result still applies only to this phantom contrast, acquisition protocol, reconstruction version, display path, and analysis method. It should not be generalized to all diagnostic tasks.

Step 4: Uniformity Check

Use five regions of interest: center, north, south, east, and west. The mean image values are:

RegionMean value
Center1020
North975
South1046
East966
West1008

Define maximum uniformity deviation relative to the center:

\displaystyle D_u=\frac{\max|\mu_i-\mu_c|}{\mu_c}100\%

The largest deviation is from the east region:

|\mu_E-\mu_c|=|966-1020|=54

Therefore:

\displaystyle D_u=\frac{54}{1020}100\%=5.29\%

The expanded uncertainty in the uniformity deviation is:

U_u=1.0\%

For an upper-bound requirement, use:

D_{u,guarded}=D_u+U_u

Then:

D_{u,guarded}=5.29\%+1.0\%=6.29\%

Acceptance Check

QuantityResult
Measured uniformity deviation5.29\%
Expanded uncertainty1.0\%
Guarded deviation6.29\%
Acceptance limit\leq 8.0\%
Decisionpass

Engineering Comment

The uniformity result passes with margin. The report should still include the phantom position, exposure mode, reconstruction version, ROI size, and whether the same display or raw-image basis was used as the commissioned baseline. A uniformity problem can come from detector calibration, beam hardening, source output, reconstruction correction, phantom centering, or analysis method.

Step 5: Geometric Accuracy

The phantom contains a calibrated distance:

L_{ref}=100.0\ \text{mm}

The measured distance in the image is:

L_{meas}=100.6\ \text{mm}

Geometric error is:

e_L=L_{meas}-L_{ref}

Therefore:

e_L=100.6-100.0=0.6\ \text{mm}

Use expanded uncertainty:

U_L=0.3\ \text{mm}

For a two-sided tolerance, compare:

|e_L|+U_L

with the allowed tolerance:

T_L=1.0\ \text{mm}

Guarded error:

|e_L|+U_L=0.6+0.3=0.9\ \text{mm}

Acceptance Check

QuantityResult
Reference distance100.0\ \text{mm}
Measured distance100.6\ \text{mm}
Error0.6\ \text{mm}
Guarded error0.9\ \text{mm}
Acceptance limit\leq 1.0\ \text{mm}
Decisionpass, but close to limit

Engineering Comment

The geometric check passes, but the guard-banded result is close to the limit. The release package should flag it for the next QA interval. If the imaging task includes quantitative sizing, implant fit, surgical guidance, radiotherapy planning, or serial measurement, this margin may be too weak even though it passes the simplified project criterion.

Step 6: Radiation Output Check

For ionizing imaging systems, image-quality release should not ignore output. The expected scanner-reported output for the QA protocol is:

CTDI_{vol,exp}=12.0\ \text{mGy}

The current output is:

CTDI_{vol,meas}=12.7\ \text{mGy}

Relative difference is:

\displaystyle \Delta_{dose}=\frac{CTDI_{vol,meas}-CTDI_{vol,exp}}{CTDI_{vol,exp}}100\%

Substitute:

\displaystyle \Delta_{dose}=\frac{12.7-12.0}{12.0}100\%=5.83\%

Use expanded uncertainty:

U_{dose}=2.0\%

For an upper-bound output-difference criterion:

\Delta_{dose,guarded}=|\Delta_{dose}|+U_{dose}

Therefore:

\Delta_{dose,guarded}=5.83\%+2.0\%=7.83\%

Acceptance Check

QuantityResult
Expected output12.0\ \text{mGy}
Measured output12.7\ \text{mGy}
Difference5.83\%
Guarded difference7.83\%
Acceptance limit\leq 10\%
Decisionpass

Engineering Comment

The output is within the simplified tolerance after uncertainty is included. This check does not estimate patient dose and does not justify a clinical protocol by itself. It verifies that the QA acquisition output is not drifting away from the configured basis. Dose, image quality, task performance, and patient size must be controlled together.

Step 7: Latency and Data Integrity Check

For image-guided workflows, acquisition-to-review latency matters. Use this simplified timing budget:

SegmentTime
Detector readout42\ \text{ms}
Reconstruction and correction86\ \text{ms}
Network transfer18\ \text{ms}
Workstation display update31\ \text{ms}

Total latency:

t_{total}=42+86+18+31=177\ \text{ms}

Acceptance limit:

t_{limit}=250\ \text{ms}

Acceptance Check

QuantityResult
Total latency177\ \text{ms}
Acceptance limit250\ \text{ms}
Missing slicesnone
Corrupted metadatanone
Version traceabilitycomplete
Decisionpass

Engineering Comment

The latency result passes for the simplified image-guided workflow. If the system is used only for offline review, the latency criterion may be less important than archival integrity and workstation compatibility. If the system guides a procedure, latency, jitter, registration error, display update behavior, and user response become part of patient-safety evidence.

Step 8: CNR Trend Review

Single-test acceptance is not enough when drift matters. The commissioned baseline CNR was:

CNR_0=4.8

The current measured value is:

CNR_1=4.47

Percent decrease is:

\displaystyle D_{CNR}=\frac{CNR_0-CNR_1}{CNR_0}100\%

Therefore:

\displaystyle D_{CNR}=\frac{4.8-4.47}{4.8}100\%=6.88\%

The local investigation trigger is a decrease greater than:

10\%

Acceptance Check

QuantityResult
Baseline CNR4.8
Current CNR4.47
Decrease6.88\%
Investigation trigger>10\%
Decisionno immediate drift investigation required

Engineering Comment

The current CNR passes both the absolute criterion and the drift screen. The trend should still be kept. A future value could remain above the absolute limit while showing sustained drift that points to detector gain change, source output change, reconstruction update, phantom positioning, environmental variation, or analysis-script change.

Step 9: Uncertainty Budget

Summarize the uncertainty sources used in the guard bands.

MeasurandDominant sourcesExpanded uncertainty used
Pixel sizefield-of-view record, matrix record, reconstruction geometrynegligible for this simplified check
CNRROI placement, repeat acquisition, phantom insert tolerance, reconstruction noise texture, analyst repeatability0.25
Uniformity deviationROI placement, phantom centering, detector correction repeatability, background drift1.0\%
Geometric distancephantom reference length, pixel interpolation, edge threshold, slice position0.3\ \text{mm}
Radiation output differencescanner display, dosimeter calibration or scanner output comparison, repeatability, setup2.0\%
Latencytimestamp resolution, clock synchronization, display update detection10\ \text{ms} if close to limit

Engineering Comment

The uncertainty budget does not need to be more complex than the decision requires, but it must cover the sources that can change the release decision. A small CNR margin or geometry margin needs a better uncertainty basis than a result far from the limit.

Step 10: Failure Modes and Controls

Connect the QA result to failure modes.

Failure modeEngineering effectDetection methodControl or response
Detector gain driftCNR loss, nonuniformity, false textureCNR trend, uniformity map, service calibration recordrecalibrate detector, repeat QA, compare baseline
Reconstruction update changes noise textureapparent CNR pass but task performance changesversion control, phantom comparison, user reviewlock algorithm version, repeat task phantom, document release scope
Phantom mispositioningfalse geometry, uniformity or CNR changesetup photo, alignment marks, scout recordrepeat acquisition with controlled positioning
Dose output driftexposure risk or image-quality shiftoutput comparison, dose dashboard, QA dosimetryservice check, radiation protection review, repeat output measurement
Display preset mismatchuser sees different contrast than QA evidencedisplay configuration record, workstation auditlock display preset, verify DICOM or workstation settings
Metadata or slice lossQA record no longer traceablearchive validation, checksum or image count checkreject record, repeat acquisition, investigate data path
EMI or network disturbancecorrupted transfer, delayed display, intermittent errorsevent log, timing record, repeat under loadisolate source, repeat validation under representative load
Incomplete user workflow validationphantom passes but clinical use remains riskysimulated-use check, handoff reviewrestrict release until workflow evidence is complete

Engineering Comment

The failure-mode table prevents a common QA mistake: treating a phantom pass as a universal system pass. A phantom verifies a controlled slice of performance. The release decision must still consider software, display, workflow, data integrity, maintenance state, and intended use.

Step 11: Release Matrix

Use a release matrix to make the decision explicit.

Evidence itemResultRelease meaning
Configuration recordcompleteQA result is traceable to the released setup
Pixel size and target samplingpassacquisition geometry supports the simplified task screen
CNR with uncertainty guard bandpasslow-contrast metric has margin for the stated phantom task
Uniformity with uncertainty guard bandpassdetector and correction response are acceptable for the simplified check
Geometry with uncertainty guard bandpass, close to limitrelease allowed, but next QA must monitor scale error
Radiation output checkpassoutput agrees with the configured QA basis within tolerance
Latency and data integritypassimage-guided review path meets simplified timing and traceability criteria
CNR trendpassno immediate drift investigation required
Failure-mode reviewopen monitoring action for geometry marginrelease with surveillance item

Final Decision

The system passes the simplified diagnostic imaging phantom QA validation package for the stated CT-like phantom task and controlled configuration. The release should be limited to the protocol, reconstruction version, display path, phantom method, and intended task recorded in this package.

The release package should include one surveillance action: review geometric scale error at the next QA interval because the guard-banded value is close to the acceptance limit. If the next result moves toward the limit, the team should check phantom positioning, calibration geometry, reconstruction scaling, table motion, edge-detection method, and service history before widening clinical use.

What the Final Report Should Contain

A complete report should contain:

  1. intended task and acceptance criteria;
  2. configuration record and version control;
  3. phantom setup and acquisition evidence;
  4. image-quality calculations with units and assumptions;
  5. uncertainty budget and guard-band decisions;
  6. trend comparison with baseline;
  7. dose-output evidence where ionizing radiation is involved;
  8. latency or workflow evidence where real-time review matters;
  9. failure-mode and corrective-action table;
  10. signed release decision, restrictions, open actions, and next QA date.

Common Mistakes

Common mistakes include:

  • reporting CNR without phantom, ROI, reconstruction, and task context;
  • treating pixel size as true resolution;
  • passing a nominal value that fails after uncertainty is considered;
  • ignoring trend drift because the current value still passes an absolute limit;
  • changing the reconstruction algorithm without repeating task-based QA;
  • validating a display path different from the released workstation path;
  • recording dose output without connecting it to image quality and protocol control;
  • omitting data integrity, metadata, software version, or archive checks;
  • releasing a system for all use cases after testing only one phantom task.

Engineering Takeaway

Diagnostic imaging QA is a controlled evidence package, not a visual impression. A strong phantom validation project ties image-quality metrics to an intended task, protects the configuration from silent drift, applies uncertainty guard bands, watches trends, and states exactly what the release decision covers. The engineer’s responsibility is to make the boundary of the evidence explicit.

REF

See also