Exercise set

Medical Device Verification, Validation, and Risk Management Exercises

Worked biomedical engineering exercises for medical device V&V and risk management covering traceability, RPN, measurement uncertainty, usability validation, leakage current, latency, sterilization process evidence, reliability, sampling, and change impact.

These exercises practise medical device verification, validation, and risk management from an engineering evidence perspective. They cover traceability, hazard controls, RPN reduction, measurement uncertainty, usability validation, electrical leakage, sampling and latency, sterilization process evidence, reliability, acceptance sampling, and change impact.

The purpose is not to provide regulatory advice or clinical guidance. The purpose is to train the engineering reasoning needed to decide whether a medical device requirement, risk control, test result, validation scenario, or lifecycle change is supported by objective evidence.

Assume simplified project-specific criteria unless an exercise states otherwise. Real medical device programs must also follow the applicable regulatory, quality-system, risk-management, usability, software, electrical safety, biocompatibility, sterilization, cybersecurity, and clinical evidence requirements for the device and market.

How to Use These Exercises

For each calculation, define:

  1. the intended use, user, patient or sample population, and environment;
  2. the requirement, claim, hazard, or risk control being tested;
  3. the acceptance criterion and the evidence method;
  4. the configuration covered by the result;
  5. the residual risk or follow-up action after the result.

The common mistake is treating a passed test as universal proof. Medical device evidence is only meaningful when it is tied to intended use, configuration, risk control, measurement method, and realistic use conditions.

For each result, state whether the evidence supports a requirement, a risk control, a validation claim, a release gate, or a change-impact decision. Passing arithmetic does not close an item unless the acceptance criterion and covered configuration are explicit.

Exercise 1: Traceability from Claim to Evidence

A device team makes 42 design claims in its design input file. A traceability review finds:

Trace statusCount
Claim linked to requirement, risk control, and verification or validation evidence29
Claim linked to requirement and evidence but no risk-control link6
Claim linked to requirement only5
Claim with no controlled downstream evidence2

Calculate the full traceability closure rate and the number of claims that cannot yet support release evidence.

Solution

Full traceability closure:

\displaystyle C_t=\frac{29}{42}\times100=69.0\%

Claims not fully closed:

N_{open}=6+5+2=13

Open fraction:

\displaystyle \frac{13}{42}\times100=31.0\%

Engineering Comment

Only 69.0 percent of claims are fully connected to requirements, risk controls, and evidence. That is weak for release readiness because a medical device claim may affect safety, clinical interpretation, usability, manufacturing, or labeling.

The two claims with no downstream evidence are immediate blockers. The six claims missing risk-control linkage should be reviewed carefully because a claim can sound like performance evidence while still leaving an associated hazard uncontrolled.

Exercise 2: RPN Reduction After a Design Control

A reusable device has a failure mode: the user can assemble a connector in the wrong orientation. Initial ratings are:

RatingValue
Severity7
Occurrence5
Detection4

The team adds asymmetric keying, a status interlock, and a setup screen that confirms correct connection. Revised ratings are:

RatingValue
Severity7
Occurrence2
Detection2

Calculate the initial and revised RPN values.

Solution

Initial RPN:

RPN_0=7\times5\times4=140

Revised RPN:

RPN_1=7\times2\times2=28

Relative reduction:

\displaystyle \frac{140-28}{140}\times100=80\%

Engineering Comment

The controls reduce occurrence and improve detection, but severity remains unchanged. The harm is still serious if the user defeats the keying, ignores the screen, or the interlock does not detect the failure.

The next engineering question is evidence: keying verification, interlock fault testing, usability validation of the setup screen, and field monitoring for repeated connection questions or workarounds.

Exercise 3: Measurement Error Budget

A diagnostic accessory reports pressure. The project acceptance criterion is:

|Error_{total}|\leq3.0\ \text{mmHg}

The root-sum-square error components are estimated as:

Error componentStandard uncertainty
Pressure transducer calibration1.1 mmHg
Analog front-end noise0.8 mmHg
Fixture positioning0.9 mmHg
Temperature sensitivity0.7 mmHg
Software rounding and quantization0.4 mmHg

Estimate combined standard uncertainty using root-sum-square. Compare it with the criterion.

Solution

Combined standard uncertainty:

u_c=\sqrt{1.1^2+0.8^2+0.9^2+0.7^2+0.4^2}
u_c=\sqrt{1.21+0.64+0.81+0.49+0.16}
u_c=\sqrt{3.31}=1.82\ \text{mmHg}

Compared with the 3.0 mmHg criterion:

1.82<3.0

Engineering Comment

The standard uncertainty screen passes, but this is not yet a complete claim. The team must define whether the 3.0 mmHg criterion applies to standard uncertainty, expanded uncertainty, worst-case error, or clinical decision error.

If the claim is based on expanded uncertainty, a coverage factor may be required by the project method. The evidence should also check drift, user placement, patient variability, environmental conditions, and reference-method uncertainty.

Exercise 4: Usability Validation of Critical Tasks

A simulated-use validation study includes 30 representative users. A critical task is successful only if the user completes the task without critical error and without moderator assistance.

Results:

OutcomeUsers
Completed without critical error27
Completed after assistance2
Critical error1

The project criterion is 95 percent unassisted success and zero critical errors. Evaluate the result.

Solution

Unassisted success rate:

\displaystyle P_s=\frac{27}{30}\times100=90.0\%

Critical-error count:

N_{critical}=1

The criterion requires:

P_s\geq95\%,\quad N_{critical}=0

The observed result is:

90.0\%<95\%,\quad1>0

Engineering Comment

The validation fails both criteria. The two assisted completions are not clean successes because the released device will not include a moderator. The critical error must be traced to interface design, labeling, training, workflow, packaging, alarm behavior, or task sequence.

The correct engineering response is not to average the result away. The team should identify the use-error mechanism, update the risk analysis and design control, and repeat affected validation scenarios after correction.

Exercise 5: Leakage Current from Insulation Resistance

A patient-connected accessory is tested with an applied voltage of:

V=250\ \text{V}

The measured insulation resistance is:

R=80\ \text{MOhm}

Use Ohm’s law to estimate leakage current:

\displaystyle I=\frac{V}{R}

Compare the result with a project screening limit of 5 microA.

Solution

Convert resistance:

R=80\ \text{MOhm}=80{,}000{,}000\ \Omega

Leakage current:

\displaystyle I=\frac{250}{80{,}000{,}000}=3.125\times10^{-6}\ \text{A}

In microamps:

I=3.125\ \text{microA}

Comparison:

3.125<5

Engineering Comment

The simple screening calculation passes the project limit. It does not replace full electrical safety evidence. A real review would check test method, patient-applied part classification, humidity conditioning, cable configuration, single-fault conditions, leakage paths, insulation material, connector contamination, and production test controls.

Engineering evidence should be at the device level, not only at the component-datasheet level.

Exercise 6: Sampling Rate and Physiological Signal Bandwidth

A wearable monitor analyzes a physiological waveform with useful content up to:

f_{max}=35\ \text{Hz}

The selected analog-to-digital converter sampling rate is:

f_s=80\ \text{Hz}

Use the sampling condition:

f_s\geq2f_{max}

Check whether the sampling rate is sufficient before considering filter roll-off and motion artifacts.

Solution

Minimum sampling rate:

2f_{max}=2\times35=70\ \text{Hz}

Comparison:

80\geq70

The selected rate satisfies the simple sampling condition.

Engineering Comment

The arithmetic passes, but the margin is small:

80-70=10\ \text{Hz}

The engineering review should still check anti-alias filtering, motion artifact, timestamp jitter, sensor saturation, quantization, data loss, algorithm latency, and whether abnormal waveforms contain higher-frequency components. A sampling theorem screen is necessary but not sufficient for device validation.

Exercise 7: Alarm Latency Budget

A monitoring device must alarm within:

T_{limit}=2.0\ \text{s}

after a sustained critical condition begins. The latency budget is:

Latency componentTime
Sensor response0.35 s
Analog filtering0.20 s
ADC buffering0.15 s
Algorithm detection window0.75 s
Display and audible alarm activation0.25 s

Calculate total latency and margin.

Solution

Total latency:

T_L=0.35+0.20+0.15+0.75+0.25=1.70\ \text{s}

Margin:

M=2.0-1.70=0.30\ \text{s}

Engineering Comment

The nominal latency budget passes with 0.30 seconds of margin. That margin may be consumed by processor load, communication retry, low battery state, sensor placement, alarm prioritization, display sleep state, or software task scheduling.

Verification should test worst-case operating modes, not only nominal bench timing. If latency protects patient safety, the evidence should include configuration, firmware version, sensor setup, and abnormal signal conditions.

Exercise 8: Sterilization Process Log-Reduction Screen

A sterile accessory process validation uses a simplified microbial challenge model. Initial bioburden is:

N_0=1.0\times10^6

After the process, recovered viable units are estimated as:

N_f=1.0

Calculate the log reduction:

\displaystyle LR=\log_{10}\left(\frac{N_0}{N_f}\right)

Solution

Log reduction:

\displaystyle LR=\log_{10}\left(\frac{1.0\times10^6}{1.0}\right)
LR=\log_{10}(10^6)=6

Engineering Comment

The simplified screen indicates a six-log reduction. This does not by itself prove a validated sterilization process. Real sterilization evidence depends on the selected method, product geometry, packaging, load configuration, biological indicators, process parameters, material compatibility, residuals, storage, transport, and revalidation triggers.

The engineering value of the calculation is that it links process effect to evidence. It should not be used as a substitute for the required sterilization validation protocol.

Exercise 9: Reliability from MTBF Over a Mission Interval

A portable device has an estimated constant-failure-rate MTBF of:

MTBF=18{,}000\ \text{h}

The intended mission interval between maintenance opportunities is:

t=120\ \text{h}

For an exponential reliability approximation:

R(t)=e^{-t/MTBF}

Estimate mission reliability.

Solution

Substitute:

R(120)=e^{-120/18000}=e^{-0.006667}
R(120)=0.9934

As a percentage:

R(120)=99.34\%

Engineering Comment

The mission reliability estimate is high under the constant-failure-rate assumption. That assumption should be checked. Medical devices can fail through battery aging, connector wear, fluid ingress, cleaning damage, calibration drift, software state faults, sensor adhesion loss, and use conditions that are not memoryless.

Reliability evidence should connect to actual failure mechanisms, preventive maintenance, field feedback, environmental exposure, and repair or replacement strategy.

Exercise 10: Acceptance Sampling for a Critical Dimension

A batch of molded components has a critical width requirement:

10.00\pm0.20\ \text{mm}

A sample of 40 parts gives:

\bar{x}=10.08\ \text{mm},\quad s=0.045\ \text{mm}

Assume a normal distribution for screening. Estimate the z-score to the upper specification limit:

\displaystyle z=\frac{USL-\bar{x}}{s}

Solution

Upper specification limit:

USL=10.20\ \text{mm}

z-score:

\displaystyle z=\frac{10.20-10.08}{0.045}=2.67

Engineering Comment

The sample mean is inside the specification, but the z-score to the upper limit is only 2.67 standard deviations. That may be weak for a critical dimension depending on severity, distribution stability, measurement uncertainty, lot size, and process capability history.

The engineering action is to check lower-tail margin, measurement system quality, tool wear, cavity effects, environmental conditions, and whether the component dimension is linked to a risk control or essential performance claim.

Exercise 11: Supplier Material Change Impact

A supplier proposes changing a polymer grade used in a reusable device handle. The engineering change review identifies:

Affected evidence areaCount
Requirements requiring review8
Risk controls requiring review5
Biocompatibility evidence items3
Cleaning and disinfection evidence items4
Mechanical strength tests6
Labeling or maintenance documents2

Calculate the total affected evidence items and decide whether this can be treated as a documentation-only change.

Solution

Total affected evidence items:

N_i=8+5+3+4+6+2=28

The change affects material safety, cleaning, mechanical strength, risk controls, and documents. It is not documentation-only.

Engineering Comment

A polymer-grade change can alter biocompatibility, cleaning compatibility, fatigue strength, creep, cracking, surface wear, chemical resistance, color stability, sterilization response, and manufacturing process controls. The affected item count confirms that this is a lifecycle evidence change, not a simple purchasing update.

The team should define which prior evidence remains valid, which evidence must be repeated, and which acceptance criteria apply to the changed configuration.

Review Checklist

When reviewing medical device V&V and risk evidence, ask:

  • Is the evidence tied to intended use, configuration, users, patients or samples, and environment?
  • Does each requirement have an acceptance criterion and verification or validation method?
  • Are risk controls specific, testable, and linked to residual-risk review?
  • Does usability validation include representative users and critical tasks?
  • Do measurement results include uncertainty, reference method, calibration, and worst-case use?
  • Do software and sensor tests cover timing, latency, jitter, data integrity, and failure modes?
  • Does process validation cover parameters, monitoring, revalidation triggers, and product configuration?
  • Does change control define which evidence remains valid and which must be repeated?
  • Are release-blocking gaps separated from lower-risk documentation gaps?
  • Can every claim be traced to requirement, risk control, evidence record, version, and residual-risk decision?

Strong medical device engineering makes evidence traceable, risk-based, configuration-aware, and usable for lifecycle decisions.

REF

See also