However, difficulties can arise depending on how these indicators are collected.
In general, there is a wide variety of different causes for deviations. Classic examples are:
The KPI ‘human error‘ in particular is gaining in importance and is increasingly being assigned upper limits in the performance targets. A high human error rate can indicate many things. This could be, for example:
However, attention must also be paid to how the human error rate is collected. Absolute or relative values are possible here. For absolute values, this means that out of 100 deviations, 20 deviations are caused by ‘human error‘. The relative value would be 20%. For tracking, the absolute value is more suitable than the relative value. Why is this so? The following is an example:
Let's assume that out of 100 deviations, we have 50 with the cause ‘human error‘ and 50 with the cause ‘machine‘. Now the target (relative value) for the KPI human error is set at 20% and a project is launched to reduce the human error rate. At the same time, a project is started to stabilise the manufacturing processes.
Through the human error reduction project, the absolute value of deviations with this cause is reduced from 50 to 30. This is huge progress. At the same time, by establishing modern machines and modern processes to protect these machines, the number of deviations with the cause ‘machine‘ is reduced from 50 to 10.
Of 40 remaining deviations, 30 fall into the cause category ‘human error‘, which corresponds to an increased relative value of 75%. This means that despite a respectable reduction in the number of deviations with the cause ‘human error‘ from 50 to 30 deviations (absolute value), the relative value has increased from 50% to 75% (cf. Table 1).
However, this only considers the case of a constant production volume. If the production volume increases, for example from 100 to 200 batches, it can be assumed that the absolute value of deviations will also increase. This must then also be taken into account when specifying the KPIs as absolute values.
Tracking the cause categories of deviations is becoming increasingly important in the KPIs. The focus here is particularly on the cause ‘human error‘. It makes more sense to track this KPI according to the absolute value than according to the relative value, as we have illustrated in the example. In order to interpret these figures correctly and derive meaningful measures from them, one must consider in advance which factors need to be taken into account for correct collection. This is how the KPIs can be properly evaluated.
Use the most comprehensive GMP online knowledge portal worldwide for your everyday work, combining theory and practice in a successful way.
The GMP Compliance Adviser is presented in two parts: