Process Performance Analysis or Process Capability Analysis?

The BIS.Net Team BIS.Net Team

This is a common question asked to which different scholars have different opinions. Two of these are examined now.

One school of thought suggests that process performance analysis should only be performed during Phase I of SPC applications and a process capability analysis during phase II. The reasoning follows Dr. Walter Shewhart’s assertion that an out-of-control process cannot be used to predict process capability. During Phase I the process is out-of-control and hence process performance analysis is more appropriate. During Phase II the process has been bought under control, and thus behaves predictably making process capability analysis more appropriate.

It is unlikely that Dr. Shewhart intended for his comments to be used literally, for he has shown to be a very pragmatic and practical statistician, who believed that just because criteria have a history of high-brow statistics, does not justify their use.

A more practical school of thought asserts that during Phase I performing an exploratory capability analysis enables management to estimate the worth of bringing the process in control. Although the process may be out-of-control, this does not always make a process capability analysis unreliable. The reason is that a process capability analysis is based on within sub-group variation, whereas a process performance analysis is based on total variation.

It must be made clear that a capability analysis based on within sub-group variation only applies to normally distributed data. For non-normally distributed data the concept of using within subgroup standard deviation cannot be applied because the spread of the non-normal data cannot be directly related to a multiple of standard deviation. For non-normal data, a process capability analysis must be performed on a stable process, or use the BIS.Net Special Analysis App to remove the effect of an out of control process using Machine Power. If the App is used then capability can be performed in both Phase I and Phase II, where Phase I provides an estimate for the in-control Phase II process capability.

Within sub-group variation tends to be robust to the overall stability of the process, as shown in the image below. Here the distribution curves are based on within sub-group variation and remains constant even though the process is clearly out-of-control.

Process Capability Analysis

It is thus not unreasonable to perform a process capability analysis on an unstable process, if it can be proven that within sub-group variation is stable during Phase I SPC. This can be done with machine powered dynamic capability charts, such as shown above and below, or classical statistical tests such as Bartlett’s or Levene’s test.

It is of course possible that the variation within subgroups is also unstable, such as shown in the image below.

Process Performance Analysis

In this instance a process capability analysis appears futile and it would make sense to at least try and stabilize the within sub-group variation and then perform a process capability analysis the conventional way using within subgroup variation.

One option is to take many samples during a period when the within subgroup variation is near its lowest, or at a level believed to be achievable consistently and perform a capability analysis on this snapshot of data. This would estimate capability on the premise that within subgroup variation can be maintained near the chosen level of within subgroup variability.

It thus makes sense to conclude that there is no reason why a capability analysis cannot be performed during Phase I as well and why a process performance analysis cannot be applied during Phase II as well. The latter because it is prudent to always see how the process is performing. If a process capability analysis is performed during Phase I then this fact must be clearly documented and the reasons and limitations explained.

As a customer it can be argued that it makes more sense to know what the process performance is as opposed to what the process is capable off, i.e. a process performance analysis should also be performed during Stage II. Although a process may be perfectly capable of producing non-conforming product then surely if the process does not produce non-conforming product then this is more important information than the theoretical possibility. This brings us to the point where we need to understand the terms process capability and performance to further answer the question, process performance or process capability?

Process capability generally is defined as the ability of something performing a required task. For quality assurance purposes the task is producing near zero non-conformance. In this instance whether the process can perform this task is measured by the range of inherent variations. Historically inherent variation is measured from within subgroup variation. This demonstrates an incorrect assumption that only within subgroup variation is inherent. Between process variation can also be inherent, such as processes dependent on mother nature, which does not practice SPC. A classical capability analysis may thus be far too optimistic making a process performance analysis a better choice.

If the only inherent variation is within subgroup variation then this begs the question, what is better during Phase II. A process capability or process performance analysis? The former assumes a perfectly stable process. But no process is always perfectly stable. So, it seems more pragmatic to perform both analyses to see if the process is deteriorating relative to what it is capable of.

Process capability analysis or process performance analysis?

The overall conclusion is that there should not be a hard-line drawn, for when a capability or process performance analysis is applied, no matter whether recommended by high-brow statistical theory. Practical considerations dictate that both provide important information at all stages. What is important is documenting the state of the process at the time of the analysis and the phase of operation, listing the limitations and caveats of the analysis.

200 Analytics Tools For Quality

Download 200 statistical analytics tools for quality improvement - Mobile Version

Improve product quality through smart data insights using new-age, machine-powered driven analytics, available to download through a suite of Apps!

  • Apps for SPC, MSA, Process Performance, Inferences, Visualization, and much more
  • No licencing or subscriptions! Pay ONLY per analysis billed monthly - don't use, don't pay!
  • Always up-to-date with the latest features