One factor at a time cannot find what you are looking for
The instinct when a process misbehaves is to change one thing, see what happens, change it back, change the next thing. It is careful, it feels rigorous, and it is almost the worst way to spend the experiments.
It fails for a specific reason: it cannot see interactions. If a higher temperature only helps when the catalyst loading is also high, no amount of varying temperature at fixed catalyst will reveal it. And on real chemical and thermal processes, interactions are usually where the money is.
A factorial design varies everything together, in a pattern, so that every factor is tested equally often at both settings. Each run contributes to the estimate of every effect rather than just one — which is why factorial designs get more information from fewer experiments, not more.
What the designs cost
Two levels per factor, full factorial:
| Factors | Full factorial | Res IV fraction | Res V fraction |
|---|---|---|---|
| 3 | 8 | 8 | 8 |
| 4 | 16 | 8 | 8 |
| 5 | 32 | 8 | 16 |
| 6 | 64 | 8 | 16 |
| 7 | 128 | 8 | 16 |
Seven factors as a full factorial is 128 experiments. As a resolution IV fraction it is 8 — a 1/16th fraction that still estimates all seven main effects.
That saving is real, and it is not free.
What a fraction gives up: aliasing
A fractional design builds its extra factors as products of the base ones. In the 2⁷⁻⁴ design, factor 4 is the product of factors 1 and 2. The consequence is that the design cannot tell the effect of factor 4 apart from the interaction between factors 1 and 2 — they are aliased, and the number the analysis returns is their sum.
Resolution names how bad the aliasing is:
- Resolution IV — main effects are clear of two-factor interactions, but two-factor interactions are confounded with each other. Right for screening, when you want to know which of many factors matter at all.
- Resolution V — main effects and two-factor interactions are all clear of one another. Right when you already know which factors matter and need to understand how they combine.
The honest workflow is usually two stages: screen seven or eight candidates in 8 runs at resolution IV, then take the three or four that survive and run a full factorial with replication on those.
Randomising the run order
The randomise option shuffles the order in which you actually perform the runs, and it matters more than it looks.
Anything that drifts over the course of a day — a warming room, a settling feedstock, a catalyst slowly deactivating, an operator getting better at the job — will be read as a factor effect if you happen to run that factor's settings in time order. Randomising breaks the correlation, so drift becomes noise rather than a false result.
Randomise unless a factor is genuinely impractical to change between runs. If one is (a furnace that takes six hours to change temperature, for instance), that is a split-plot design, and it needs analysing as one — the calculator does not build split-plot designs.
Reading the design
Coded levels are −1 and +1 for the low and high setting of each factor. The analysis works in coded units, which is what makes the effects directly comparable regardless of whether a factor is measured in °C or bar. The table shows both the coded level and the real value you set on the plant.
Balance is the mean coded level per factor. Every one should be exactly zero: that is what "each factor tested equally often high and low" means, and it is the property that keeps the estimated effects independent of each other and of the overall mean. The calculator plots it so an unbalanced design cannot slip through unnoticed.
Limits worth stating before you run anything
- Two levels only. Two-level designs assume the response is roughly linear between your settings. They find which factors matter and how they interact — they cannot locate an optimum inside the range or detect curvature. That needs centre points, and then a response-surface design (central composite, Box–Behnken).
- No replication. Without repeated runs you have no independent estimate of experimental error, so you cannot tell a real effect from noise. Add replicates or centre points if you need a significance test rather than a ranking.
- It plans, it does not analyse. The design matrix and an empty response column come out; the effects, the ANOVA and the model do not.
- It does not know your constraints. Some combinations of settings will be unsafe, impossible, or will wreck a batch. Read every row before you run it.
- Choose your levels well. Too narrow and a real effect vanishes into measurement noise; too wide and you leave the operating envelope or hit a non-linearity the design cannot represent.
An hour spent choosing factors and levels is worth more than any amount of sophistication in the design that follows.