5. Method Limitation
5.1. Examples
Measuring the temperature of a liquid by placing a thermometer near the heat source rather than in the bulk of the liquid, so all readings are consistently too high
Using a coloured solution in a titration without a suitable indicator, making it impossible to identify the true endpoint consistently
Using a control group that is not matched to the experimental group in a Biology investigation, introducing a consistent confounding variable
Timing a reaction by colour change observed by eye when the change is gradual, introducing a consistent delay across all trials
Using a sample size that is too small to represent the population, so results are systematically biased toward the characteristics of the sample
Assuming a linear relationship between variables when the true relationship is non-linear, causing consistent underestimation or overestimation across the range
Method Limitation: A Four-Step Analysis
Use the four-step framework to analyse a method limitation:
- Step 1 — Identify the source
Method — a flaw in the experimental design itself introduces bias, not the operator’s technique or the instrument’s condition. The same error would occur even if a different researcher used the same method with the same equipment.
- Step 2 — Classify the behaviour
Consistent, one-direction shift → Systematic error → affects accuracy. The flaw affects every trial in the same way, so all results are displaced from the true value in the same direction.
- Step 3 — Explain the impact
All results are shifted consistently too high or too low due to the design flaw. The error cannot be detected or reduced by repeating measurements, as every repeat uses the same flawed method. Precision may be unaffected — results can agree closely with each other — but the design prevents them from reflecting the true value.
- Step 4 — Suggest an improvement
Method limitations are eliminated by redesigning the relevant part of the experimental method — repeating measurements or recalibrating instruments will not help.
5.2. Effects
Method limitations produce a consistent bias across all measurements and trials. Because the flaw is built into the design itself:
results will appear precise (repeats agree with each other, since every trial uses the same flawed method),
but accuracy is reduced — all values are systematically displaced from the true value,
repeating measurements does not help, as every repeat is subject to the same design flaw,
the bias may not be apparent from the data alone — it can only be identified by critically evaluating the method itself.
5.3. Improvements
To eliminate a method limitation, identify the design flaw and modify the experimental method before data collection begins.
Identify assumptions built into the method and assess whether they are valid for the conditions of the investigation.
Reposition measurement points so they reflect the quantity of interest — for example, place a thermometer in the bulk of the liquid rather than near the heat source.
Use an objective detection method in place of subjective observation — for example, a colorimeter rather than visual colour judgement.
Ensure control and experimental groups are matched on all relevant variables to prevent confounding.
Increase sample size and use random sampling to ensure results are representative of the population.
Pilot the method before full data collection to identify and correct design flaws early.
Structured Question: Method Limitation
A Year 8 class is investigating whether plants grow taller when given more water. Each group plants five bean seeds in identical pots of soil and waters them with different volumes of water each day for two weeks. At the end of the investigation, students measure the height of each plant by placing a ruler next to the stem and reading the value at the tip of the tallest leaf.
One student notices that measuring to the tip of the tallest leaf gives different results depending on which leaf happens to be growing fastest that day. Another student points out that the tallest leaf is not always growing in a straight line upward — some leaves curve outward, making the plant appear taller than it actually is.
(a) Identify the type of error introduced by measuring to the tip of the tallest leaf rather than the top of the main stem, and classify it as random, systematic, or personal. (2 marks)
(b) Explain how this error would affect the group’s height measurements. In your answer, refer to its effect on the accuracy and precision of the results. (3 marks)
(c) The group repeats each height measurement three times on the same day and calculates a mean. Evaluate whether this would reduce the effect of the error identified in part (a). (2 marks)
(d) Describe one improvement to the method that would reduce or eliminate this error. (1 mark)
Reveal Answer Key
(a)
The error is a method limitation, classified as a systematic error.
(1 mark for naming method limitation; 1 mark for systematic)
(b)
Measuring to the tip of the tallest leaf rather than the top of the main stem consistently overestimates the true height of the plant, as leaves extend beyond the stem and may curve outward. This bias is built into the method itself and affects every measurement in the same way, regardless of who takes the reading or which instrument is used. (1 mark)
The accuracy of the results is reduced — all recorded heights are consistently higher than the true stem height, so the data does not accurately reflect plant growth. (1 mark)
The precision may appear unaffected if the same leaf is measured each time, as repeated readings will agree with each other — but all will be displaced from the true value in the same direction. (1 mark)
(c)
Repeating the height measurement three times on the same day and averaging would not reduce the effect of this error. (1 mark)
Because the flaw is in the design of the measurement itself — measuring the wrong reference point — every repeat uses the same flawed method and produces the same consistent overestimate. Averaging does not cancel a consistent offset caused by a design flaw; it only reduces the effect of random errors that vary between trials. (1 mark)
(d)
The group should redefine the measurement point in the method — for example, measure from the soil surface to the top of the main stem only, excluding leaves, and mark the measurement point consistently on each plant at the start of the investigation. (1 mark)
Part (a): accept “method limitation” or “flaw in the experimental design.” Do not accept “parallax error” — the issue is not the viewing angle but the reference point defined in the method. Do not accept “operator error” — the same incorrect result would occur regardless of which student took the measurement, as the flaw is in the method itself.
Part (b): award the direction mark only if the student identifies overestimation and links it to the leaf extending beyond the stem. Award the precision mark for a response that correctly notes results may appear precise while still being displaced from the true value — this is the key insight that distinguishes method limitations from random errors.
Part (c): a response that states “repeating reduces error” without explaining why the flaw persists across every repeat should not receive full marks. The key reasoning is that the same flawed reference point is used in every trial, so the offset is identical each time.
Part (d): accept any response that redefines the measurement point to the top of the main stem, marks a consistent reference point, or uses a method that avoids the ambiguity of leaf position — for example, measuring the height of the stem at a fixed node. Do not accept “repeat measurements” as this has already been evaluated as ineffective in part (c).