Testing Limitations

Testing Limitations

• You cannot test a program completely
• We can only test against system requirements

– May not detect errors in the requirements.
– Incomplete or ambiguous requirements may lead to inadequate or incorrect testing.

• Exhaustive (total) testing is impossible in present scenario.
• Time and budget constraints normally require very careful planning of the testing effort.
• Compromise between thoroughness and budget.
• Test results are used to make business decisions for release dates.
• Even if you do find the last bug, you’ll never know it
• You will run out of time before you run out of test cases
• You cannot test every path
• You cannot test every valid input
• You cannot test every invalid input

Must Read – The Impossibility of Complete Testing by Dr. Cem Kaner