Evaluating options with a structured approach
To evaluate options against a baseline concept,using a generated list of criteria.
*Generate evaluation criteria*
Identify the criteria you will use. This can itself generate significant debate. This is usually a good sign, especially if it surfaces underlying issues that can be discussed and resolved. There may be up to 20 criteria, although you should be careful not to hide the trees of important criteria in the wood of less important ones.
*Identify baseline concept*
A base option or baseline concept is then chosen, against which all other options will be compared. This is a very helpful process, as it is much easier to compare two options than allocate a stand-alone score to a single option. The base option may be a competitor product, an industry benchmark or other standard.
*Score options against the baseline*
The team then examines each option or concept and compares it against each criterion to give it a relative score. The scoring scheme for this may simply be +1, 0 and -1 to show "better, same, worse" or may have values attached to the criteria that indicate how much better or worse the option is.
Each option then has its score totalled to show its overall score relative to the base option. If one option scores much higher, then this is clearly likely to be the best choice. However, before rejecting other options, you can consider how they may be improved. For example a low-scoring choice may have its score significantly increased at relatively low cost.
Usual or Expected Outcomes: The concept screen works simply by comparison against a benchmark base option. We find it easier to compare than to give absolute scores to something. Having a fixed things against which to compare all options helps make scores fair and equitable. By selecting a strong base option, you can also test how effective and competitive your solution really is.
A consideration that should always be held in the mind with this approach is that it is a poor criteria or inaccurate scoring will give a poor result.
A major benefit of this that should not be forgotten is the impact on teamwork. A structured approach, no matter what it is, can help bring the team together and create a more equitable and more rationally considered decision than an unstructured argument.