Some Problems You May Encounter

Questions to Ask When Generating and Reviewing Metrics

Most organizations collect some sort of measurements, even if they are only when projects start and finish, or how much money has been spent so far. When structuring a metrics process, you should consider asking the following questions of your project managers:

• What metrics do you collect?

• How do they track to the cost-effort-schedule metrics needed by senior management or other corporate activities?

• Do you use and understand "Earned Value"?

• Do you track the time it takes to enter, track, and report metrics?

• Do you use any graphs or automated tools?

• Which metrics work for you, and which ones do not work for you? Why and why not?

• How have you used the metrics?

• What problems do you see in entering, collecting, analyzing, and reporting the metrics?

• How do you use the WBS? Does it tie back to the activities tracked by the metrics?

• How are the metrics you collect tied to business goals and the business problems in this organization?

• How do you analyze the metrics data?

• How do you verify that the data are correct and accurate?

• As for trends, what problems does your project have? Do the metrics reflect this finding? Did using the metrics help you identify this problem?

• In which phase of the life cycle did these problems occur?

• Do the metrics collected reflect or help you identify the phase of the life cycle in which the problem occurred, or the cause of the problem?

Selection of the metrics to be used on the projects should take into consideration the size of the project (both in dollars, personnel, and product size ); project classification (Development, Enhancements, or Maintenance); and the complexity of the system being built. In addition, the metrics should reflect the needs of the projects that represent the main functional areas in your organization. This approach will help to ensure coverage of representative projects of the organization.