In-Depth

Measuring QSM's repository and analysis tool

• By James Heires
• June 26, 2001

Slim-Metrics, a new software data collection, analysis and reporting tool from QSM Inc., McLean, Va., is one of three software metrics tools offered by QSM. While Slim-Metrics is designed to reveal an organization's ability to develop software, it also allows any organization that is not yet collecting historical software project data to begin to do so immediately. QSM's other two products, Slim (a project estimation tool) and Slim-Control (a project tracking tool), can use Slim-Metrics' historical data as a "sanity check" to seamlessly integrate the measurement phases of a software project.

Slim-Metrics QSM Inc. McLean, Va. 800-424-6755

Software development ability is primarily measured in terms of size, effort, schedule and quality. Initial estimates and final actuals can also be compared to help improve estimation ability. But an organization's ability to stay competitive in its
industry is an important facet of a measurement program.

Slim-Metrics is integrated with annually updated industry-trend data representing more than 3,000 worldwide software development projects covering all major industries. Although individual project data is not available, these trend lines are helpful when benchmarking an organization against the competition. This capability, like all of Slim-Metrics' features, is accessed by a no-nonsense user interface.

Slim-Metrics comprises two distinct programs: Data Entry and Analysis. The Data Entry program allows users to view and edit the contents of an existing database or enter new data. Existing databases can be read directly from any of the following file formats: Slim-Metrics (.smp), Slim estimate (.sle), Slim history (.slh), Pads database (.pd4) and Slim-Control (.scp). The database is also ODBC-compliant, making it easy to create seamless interfaces to other ODBC-compliant tools.

SAMPLE DATABASE

QSM has included a sample project database with Slim-Metrics that allows users to appraise the product's functionality without first collecting data. Users can select a project from a database or add a new project to reveal a multipage data entry screen (see Fig. 1). The data fields on the first page of this screen constitute the Software Engineering Institute's Initial Core Measures of size, effort, schedule and defects. Users can enter new data from this screen or view existing data; the remaining pages allow more detailed information to be entered.

Fig. 1 Slim-Metrics lets users appraise functionality without collecting data. A multipage data entry screen can reveal a project from a database.

The remaining portion of Data Entry consists of more than 50 additional measures, including cost, requirements size, application type, design complexity, environmental factors, overrun/slippage, growth/reduction and custom fields. Custom fields -- such as compliance with certain standards, or the use of certain tools or methods -- are quite useful for defining measures particular to your organization or industry. But users should take note: Because each field is a potential discriminator when it comes to analysis, custom fields should be selected carefully.

Fig. 2 Data points, containing detailed information about the project represented, may be graphed according to property sheets.

Although extremely flexible, Data Entry does not allow new metrics to be formulated using combinations of other measures. For example, to define a metric such as hogsheads/fortnight, consider a spreadsheet-like formula capability. Assume for a moment that Beer Consumed is a custom field (quantifying the amount of beer consumed, measured in hogsheads, by a programming staff over the life of a project). Hogsheads/fortnight could then be computed in another custom field by the following formula: Hogsheads/(Schedule/12 months per year * 26 fortnights per year), where Schedule is measured in calendar months. Selected projects could then be analyzed with this newly created metric.

Buttons at the bottom of the Data Entry screen let users navigate through projects in a database. Projects can also be added and deleted in the same manner. After data entry is completed, users should switch to the Analysis program in order to experience the analytical power of Slim-Metrics.

MINING FOR DATA

The Analysis program contains a statistics engine that encompasses min., max., mean, standard deviation, coefficient of determination, slope, intercept and a number of observations. Histograms, scatter plots and bar charts can also be generated to help users discover the inherent trends in their data. The standard measures and metrics on each graph can also be compared with industry-trend lines for competitive positioning studies.

Individual studies can be grouped together to form a view that contains up to 16 graphs or tables in an adaptable layout (see Fig. 2). Views can be designed around the metrics dashboard approach or around business goals (productivity, quality and time-to-market). Views with multiple graphs or tables can be "zoomed" so that a single item fills the screen.

Slim-Metrics' graphs, however, are far more than just static pictures. Graphs also allow instant access to data, with each data point containing detailed information about the project represented. Project name, organization, size, effort and other project detail can be obtained instantly about any data point on any graph. Each graph also has an associated property sheet that defines axis metrics, titles, data sets, variation lines and report format.

One power feature is the ability to present different data trends on the same graph. This capability can be helpful when users need to show the differences between organizations, application types or time periods. Trend lines for each data set can be displayed as well, showing mean and standard deviation.

Slim-Metrics requires Windows 95 or NT, a Pentium CPU and 30Mb of hard disk. License options begin at $4,995. Training/support is also available from QSM.