Example of Generalized Regression

The data in the Diabetes.jmp sample data table consist of measurements on 442 diabetics. The response of interest is Y, disease progression measured one year after a baseline measure was taken. Ten variables thought to be related to disease progression are also measured at baseline. This example shows how to develop a predictive model using generalized regression techniques.

Select Help > Sample Data Library and open Diabetes.jmp.

Select Analyze > Fit Model.

Select Y from the Select Columns list and click Y.

Select Age through Glucose and click Macros > Factorial to Degree.

This adds all terms up to degree 2 (the default in the Degree box) to the model.

Select Validation from the Select Columns list and click Validation.

From the Personality list, select Generalized Regression.

Click Run.

The Generalized Regression report that appears contains a Model Launch control panel and a Standard Least Squares with Validation Column report.

In the Model Launch control panel, note the following:

–

The default estimation method is the Adaptive Lasso.

–

The Validation Method is set to Validation Column because you specified a validation column in the Fit Model window.

Click Go.

An Adaptive Lasso with Validation Column report appears. The Solution Path report (Figure 5.2) shows plots of the parameter estimates and scaled negative log-likelihood. The shrinkage increases as the Magnitude of Scaled Parameter Estimates decreases. The estimates at the far right of the plot are the maximum likelihood estimates. A vertical red line indicates those parameter values selected by the validation criterion, in this case, the holdback sample defined by the column Validation.

Figure 5.2 Solution Path Plot

Select the option Select Nonzero Terms from the Adaptive Lasso with Validation Column report’s red triangle menu.

This option highlights the nonzero terms in the Parameter Estimates for Original Predictors report (Figure 5.3) and their paths in the Solution Path Plot. The corresponding columns in the data table are also selected. Note that only 7 of the 55 parameter estimates are nonzero. Also note that the scale parameter for the normal distribution (sigma) is estimated and shown in a separate table at the bottom of the Parameter Estimates for Original Data report.

Figure 5.3 Portion of Parameter Estimates for Original Predictors Report

To save the prediction formula, select Save Columns > Save Prediction Formula from the red triangle menu for the Adaptive Lasso with Validation Column report.