In the Fit Least Squares report, the Press option represents the prediction error sum of squares statistic, which is an estimate of prediction error computed using leave-one-out cross validation. In leave-one-out cross validation, each observation, in turn, is removed. Consider a specific observation. The model is fit with that observation withheld and then a predicted value is obtained for that observation. The residual for that observation is computed. This procedure is applied to all observations and the residuals are squared and summed to give the Press value.
Specifically, the Press sum of squares for error (SSE) statistic is given by the following:
where n is the number of observations, yi is the observed response value for the ith observation, and is the predicted response value for the ith observation. These values are based on a model fit without including that observation.
The Press RMSE is defined as .
The Press RSquare is defined as 1 - Press/SSTotal.
The Press report also contains the SSE, RMSE, and RSquare values for the overall model. The statistics for the overall model are in the row labeled Ordinary.