MODEL SELECTION VIA ROBUST VERSION OF R-SQUARED
- 1 University of Malaya, Malaysia
Abstract
R-squared (R2) is a popular method for variable selection in linear regression models. R2 based on Least Squares (LS) regression minimizes the sum of the squared residuals; LS is sensitive to outlier observation. Alternative criterion based on M-estimators, which is less sensitive to outlying observation has been proposed. In this study explicit expression for such criterion is obtained when the Least Trimmed Squares (LTS) estimator is used. The influence function of R2 is also discussed. In our simulation study, the performance of proposed criterion is compared to the existing criteria based on M-estimators (R2M) and to the classical non-robust based on least squares estimators (R2LS). We observe that the proposed (R2LTS) selects more appropriate models in the case of bad leverage points (outliers in the X-direction) are present.
DOI: https://doi.org/10.3844/jmssp.2014.414.420
Copyright: © 2014 Shokrya Saleh. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
- 3,763 Views
- 3,081 Downloads
- 24 Citations
Download
Keywords
- Robust R2-Coefficents
- Least Trimmed Squares
- Influence Function