In high dimensional regression problems regularization methods have been a popular choice to address variable selection and multicollinearity. In this paper we study bridge regression that adaptively selects the penalty order from data and produces flexible solutions in various settings. We implement bridge regression based on the local linear and quadratic approximations to circumvent the nonconvex optimization problem. Our numerical study shows that the proposed bridge estimators are a robust choice in various circumstances compared to other penalized regression methods such as the ridge, lasso, and elastic net. In addition, we propose group bridge estimators that select grouped variables and study their asymptotic properties when the number of covariates increases along with the sample size. These estimators are also applied to varying-coefficient models. Numerical examples show superior performances of the proposed group bridge estimators in comparisons with other existing methods.

TR Number: 
2010-03
Cheolwoo Park and Young Joo Yoon
Key Words: 
Analysis of Variance, Bridge regression, Multicollinearity, Oracle property, Penalized regression, Variable selection, Varying-coefficient models

To request a copy of this report, please email us. We will send you a pdf copy if one is available.