Jung, Y., & MacEachern, S. N. (2016). Efficient Model Selection in Linear and Non-Linear Quantile Regression by Cross-Validation. Presented at the ICCSS 2016 : 18th International Conference on Computational and Statistical Sciences.
Permanent Research Commons link: https://hdl.handle.net/10289/10285
Check loss function is used to define quantile regression. In the prospect of cross validation, it is also employed as a validation function when underlying truth is unknown. However, our empirical study indicates that the validation with check loss often leads to choosing an over estimated fits. In this work, we suggest a modified or L2-adjusted check loss which rounds the sharp corner in the middle of check loss. It has a large effect of guarding against over fitted model in some extent. Through various simulation settings of linear and non-linear regressions, the improvement of check loss by L2 adjustment is empirically examined. This adjustment is devised to shrink to zero as sample size grows.
Paper presented at ICCSS 2016: 18th International Conference on Computational and Statistical Sciences. © 2016 copyright with the author.