SCAD-penalised generalised additive models with non-polynomial dimensionality
In this article, we study the (group) smoothly clipped absolute deviation (SCAD) estimator in the estimation of generalised additive models. The SCAD penalty, proposed by Fan and Li [(2001) ‘Variable Selection via Nonconcave Penalised Likelihood and Its Oracle Properties’, Journal of the American...
| Main Authors: | , , |
|---|---|
| Other Authors: | |
| Format: | Journal Article |
| Language: | English |
| Published: |
2013
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/98192 http://hdl.handle.net/10220/17090 |
| _version_ | 1826119917346226176 |
|---|---|
| author | Li, Gaorong Xue, Liugen Lian, Heng |
| author2 | School of Physical and Mathematical Sciences |
| author_facet | School of Physical and Mathematical Sciences Li, Gaorong Xue, Liugen Lian, Heng |
| author_sort | Li, Gaorong |
| collection | NTU |
| description | In this article, we study the (group) smoothly clipped absolute deviation (SCAD) estimator in the estimation
of generalised additive models. The SCAD penalty, proposed by Fan and Li [(2001) ‘Variable Selection via
Nonconcave Penalised Likelihood and Its Oracle Properties’, Journal of the American Statistical Association
96(456), 1348–1360], has many desirable properties including continuity, sparsity and unbiasedness.
For high-dimensional parametric models, it has only recently been shown that the SCAD estimator can
deal with problems with dimensions much larger than the sample size. Here, we show that the SCAD
estimator can be successfully applied to generalised additive models with non-polynomial dimensionality
and our study represents the first such result for the SCAD estimator in nonparametric problems, as far
as we know. In particular, under suitable assumptions, we theoretically show that the dimension of the
problem can be close to exp{nd/(2d+1)}, where n is the sample size and d is the smoothness parameter of
the component functions. Some Monte Carlo studies and a real data application are also presented. |
| first_indexed | 2024-10-01T05:07:57Z |
| format | Journal Article |
| id | ntu-10356/98192 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T05:07:57Z |
| publishDate | 2013 |
| record_format | dspace |
| spelling | ntu-10356/981922020-03-07T12:34:45Z SCAD-penalised generalised additive models with non-polynomial dimensionality Li, Gaorong Xue, Liugen Lian, Heng School of Physical and Mathematical Sciences DRNTU::Science::Mathematics::Statistics In this article, we study the (group) smoothly clipped absolute deviation (SCAD) estimator in the estimation of generalised additive models. The SCAD penalty, proposed by Fan and Li [(2001) ‘Variable Selection via Nonconcave Penalised Likelihood and Its Oracle Properties’, Journal of the American Statistical Association 96(456), 1348–1360], has many desirable properties including continuity, sparsity and unbiasedness. For high-dimensional parametric models, it has only recently been shown that the SCAD estimator can deal with problems with dimensions much larger than the sample size. Here, we show that the SCAD estimator can be successfully applied to generalised additive models with non-polynomial dimensionality and our study represents the first such result for the SCAD estimator in nonparametric problems, as far as we know. In particular, under suitable assumptions, we theoretically show that the dimension of the problem can be close to exp{nd/(2d+1)}, where n is the sample size and d is the smoothness parameter of the component functions. Some Monte Carlo studies and a real data application are also presented. 2013-10-31T01:30:59Z 2019-12-06T19:51:58Z 2013-10-31T01:30:59Z 2019-12-06T19:51:58Z 2012 2012 Journal Article Li, G., Xue, L., & Lian, H. (2012). SCAD-penalised generalised additive models with non-polynomial dimensionality. Journal of nonparametric statistics, 24(3), 681-697. https://hdl.handle.net/10356/98192 http://hdl.handle.net/10220/17090 10.1080/10485252.2012.698740 en Journal of nonparametric statistics |
| spellingShingle | DRNTU::Science::Mathematics::Statistics Li, Gaorong Xue, Liugen Lian, Heng SCAD-penalised generalised additive models with non-polynomial dimensionality |
| title | SCAD-penalised generalised additive models with non-polynomial dimensionality |
| title_full | SCAD-penalised generalised additive models with non-polynomial dimensionality |
| title_fullStr | SCAD-penalised generalised additive models with non-polynomial dimensionality |
| title_full_unstemmed | SCAD-penalised generalised additive models with non-polynomial dimensionality |
| title_short | SCAD-penalised generalised additive models with non-polynomial dimensionality |
| title_sort | scad penalised generalised additive models with non polynomial dimensionality |
| topic | DRNTU::Science::Mathematics::Statistics |
| url | https://hdl.handle.net/10356/98192 http://hdl.handle.net/10220/17090 |
| work_keys_str_mv | AT ligaorong scadpenalisedgeneralisedadditivemodelswithnonpolynomialdimensionality AT xueliugen scadpenalisedgeneralisedadditivemodelswithnonpolynomialdimensionality AT lianheng scadpenalisedgeneralisedadditivemodelswithnonpolynomialdimensionality |