P-values for high-dimensional regression
Assigning significance in high-dimensional regression is challenging. Most computationally efficient selection algorithms cannot guard against inclusion of noise variables. Asymptotically valid p-values are not available. An exception is a recent proposal by Wasserman and Roeder (2008) which splits...
| Main Authors: | , , |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
2008
|
| _version_ | 1826261246532386816 |
|---|---|
| author | Meinshausen, N Meier, L Bühlmann, P |
| author_facet | Meinshausen, N Meier, L Bühlmann, P |
| author_sort | Meinshausen, N |
| collection | OXFORD |
| description | Assigning significance in high-dimensional regression is challenging. Most computationally efficient selection algorithms cannot guard against inclusion of noise variables. Asymptotically valid p-values are not available. An exception is a recent proposal by Wasserman and Roeder (2008) which splits the data into two parts. The number of variables is then reduced to a manageable size using the first split, while classical variable selection techniques can be applied to the remaining variables, using the data from the second split. This yields asymptotic error control under minimal conditions. It involves, however, a one-time random split of the data. Results are sensitive to this arbitrary choice: it amounts to a `p-value lottery' and makes it difficult to reproduce results. Here, we show that inference across multiple random splits can be aggregated, while keeping asymptotic control over the inclusion of noise variables. We show that the resulting p-values can be used for control of both family-wise error (FWER) and false discovery rate (FDR). In addition, the proposed aggregation is shown to improve power while reducing the number of falsely selected variables substantially. |
| first_indexed | 2024-03-06T19:18:29Z |
| format | Journal article |
| id | oxford-uuid:193d3f27-8a96-4230-a326-0d1eec0a1c07 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-06T19:18:29Z |
| publishDate | 2008 |
| record_format | dspace |
| spelling | oxford-uuid:193d3f27-8a96-4230-a326-0d1eec0a1c072022-03-26T10:47:52ZP-values for high-dimensional regressionJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:193d3f27-8a96-4230-a326-0d1eec0a1c07EnglishSymplectic Elements at Oxford2008Meinshausen, NMeier, LBühlmann, PAssigning significance in high-dimensional regression is challenging. Most computationally efficient selection algorithms cannot guard against inclusion of noise variables. Asymptotically valid p-values are not available. An exception is a recent proposal by Wasserman and Roeder (2008) which splits the data into two parts. The number of variables is then reduced to a manageable size using the first split, while classical variable selection techniques can be applied to the remaining variables, using the data from the second split. This yields asymptotic error control under minimal conditions. It involves, however, a one-time random split of the data. Results are sensitive to this arbitrary choice: it amounts to a `p-value lottery' and makes it difficult to reproduce results. Here, we show that inference across multiple random splits can be aggregated, while keeping asymptotic control over the inclusion of noise variables. We show that the resulting p-values can be used for control of both family-wise error (FWER) and false discovery rate (FDR). In addition, the proposed aggregation is shown to improve power while reducing the number of falsely selected variables substantially. |
| spellingShingle | Meinshausen, N Meier, L Bühlmann, P P-values for high-dimensional regression |
| title | P-values for high-dimensional regression |
| title_full | P-values for high-dimensional regression |
| title_fullStr | P-values for high-dimensional regression |
| title_full_unstemmed | P-values for high-dimensional regression |
| title_short | P-values for high-dimensional regression |
| title_sort | p values for high dimensional regression |
| work_keys_str_mv | AT meinshausenn pvaluesforhighdimensionalregression AT meierl pvaluesforhighdimensionalregression AT buhlmannp pvaluesforhighdimensionalregression |