Narrowing the Gap: Random Forests In Theory and In Practice
Despite widespread interest and practical use, the theoretical properties of random forests are still not well understood. In this paper we contribute to this understanding in two ways. We present a new theoretically tractable variant of random regression forests and prove that our algorithm is cons...
| Main Authors: | , , |
|---|---|
| Format: | Conference item |
| Published: |
2014
|
| _version_ | 1826275680499793920 |
|---|---|
| author | Denil, M Matheson, D de Freitas, N |
| author_facet | Denil, M Matheson, D de Freitas, N |
| author_sort | Denil, M |
| collection | OXFORD |
| description | Despite widespread interest and practical use, the theoretical properties of random forests are still not well understood. In this paper we contribute to this understanding in two ways. We present a new theoretically tractable variant of random regression forests and prove that our algorithm is consistent. We also provide an empirical evaluation, comparing our algorithm and other theoretically tractable random forest models to the random forest algorithm used in practice. Our experiments provide insight into the relative importance of different simplifications that theoreticians have made to obtain tractable models for analysis. |
| first_indexed | 2024-03-06T23:02:28Z |
| format | Conference item |
| id | oxford-uuid:629ebd34-6a06-4e10-9939-edde8af25909 |
| institution | University of Oxford |
| last_indexed | 2024-03-06T23:02:28Z |
| publishDate | 2014 |
| record_format | dspace |
| spelling | oxford-uuid:629ebd34-6a06-4e10-9939-edde8af259092022-03-26T18:07:25ZNarrowing the Gap: Random Forests In Theory and In PracticeConference itemhttp://purl.org/coar/resource_type/c_5794uuid:629ebd34-6a06-4e10-9939-edde8af25909Department of Computer Science2014Denil, MMatheson, Dde Freitas, NDespite widespread interest and practical use, the theoretical properties of random forests are still not well understood. In this paper we contribute to this understanding in two ways. We present a new theoretically tractable variant of random regression forests and prove that our algorithm is consistent. We also provide an empirical evaluation, comparing our algorithm and other theoretically tractable random forest models to the random forest algorithm used in practice. Our experiments provide insight into the relative importance of different simplifications that theoreticians have made to obtain tractable models for analysis. |
| spellingShingle | Denil, M Matheson, D de Freitas, N Narrowing the Gap: Random Forests In Theory and In Practice |
| title | Narrowing the Gap: Random Forests In Theory and In Practice |
| title_full | Narrowing the Gap: Random Forests In Theory and In Practice |
| title_fullStr | Narrowing the Gap: Random Forests In Theory and In Practice |
| title_full_unstemmed | Narrowing the Gap: Random Forests In Theory and In Practice |
| title_short | Narrowing the Gap: Random Forests In Theory and In Practice |
| title_sort | narrowing the gap random forests in theory and in practice |
| work_keys_str_mv | AT denilm narrowingthegaprandomforestsintheoryandinpractice AT mathesond narrowingthegaprandomforestsintheoryandinpractice AT defreitasn narrowingthegaprandomforestsintheoryandinpractice |