Raymond Carroll (Chair)

Abstract

We introduce a novel interpretable and tree-based algorithm for prediction in a regression setting in which each tree in a classical random forest is replaced by a family of planted trees that grow simultaneously. The motivation for our algorithm is to estimate the unknown regression function from a functional ANOVA decomposition perspective, where each tree corresponds to a function within that decomposition. Therefore, planted trees are limited in the number of interaction terms.  The maximal order of approximation in the ANOVA decomposition can be specified or left unlimited. If a first order approximation is chosen, the result is an additive model. In the other extreme case, if the order of approximation is not limited, the resulting model places no restrictions on the form of the regression function. We study the performance of the proposed estimators by extended simulations and we also develop theory for an idealised version of random planted forests. (Joint work with Munir Hiabu (Copenhagen) and Joseph T. Meyer (Heidelberg)