Conditional Distribution Estimation for Functional Responses with Random Forests

📅 2026-08-08
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
Existing approaches often reduce functional responses to scalars or conditional mean curves, thereby failing to capture the full influence of covariates on the entire response distribution—including its shape, temporal dynamics, and variability. This work proposes a functional distributional random forest that uniquely integrates random forests with kernel methods in function spaces. By employing maximum mean discrepancy based on Sobolev kernels or operator-induced kernels at leaf nodes, the method estimates covariate-dependent full conditional distributions nonparametrically. It enables inference on arbitrary distributional functionals while preserving the realism of predicted samples. Simulations demonstrate the model’s ability to recover distributional dynamics missed by baseline methods, and an analysis of NHANES accelerometer data reveals significant covariate effects on both the median activity profiles and predictive dispersion.
📝 Abstract
Many functional data analyses reduce random functions to scalar summaries or conditional mean curves. This is limiting when we wish to understand how covariates affect the distribution of entire functional responses, including their shape, timing, or variability. We study the problem of estimating conditional laws of functional outcomes and show that these objects can be estimated and evaluated in a practical nonparametric framework. To do this, we introduce functional distributional random forests, which estimate each conditional law as a covariate-dependent distribution over sampled functions by training a random forest to minimize a kernel-based maximum mean discrepancy within the leaf nodes of the decision tree. This supports inference on arbitrary functionals of the conditional distribution while keeping predictive samples tied to realistic curves. We consider a variety of kernels defined on function spaces, including Sobolev and operator-induced kernels. We also provide conditions for consistency of our estimator and develop scoring rules for comparing it to baseline estimators. In simulations, our method recovers distributional changes that are missed by baseline methods. In an application to NHANES accelerometer data, it identifies interesting covariate-associated changes in both median activity profiles and predictive dispersion.
Problem

Research questions and friction points this paper is trying to address.

conditional distribution estimation
functional data
random forests
distributional inference
nonparametric methods
Innovation

Methods, ideas, or system contributions that make the work stand out.

functional distributional random forests
maximum mean discrepancy
conditional distribution estimation
function space kernels
nonparametric inference
🔎 Similar Papers