Nonseparable Gaussian Stochastic Process: A Unified View and Computational Strategy
Gaussian stochastic process (GaSP) has been widely used as a prior over functions due to its flexibility and tractability in modeling. However, the computational cost in evaluating the likelihood is O(n^3), where n is the number of observed points in the process, as it requires to invert the covariance matrix. This bottleneck prevents GaSP being widely used in large-scale data. We propose a general class of nonseparable GaSP models for multiple functional observations with a fast and exact algorithm, in which the computation is linear (O(n)) and exact, requiring no approximation to compute the likelihood. We show that the commonly used linear regression and separable models are both special cases of the proposed nonseparable GaSP model. The advantages of our nonseparable GaSP model are illustrated in an epigenetic application in which the genome-wide DNA methylation levels are predicted.
READ FULL TEXT