Slice Sampling Covariance Hyperparameters in Latent Gaussian Models

Advances in Neural Information Processing Systems 23, Vancouver, British Columbia, p.1723-1731 (2010)
arXiv:1006.0868 [stat.CO] | PDF | Google Doc | Code | Google Scholar | BibTex | EndNote


The Gaussian process (GP) is a popular way to specify dependencies between random variables in a probabilistic model. In the Bayesian framework the covariance structure can be specified using unknown hyperparameters. Integrating over these hyperparameters considers different possible explanations for the data when making predictions. This integration is often performed using Markov chain Monte Carlo (MCMC) sampling. However, with non-Gaussian observations standard hyperparameter sampling approaches require careful tuning and may converge slowly. In this paper we present a slice sampling approach that requires little tuning while mixing well in both strong- and weak-data regimes.


gaussian process, markov chain monte carlo, slice sampling