Building Intelligent Probabilistic Systems

In the HIPS group, we are interested in building intelligent algorithms. What makes a system intelligent? Our philosophy is that "intelligence" means making decisions under uncertainty, adapting to experience, and discovering structure in high-dimensional noisy data. The unifying theme for research in these areas is developing new approaches to statistical inference: uncovering the coherent structure that we cannot directly observe and using it for exploration and to make decisions or predictions. We develop new models for data, new tools for performing inference, and new computational structures for representing knowledge and uncertainty.

Recent News

New Podcast: Talking Machines


We are happy to announce the launch of a new podcast (hosted by Ryan Adams and Katherine Gorman) on machine learning and related topics, called Talking Machines. The first episode is up, with a taste of what the first season will bring. We have really interesting interviews with many great machine learning researchers, so definitely check it out.

Harvard CRCS Call for Fellows and Visiting Scholars


The Harvard Center for Research on Computation and Society (CRCS) solicits applications for its Postdoctoral Fellows and Visiting Scholars Programs for the 2015-2016 academic year. Postdoctoral Fellows receive an annual salary of approximately $63,000 for one year (with the possibility of renewal) to engage in a program of original research, and are provided with additional funds for travel and research support. Visiting Scholars ordinarily come with their own support, but CRCS can occasionally offer supplemental funding.

Bayesian Optimization Workshop at NIPS


At NIPS this year will be a workshop on Bayesian Optimization in Academia and Industry, on Friday 12 December 2014. The announcement is below. We invite abstracts, due on October 23, 2014.

New Spearmint Release


After many months of updates and new research, we're announcing a completely updated version of Spearmint, our tool for Bayesian optimization. It is available for use under a non-commercial license. This is a long-term collaboration between Jasper Snoek, Kevin Swersky, Hugo Larochelle, Michael Gelbart, and Ryan Adams.

Recent Publications

Parallel MCMC with Generalized Elliptical Slice Sampling. Nishihara, R, Murray I, Adams RP.  Journal of Machine Learning Research (JMLR). 2014.   { PDF }
Firefly Monte Carlo: Exact MCMC with Subsets of Data. Maclaurin, D, Adams RP.  Thirtieth Conference on Uncertainty in Artificial Intelligence (UAI). 2014.   { arXiv:1403.5693 [stat.ML] | PDF }
Accelerating MCMC via Parallel Predictive Prefetching. Angelino, E, Kohler E, Waterland A, Seltzer M, Adams RP.  Thirtieth Conference on Uncertainty in Artificial Intelligence (UAI). 2014.   { arXiv:1403.7265 [stat.ML] | PDF | Code }
Bayesian Optimization with Unknown Constraints. Gelbart, MA, Snoek J, Adams RP.  Thirtieth Conference on Uncertainty in Artificial Intelligence (UAI). 2014.   { arXiv:1403.5607 [stat.ML] | PDF | Code }