Gaussian Processes (GPs) are powerful nonparametric distributions over functions. For real-valued
outputs, we can combine the GP prior with a Gaussian likelihood and perform exact posterior inference in closed form. However, in other cases, such as classification, preference learning, ordinal regression and mixed problems, the likelihood is no longer conjugate to the GP prior, and exact inference is known to be intractable.
We showed that is actually possible to derive closed-form expression for the posterior process in all the above cases (not only for regression), and that the posterior process is a Skew Gaussian Process (SkewGP). SkewGPs are more general and more flexible nonparametric distributions than GPs, as SkewGPs may also represent asymmetric distributions. Moreover, SkewGPs include GPs as a particular case. By exploiting the closed-form expression for the posterior and predictive distribution, we can compute inferences for regression, classification, preference and mixed problems with computation complexity of O(n^3) and storage demands of O(n^2) (same as for GP regression).
The software library SkewGP provides a unified framework for closed-form nonparametric inference for a large class of supervised learning problems.
- A unified framework for closed-form nonparametric regression, classification, preference and mixed problems with Skew Gaussian Processes. In: Machine Learning, pp. 1-39, 2021.
- Preferential Bayesian optimisation with Skew Gaussian Processes. In: 2021 Genetic and Evolutionary Computation Conference Companion (GECCO '21 Companion), July 10--14, 2021, Lille, France , ACM, New York, NY, USA, 2021, ISBN: 978-1-4503-8351-6/21/07.
- Skew Gaussian Processes for Classification. In: Machine Learning, vol. 109, pp. 1877–1902, 2020.