Training Energy Based Models, Dr. David Barber
University of Cambridge event

Mon, 23 Oct 2023 3:00 PM - 4:00 PM

Organiser
Cambridge ELLIS Unit Seminar Series
Location
Online

The Cambridge ELLIS Unit Seminar Series holds talks by leading researchers in the area of machine learning and AI. Our next  speaker of 2023 will be Dr. David Barber. Details of his talk can be found below.

Abstract: Energy Based models are undirected models of the formp(x) \propto exp(-f(x)). These are very general models and provide an alternative to the currently popular directed models used in Diffusion Models and LLMs. However, training and sampling from these models is typically problematic. We consider an approach based on Denoising Score Matching and consider a Gibbs sampling to recover samples from the learned model. Remarkably, we show that there is an exact expression for the mean and covariance of the sampler. We will also highlight close connections to Diffusion Models.

Please note that we require all attendees to have valid Zoom accounts to join.

Zoom detailshttps://cam-ac-uk.zoom.us/j/83278351798?pwd=bUh6d09NVkkwM20xeFVXZUVjakNTQT09

Meeting ID: 832 7835 1798

Passcode: 481967

Talks.cam link: http://talks.cam.ac.uk/talk/index/206371

Image
generic image