Expectation maximization, one step at a time

330 points from three hidden groups. Fit a Gaussian mixture by alternating E-steps and M-steps.

EM for a mixture of three Gaussians

Try thisPress E-step and M-step in turn and watch the log-likelihood: it never goes down. Try several random starts: sometimes EM gets stuck with two ellipses sharing one cluster (a local optimum).