Bayesian Linear Regression - CEDAR

More documents

Recommendations

Info

Machine Learning ! ! ! ! !SrihariKernel Function formulation• Formulation of Linear Regression in terms ofkernel function suggests:– Directly define kernel functions and use to makepredictions for input x• Leads to Gaussian Processes for Regressionand Classification• Can be shown that• Equivalent kernel satisfies important property:– where€€k(x,z) =ψ(x) T ψ(z)ψ(x) = β 1/ 2 S N1/ 2 φ(x)N∑n=1k(x,x n) =130
Machine Learning ! ! ! ! !SrihariProbabilistic Linear Regression Revisited!• Re-derive the predictive distribution by workingin terms of distribution over functions y(x,w)– It will provide a specific example of a GaussianProcess• Consider model with M fixed basis functionsy(x)=w T φ (x)where x is the input vector and w is the M-dimensional weight vector• Assume a Gaussian distribution of weight wp(w) = N(w|0,α -1 I)• Probability distribution over w induces aprobability distribution over functions y(x)yx
Page 1 and 2: Machine Learning ! ! ! ! !SrihariBa
Page 3: Machine Learning ! ! ! ! !SrihariSh
Page 6 and 7: Machine Learning ! ! ! ! !SrihariLi
Page 8 and 9: Machine Learning ! ! ! ! !SrihariPr
Page 10 and 11: Machine Learning ! ! ! ! !SrihariSa
Page 12 and 13: Machine Learning ! ! ! ! !SrihariBa
Page 14 and 15: Sequential Bayesian LearningMachine
Page 20 and 21: Machine Learning ! ! ! ! !SrihariEx
Page 24 and 25: Machine Learning ! ! ! ! !SrihariEq
Page 35 and 36: Machine Learning ! ! ! ! !SrihariPa
Page 37 and 38: Machine Learning ! ! ! ! !SrihariGa
Page 39 and 40: Machine Learning ! ! ! ! !SrihariDe
Page 43 and 44: Machine Learning ! ! ! ! !SrihariGP
Page 45: Machine Learning ! ! ! ! !SrihariWi

Bayesian Linear Regression - CEDAR

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?