Research work · 2019
Regression and optimization
Thomas P. Trappenberg
Fundamentals of Machine Learning
Abstract
This chapter returns to the more theoretical embedding of machine learning in regression. Prior chapters have shown that writing machine learning programs is easy using high-level computer languages and with the help of good machine learning libraries. However, applying such algorithms appropriately with superior performance requires considerable experience and a deeper knowledge of the underlying ideas and algorithms. This chapter takes a step back to consider basic regression in more detail, which in turn will form the foundation for discussing probabilistic models in following chapters. This includes the important discussion of gradient descent as a learning algorithm.