Research work · 2019

Regression and optimization

Thomas P. Trappenberg

Fundamentals of Machine Learning

Abstract

This chapter returns to the more theoretical embedding of machine learning in regression. Prior chapters have shown that writing machine learning programs is easy using high-level computer languages and with the help of good machine learning libraries. However, applying such algorithms appropriately with superior performance requires considerable experience and a deeper knowledge of the underlying ideas and algorithms. This chapter takes a step back to consider basic regression in more detail, which in turn will form the foundation for discussing probabilistic models in following chapters. This includes the important discussion of gradient descent as a learning algorithm.

DOI: 10.1093/oso/9780198828044.003.0005