LM101-076: How to Choose the Best Model using AIC and GAIC -

LM101-076: How to Choose the Best Model using AIC and GAIC

Listen now

Description

The precise semantic interpretation of the Akaike Information Criterion (AIC) and Generalized Akaike Information Criterion (GAIC) for selecting the best model are provided, explicit assumptions are provided for the AIC and GAIC to be valid, and explicit formulas are provided for the AIC and GAIC so they can be used in practice. AIC and GAIC provide a way of estimating the average prediction error of your learning machine on test data without using test data or cross-validation methods.

More Episodes

See all »

LM101-086: Ch8: How to Learn the Probability of Infinitely Many Outcomes

This 86th episode of Learning Machines 101 discusses the problem of assigning probabilities to a possibly infinite set of observed outcomes in a space-time continuum which corresponds to our physical world. The machine learning algorithm uses information about the frequency of environmental...

Published 07/20/21

Learning Machines 101

Published 07/20/21

LM101-085:Ch7:How to Guarantee your Batch Learning Algorithm Converges

This 85th episode of Learning Machines 101 discusses formal convergence guarantees for a broad class of machine learning algorithms designed to minimize smooth non-convex objective functions using batch learning methods. Simple mathematical formulas are presented based upon research from the late...

Published 05/21/21