8. From Classical Statistics Models to Machine Learning Algorithms

Topics, Class Notes and Code Assignments and Side Readings
  • Predictive Modeling with Logistic Regression (Revisited)
  • Technical Terms from Machine Learning
  • A Diagrammatic View of Logistic Regression
  • Perceptron - A Simple Neural Network Model
    • The architecture of a percetron model
    • The components of an neural network model
    • Loss function and estimatation method
    • The use of neural network model: regression and classification
  • Inplementation Perceptron Model with R
  • Notes and code
  • Optional Reading Assignments
    • This book chapter is littlt technical but good introduction to the perceptron model [PDF]
    • Help Document of neuralnet library PDF [link]
  • Project Two: Supervised Learning Algorithms: Guidelines [HTML] [PDF]
    Part I - Logistic and Perceptron Models
    • Choose a new dataset with a binary response with a medium or large size.
    • Perform logistic predictive modeling for prediction
    • Perform single-layer neural network (perceptron) model for prediction
    Due: 11:30 PM, Thursday, 11/12/2025