10. Exploring Commonly Used Supervised Learning Algorithms

Topics, Class Notes and Code Assignments and Side Readings
  • Bootstrap Methods
    • Bootstrap Algorithm
    • Bootstrap Applications
    • Bootstrap confidence intervals for AUC
  • Supervised Ensemble Algorithms
    • Issues of underfitting and overfitting
    • Concept of ensemble learning algorithms
    • Bootstrap aggregation - BAGGING
    • Boosting ideas
  • Notes and code
  • Optional Reading Assignments
  • Project Two: Supervised Learning Algorithms: Guidelines [HTML] [PDF]
    Part III - BAGGING Algorithm
    • Use the same data set you used last two week to implement the BAGGING algorithm.
    • Use ROC analysis to choose the best one from logistic, Percetron, decision tree, and BAGGING algorithms.
    • Finalize the report for submission.
    Due: 11:30 PM, Wednesday, 11/12/2025