Understanding overfitting and underfitting is essential for evaluating machine learning models. These concepts help determine how well a model generalizes to unseen data. Calculating relevant metrics provides insights into model performance and guides improvements.

Overfitting Metrics

Overfitting occurs when a model performs well on training data but poorly on new data. Common metrics to detect overfitting include:

  • Training vs. Validation Error: A large gap indicates overfitting.
  • Complexity Measures: Such as the number of parameters relative to data points.
  • Cross-Validation Scores: Significantly higher training scores compared to validation scores suggest overfitting.

Underfitting Metrics

Underfitting happens when a model is too simple to capture the underlying data patterns. Metrics indicating underfitting include:

  • High Error on Both Training and Validation Sets: Indicates the model is too simplistic.
  • Low Model Complexity: Such as very few features or parameters.
  • Consistent Poor Performance: Across training and validation data.

Calculating Metrics

Common metrics used include accuracy, precision, recall, and F1 score. To evaluate overfitting or underfitting, compare these metrics across training and validation datasets. A significant discrepancy suggests overfitting, while uniformly low scores indicate underfitting.

Using cross-validation helps in assessing model stability. Calculating the average performance across multiple folds provides a more reliable estimate of how the model will perform on unseen data.