Informace o publikaci

Evaluating the Impact of Data Augmentation on Predictive Model Performance

Autoři

ŠVÁBENSKÝ Valdemar BORCHERS Conrad CLOUDE Elizabeth B. SHIMADA Atsushi

Rok publikování 2025
Druh Článek ve sborníku
Konference Proceedings of the 15th Learning Analytics and Knowledge Conference (LAK '25) [to appear]
Citace
www ArXiv.org preprint
Doi http://dx.doi.org/10.1145/3706468.3706485
Klíčová slova learning analytics; prediction; supervised learning; data generation; synthetic data; replication
Popis In supervised machine learning (SML) research, large training datasets are essential for valid results. However, obtaining primary data in learning analytics (LA) is challenging. Data augmentation can address this by expanding and diversifying data, though its use in LA remains underexplored. This paper systematically compares data augmentation techniques and their impact on prediction performance in a typical LA task: prediction of academic outcomes. Augmentation is demonstrated on four SML models, which we successfully replicated from a previous LAK study based on AUC values. Among 21 augmentation techniques, SMOTE-ENN sampling performed the best, improving the average AUC by 0.01 and approximately halving the training time compared to the baseline models. In addition, we compared 99 combinations of chaining 21 techniques, and found minor, although statistically significant, improvements across models when adding noise to SMOTE-ENN (+0.014). Notably, some augmentation techniques significantly lowered predictive performance or increased performance fluctuation related to random chance. This paper's contribution is twofold. Primarily, our empirical findings show that sampling techniques provide the most statistically reliable performance improvements for LA applications of SML, and are computationally more efficient than deep generation methods with complex hyperparameter settings. Second, the LA community may benefit from validating a recent study through independent replication.

Používáte starou verzi internetového prohlížeče. Doporučujeme aktualizovat Váš prohlížeč na nejnovější verzi.

Další info