TY - GEN
T1 - Improving Model Fairness with Time-Augmented Bayesian Knowledge Tracing
AU - Barrett, Jake
AU - Day, Alasdair
AU - Gal, Kobi
N1 - Publisher Copyright:
© 2024 ACM.
PY - 2024/3/18
Y1 - 2024/3/18
N2 - Modelling student performance is an increasingly popular goal in the learning analytics community. A common method for this task is Bayesian Knowledge Tracing (BKT), which predicts student performance and topic mastery using the student's answer history. While BKT has strong qualities and good empirical performance, like many machine learning approaches it can be prone to bias. In this study we demonstrate an inherent bias in BKT with respect to students' income support levels and gender, using publicly available data. We find that this bias is likely a result of the model's 'slip' parameter disregarding answer speed when deciding if a student has lost mastery status. We propose a new BKT model variation that directly considers answer speed, resulting in a significant fairness increase without sacrificing model performance. We discuss the role of answer speed as a potential cause of BKT model bias, as well as a method to minimise bias in future implementations.
AB - Modelling student performance is an increasingly popular goal in the learning analytics community. A common method for this task is Bayesian Knowledge Tracing (BKT), which predicts student performance and topic mastery using the student's answer history. While BKT has strong qualities and good empirical performance, like many machine learning approaches it can be prone to bias. In this study we demonstrate an inherent bias in BKT with respect to students' income support levels and gender, using publicly available data. We find that this bias is likely a result of the model's 'slip' parameter disregarding answer speed when deciding if a student has lost mastery status. We propose a new BKT model variation that directly considers answer speed, resulting in a significant fairness increase without sacrificing model performance. We discuss the role of answer speed as a potential cause of BKT model bias, as well as a method to minimise bias in future implementations.
KW - fairness
KW - knowledge tracing
UR - http://www.scopus.com/inward/record.url?scp=85187548652&partnerID=8YFLogxK
U2 - 10.1145/3636555.3636849
DO - 10.1145/3636555.3636849
M3 - Conference contribution
AN - SCOPUS:85187548652
T3 - ACM International Conference Proceeding Series
SP - 46
EP - 54
BT - LAK 2024 Conference Proceedings - 14th International Conference on Learning Analytics and Knowledge
PB - Association for Computing Machinery
T2 - 14th International Conference on Learning Analytics and Knowledge, LAK 2024
Y2 - 18 March 2024 through 22 March 2024
ER -