Improving Model Fairness with Time-Augmented Bayesian Knowledge Tracing

Jake Barrett, Alasdair Day, Kobi Gal

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

Modelling student performance is an increasingly popular goal in the learning analytics community. A common method for this task is Bayesian Knowledge Tracing (BKT), which predicts student performance and topic mastery using the student's answer history. While BKT has strong qualities and good empirical performance, like many machine learning approaches it can be prone to bias. In this study we demonstrate an inherent bias in BKT with respect to students' income support levels and gender, using publicly available data. We find that this bias is likely a result of the model's 'slip' parameter disregarding answer speed when deciding if a student has lost mastery status. We propose a new BKT model variation that directly considers answer speed, resulting in a significant fairness increase without sacrificing model performance. We discuss the role of answer speed as a potential cause of BKT model bias, as well as a method to minimise bias in future implementations.

Original languageEnglish
Title of host publicationLAK 2024 Conference Proceedings - 14th International Conference on Learning Analytics and Knowledge
PublisherAssociation for Computing Machinery
Pages46-54
Number of pages9
ISBN (Electronic)9798400716188
DOIs
StatePublished - 18 Mar 2024
Event14th International Conference on Learning Analytics and Knowledge, LAK 2024 - Kyoto, Japan
Duration: 18 Mar 202422 Mar 2024

Publication series

NameACM International Conference Proceeding Series

Conference

Conference14th International Conference on Learning Analytics and Knowledge, LAK 2024
Country/TerritoryJapan
CityKyoto
Period18/03/2422/03/24

Keywords

  • fairness
  • knowledge tracing

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Fingerprint

Dive into the research topics of 'Improving Model Fairness with Time-Augmented Bayesian Knowledge Tracing'. Together they form a unique fingerprint.

Cite this