Research Article
Learning Path Generation of ITS Using Markov Decision Process
Song-Hwan Kwon*
,
Jong-Nam Rim,
Chung-Song Ko,
Un-Song Ryu,
Yong-Jin Pak,
Hyon-Il Son
Issue:
Volume 14, Issue 1, February 2026
Pages:
1-13
Received:
27 October 2025
Accepted:
17 November 2025
Published:
30 January 2026
DOI:
10.11648/j.sr.20261401.11
Downloads:
Views:
Abstract: Probabilistic and stochastic models such as Bayesian and Hidden Markov models can cope well with system uncertainties, but there is a problem of how learning state prediction and learning path generation are performed independently and how to connect them, and the overall effect of the system may be lost even after the connection. Using a Markov Decision Process, a kind of reinforcement learning model, not only can the prediction of the learning state of a student and the generation of a path be implemented simultaneously in a single model, but also the overall error can be reduced. In this paper, we propose to build an intelligent tutoring system into a Markov Decision Process model, an reinforcement learning model, with the aim of reducing learning path generation error and improving system performance by using Markov decision Process model in intelligent tutoring system. In addition, we propose a learning state evaluation method using a Markov Decision Process model to simultaneously proceed the student’s learning state estimation and the system’s action selection. We also propose a method to apply the value-iteration algorithm to action selection computation in a Markov Decision Process model. Comparison with previous models was carried out and its effectiveness was verified.
Abstract: Probabilistic and stochastic models such as Bayesian and Hidden Markov models can cope well with system uncertainties, but there is a problem of how learning state prediction and learning path generation are performed independently and how to connect them, and the overall effect of the system may be lost even after the connection. Using a Markov De...
Show More
