Replacement policy under partially observed Markov process

Research output: Contribution to journalArticlepeer-review

8 Scopus citations


This paper deals with a production system (machine) which deteriotes over time. The system deterioration over time is Markovian. The time scale is discrete and the 'true' state of the system (excellent, medium and bad) is not directly observable. What is observed is the performance of the system measured in terms of 'number of defectives' per time period. At the end of each period a decision is to be made: whether to replace the system or not. The objective is to minimize the total cost in the long run. Partially Observed Markovian Decision Process (POMDP) approach is used to solve this problem. Various methods to solve this problem are discussed and a simpler approximated solution is presented which utilizes some known properties of this problem.

Original languageEnglish
Pages (from-to)159-166
Number of pages8
JournalInternational Journal of Production Economics
Issue number2
StatePublished - 1 Jan 1993

ASJC Scopus subject areas

  • Business, Management and Accounting (all)
  • Economics and Econometrics
  • Management Science and Operations Research
  • Industrial and Manufacturing Engineering


Dive into the research topics of 'Replacement policy under partially observed Markov process'. Together they form a unique fingerprint.

Cite this