Stratified breast cancer follow-up using a continuous state partially observable Markov decision process

Frequency and duration of follow-up for breast cancer patients is still under discussion. Currently, in the Netherlands follow-up consists of annual mammography for the first five years after treatment and does not depend on the personal risk of developing a locoregional recurrence or a second primary tumor. The aim of this study is to gain insight in how to allocate resources for optimal and personalized follow-up. We formulate a discrete-time Partially Observable Markov Decision Process (POMDP) over a finite horizon with both discrete and continuous states, in which the size of the tumor is modeled as a continuous state. Transition probabilities are obtained from data of the Netherlands Cancer Registry. We show that the optimal value function of the POMDP is piecewise linear and convex and provide an alternative representation for it. Under some reasonable conditions on the dynamics of the POMDP, the optimal value function can be obtained from the parameters of the underlying probability distributions only. Finally, we present results for a stratification of the patients based on their age to show how this model can be applied in practice.