### Abstract

Original language | English |
---|---|

Title of host publication | Markov Decision Processes in Practice |

Editors | Richard J. Boucherie, Nico M. van Dijk |

Place of Publication | Cham |

Publisher | Springer |

Pages | 293-317 |

Number of pages | 25 |

ISBN (Electronic) | 978-3-319-47766-4 |

ISBN (Print) | 978-3-319-47764-0 |

DOIs | |

Publication status | Published - 2017 |

### Publication series

Name | International Series in Operations Research |
---|---|

Publisher | Springer International Publishing |

Volume | 248 |

ISSN (Print) | 0884-8289 |

ISSN (Electronic) | 2214-7934 |

### Fingerprint

### Keywords

- non-stationary
- Finite horizon
- Perishable products
- EWI-27918
- Blood platelets
- Blood inventory management

### Cite this

*Markov Decision Processes in Practice*(pp. 293-317). (International Series in Operations Research; Vol. 248). Cham: Springer. https://doi.org/10.1007/978-3-319-47766-4_10

}

*Markov Decision Processes in Practice.*International Series in Operations Research, vol. 248, Springer, Cham, pp. 293-317. https://doi.org/10.1007/978-3-319-47766-4_10

**Blood platelet inventory management.** / Haijema, R.; van Dijk, N. M.; van der Wal, J.

Research output: Chapter in Book/Report/Conference proceeding › Chapter › Academic › peer-review

TY - CHAP

T1 - Blood platelet inventory management

AU - Haijema, R.

AU - van Dijk, N. M.

AU - van der Wal, J.

PY - 2017

Y1 - 2017

N2 - This paper illustrates how MDP or Stochastic Dynamic Programming (SDP) can be used in practice for blood management at blood banks; both to set regular production quantities for perishable blood products (platelets) and how to do so in irregular periods (as holidays). The state space is too large to solve most practical problems using SDP. Nevertheless an SDP approach is still argued and shown to be most useful in combination with simulation. First the recipe for the stationary case is briefly reviewed as referred to earlier research. Here the regular production problem is periodic: demand and supply are weekday dependent but across weeks the problem is usually regarded as stationary. However, during a number of periods per year (roughly monthly) the problem is complicated by holiday periods and other events that imply non-stationary demand and production processes. This chapter particularly focuses on how to deal with the Blood Platelet (PPP) problem in non-stationary periods caused by holidays. How should production quantities anticipate holidays and how should production resume after holidays. The problem will therefore also be modelled as a finite horizon problem. To value products left in stock at the end of the horizon we propose to use the relative state values of the original periodic SDP. An optimal policy is derived by SDP. The structure of optimal policies is investigated by simulation. Next to its stationary results, as reported before, the combination of SDP and simulation so becomes of even more practical value to blood bank managers. Results show how outdating or product waste of blood platelets can be reduced from over 15% to 1% or even less, while maintaining shortage at a very low level.

AB - This paper illustrates how MDP or Stochastic Dynamic Programming (SDP) can be used in practice for blood management at blood banks; both to set regular production quantities for perishable blood products (platelets) and how to do so in irregular periods (as holidays). The state space is too large to solve most practical problems using SDP. Nevertheless an SDP approach is still argued and shown to be most useful in combination with simulation. First the recipe for the stationary case is briefly reviewed as referred to earlier research. Here the regular production problem is periodic: demand and supply are weekday dependent but across weeks the problem is usually regarded as stationary. However, during a number of periods per year (roughly monthly) the problem is complicated by holiday periods and other events that imply non-stationary demand and production processes. This chapter particularly focuses on how to deal with the Blood Platelet (PPP) problem in non-stationary periods caused by holidays. How should production quantities anticipate holidays and how should production resume after holidays. The problem will therefore also be modelled as a finite horizon problem. To value products left in stock at the end of the horizon we propose to use the relative state values of the original periodic SDP. An optimal policy is derived by SDP. The structure of optimal policies is investigated by simulation. Next to its stationary results, as reported before, the combination of SDP and simulation so becomes of even more practical value to blood bank managers. Results show how outdating or product waste of blood platelets can be reduced from over 15% to 1% or even less, while maintaining shortage at a very low level.

KW - non-stationary

KW - Finite horizon

KW - Perishable products

KW - EWI-27918

KW - Blood platelets

KW - Blood inventory management

U2 - 10.1007/978-3-319-47766-4_10

DO - 10.1007/978-3-319-47766-4_10

M3 - Chapter

SN - 978-3-319-47764-0

T3 - International Series in Operations Research

SP - 293

EP - 317

BT - Markov Decision Processes in Practice

A2 - Boucherie, Richard J.

A2 - van Dijk, Nico M.

PB - Springer

CY - Cham

ER -