A useful technique for piecewise deterministic Markov decision processes

Xin Guo; Yi Zhang

doi:10.1016/j.orl.2020.11.002

A useful technique for piecewise deterministic Markov decision processes

Xin Guo, Yi Zhang

Mathematics

Research output: Contribution to journal › Article › peer-review

13 Downloads (Pure)

Abstract

This note presents a technique that is useful for the study of piecewise deterministic Markov decision processes (PDMDPs) with general policies and unbounded transition intensities. This technique produces an auxiliary PDMDP from the original one. The auxiliary PDMDP possesses certain desired properties, which may not be possessed by the original PDMDP. We apply this technique to risk-sensitive PDMDPs with total cost criteria, and comment on its connection with the uniformization technique.

Original language	English
Pages (from-to)	55-61
Number of pages	7
Journal	Operations Research Letters
Volume	49
Issue number	1
Early online date	9 Nov 2020
DOIs	https://doi.org/10.1016/j.orl.2020.11.002
Publication status	Published - Jan 2021

Keywords

Continuous-time Markov decision processes
Piecewise deterministic Markov decision processes
Unbounded transition intensities

ASJC Scopus subject areas

Software
Management Science and Operations Research
Industrial and Manufacturing Engineering
Applied Mathematics

Access to Document

10.1016/j.orl.2020.11.002Licence: None: All rights reserved

GuoX2020usefulAccepted author manuscript, 308 KBLicence: Creative Commons: Attribution-NonCommercial-NoDerivs (CC BY-NC-ND)

Cite this

@article{133cc8f6c11a49dc9b03defafcf501b2,

title = "A useful technique for piecewise deterministic Markov decision processes",

abstract = "This note presents a technique that is useful for the study of piecewise deterministic Markov decision processes (PDMDPs) with general policies and unbounded transition intensities. This technique produces an auxiliary PDMDP from the original one. The auxiliary PDMDP possesses certain desired properties, which may not be possessed by the original PDMDP. We apply this technique to risk-sensitive PDMDPs with total cost criteria, and comment on its connection with the uniformization technique.",

keywords = "Continuous-time Markov decision processes, Piecewise deterministic Markov decision processes, Unbounded transition intensities",

author = "Xin Guo and Yi Zhang",

year = "2021",

month = jan,

doi = "10.1016/j.orl.2020.11.002",

language = "English",

volume = "49",

pages = "55--61",

journal = "Operations Research Letters",

issn = "0167-6377",

publisher = "Elsevier",

number = "1",

}

TY - JOUR

T1 - A useful technique for piecewise deterministic Markov decision processes

AU - Guo, Xin

AU - Zhang, Yi

PY - 2021/1

Y1 - 2021/1

N2 - This note presents a technique that is useful for the study of piecewise deterministic Markov decision processes (PDMDPs) with general policies and unbounded transition intensities. This technique produces an auxiliary PDMDP from the original one. The auxiliary PDMDP possesses certain desired properties, which may not be possessed by the original PDMDP. We apply this technique to risk-sensitive PDMDPs with total cost criteria, and comment on its connection with the uniformization technique.

AB - This note presents a technique that is useful for the study of piecewise deterministic Markov decision processes (PDMDPs) with general policies and unbounded transition intensities. This technique produces an auxiliary PDMDP from the original one. The auxiliary PDMDP possesses certain desired properties, which may not be possessed by the original PDMDP. We apply this technique to risk-sensitive PDMDPs with total cost criteria, and comment on its connection with the uniformization technique.

KW - Continuous-time Markov decision processes

KW - Piecewise deterministic Markov decision processes

KW - Unbounded transition intensities

UR - http://www.scopus.com/inward/record.url?scp=85096645245&partnerID=8YFLogxK

U2 - 10.1016/j.orl.2020.11.002

DO - 10.1016/j.orl.2020.11.002

M3 - Article

AN - SCOPUS:85096645245

SN - 0167-6377

VL - 49

SP - 55

EP - 61

JO - Operations Research Letters

JF - Operations Research Letters

IS - 1

ER -

A useful technique for piecewise deterministic Markov decision processes

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Fingerprint

Cite this