Finite horizon decision timing with partially observable Poisson processes

Ludkovski, Michael and Sezer, Semih Onur (2012) Finite horizon decision timing with partially observable Poisson processes. Stochastic Models, 28 (2). pp. 207-247. ISSN 1532-6349

This is the latest version of this item.

Full text not available from this repository. (Request a copy)

Abstract

We study decision timing problems on finite horizon with Poissonian information arrivals. In our model, a decision maker wishes to optimally time her action in order to maximize her expected reward. The reward depends on an unobservable Markovian environment, and information about the environment is collected through a (compound) Poisson observation process. Examples of such systems arise in investment timing, reliability theory, Bayesian regime detection and technology adoption models. We solve the problem by studying an optimal stopping problem for a piecewise-deterministic process, which gives the posterior likelihoods of the unobservable environment. Our method lends itself to simple numerical implementation and we present several illustrative numerical examples.
Item Type: Article
Uncontrolled Keywords: Bayesian sequential analysis; Decision making; Markov modulated Poisson processes; Optimal stopping
Subjects: Q Science > QA Mathematics > QA273-280 Probabilities. Mathematical statistics
Divisions: Faculty of Engineering and Natural Sciences > Basic Sciences > Mathematics
Faculty of Engineering and Natural Sciences > Academic programs > Manufacturing Systems Eng.
Faculty of Engineering and Natural Sciences
Depositing User: Semih Onur Sezer
Date Deposited: 28 May 2012 14:52
Last Modified: 31 Jul 2019 10:59
URI: https://research.sabanciuniv.edu/id/eprint/19067

Available Versions of this Item

Actions (login required)

View Item
View Item