University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Approximate filtering of conditional intensity process for Poisson count data: Application to urban crime

Santitissadeekorn, Naratip, Lloyd, David J.B., Short, Martin B. and Delahaies, Sylvain (2020) Approximate filtering of conditional intensity process for Poisson count data: Application to urban crime Computational Statistics & Data Analysis, 144, 106850. pp. 1-14.

[img] Text
Approximate Filtering of conditional intensity process for Poisson count data.pdf - Accepted version Manuscript
Restricted to Repository staff only until 9 October 2020.

Download (12MB)


The primary focus is a sequential data assimilation method for count data modelled by an inhomogeneous Poisson process. In particular, a quadratic approximation technique similar to the extended Kalman filter is applied to develop a sub-optimal, discrete-time, filtering algorithm, called the extended Poisson-Kalman filter (ExPKF), where only the mean and covariance are sequentially updated using count data via the Poisson likelihood function. The performance of ExPKF is investigated in several synthetic experiments where the true solution is known. In numerical examples, ExPKF provides a good estimate of the “true” posterior mean, which can be well-approximated by the particle filter (PF) algorithm in the very large sample size limit. In addition, the experiments demonstrates that the ExPKF algorithm can be conveniently used to track parameter changes; on the other hand, a non-filtering framework such as a maximum likelihood estimation (MLE) would require a statistical test for change points or implement time-varying parameters. Finally, to demonstrate the model on real-world data, the ExPKF is used to approximate the uncertainty of urban crime intensity and parameters for self-exciting crime models. The Chicago Police Department’s CLEAR (Citizen Law Enforcement Analysis and Reporting) system data is used as a case study for both univariate and multivariate Hawkes models. An improved goodness of fit measured by the Kolomogrov-Smirnov (KS) statistics is achieved by the filtered intensity. The potential of using filtered intensity to improve police patrolling prioritisation is also tested. By comparing with the prioritisation based on MLE-derived intensity and historical frequency, the result suggests an insignificant difference between them. While the filter is developed and tested in the context of urban crime, it has the potential to make a contribution to data assimilation in other application areas.

Item Type: Article
Divisions : Faculty of Engineering and Physical Sciences > Mathematics
Authors :
Lloyd, David
Short, Martin B.
Date : April 2020
Funders : Engineering and Physical Sciences Research Council (EPSRC)
DOI : 10.1016/j.csda.2019.106850
Copyright Disclaimer : © 2019. This manuscript version is made available under the CC-BY-NC-ND 4.0 license
Uncontrolled Keywords : Point process; Count data; Filtering; Parameter estimation; Hawkes process; Crime data
Depositing User : Clive Harris
Date Deposited : 14 Oct 2019 15:27
Last Modified : 31 Oct 2019 15:44

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800