University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Sequential data assimilation for 1D self-exciting processes with application to urban crime data

Santitissadeekorn, Naratip, Short, M and Lloyd, David (2018) Sequential data assimilation for 1D self-exciting processes with application to urban crime data Computational Statistics and Data Analysis, 128. pp. 163-183.

CSDA_submitted.pdf - Accepted version Manuscript
Available under License Creative Commons Attribution Non-commercial No Derivatives.

Download (5MB) | Preview


A number of models – such as the Hawkes process and log Gaussian Cox process – have been used to understand how crime rates evolve in time and/or space. Within the context of these models and actual crime data, parameters are often estimated using maximum likelihood estimation (MLE) on batch data, but this approach has several limitations such as limited tracking in real-time and uncertainty quantification. For practical purposes, it would be desirable to move beyond batch data estimation to sequential data assimilation. A novel and general Bayesian sequential data assimilation algorithm is developed for joint state-parameter estimation for an inhomogeneous Poisson process by deriving an approximating Poisson-Gamma ‘Kalman’ filter that allows for uncertainty quantification. The ensemble-based implementation of the filter is developed in a similar approach to the ensemble Kalman filter, making the filter applicable to large-scale real world applications unlike nonlinear filters such as the particle filter. The filter has the advantage that it is independent of the underlying model for the process intensity, and can therefore be used for many different crime models, as well as other application domains. The performance of the filter is demonstrated on synthetic data and real Los Angeles gang crime data and compared against a very large sample-size particle filter, showing its effectiveness in practice. In addition the forecast skill of the Hawkes model is investigated for a forecast system using the Receiver Operating Characteristic (ROC) to provide a useful indicator for when predictive policing software for a crime type is likely to be useful. The ROC and Brier scores are used to compare and analyse the forecast skill of sequential data assimilation and MLE. It is found that sequential data assimilation produces improved probabilistic forecasts over the MLE.

Item Type: Article
Divisions : Faculty of Engineering and Physical Sciences > Mathematics
Authors :
Short, M
Date : 19 July 2018
Funders : EPSRC
DOI : 10.1016/j.csda.2018.06.014
Copyright Disclaimer : © 2018. This manuscript version is made available under the CC-BY-NC-ND 4.0 license
Uncontrolled Keywords : Nonlinear filtering, Hawkes Process, joint state-parameter estimation, count data, particle filtering, ensemble Kalman filter
Depositing User : Melanie Hughes
Date Deposited : 28 Jun 2018 13:15
Last Modified : 19 Jul 2019 02:08

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800