University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Information Theory and Medical Decision Making

Krause, Paul (2020) Information Theory and Medical Decision Making In: Volume 263: Applied Interdisciplinary Theory in Health Informatics. IOS Press, pp. 23-34.

[img] Text
SHTI-263-SHTI190108.pdf - Version of Record
Restricted to Repository staff only

Download (320kB)


Information theory has gained application in a wide range of disciplines, including statistical inference, natural language processing, cryptography and molecular biology. However, its usage is less pronounced in medical science. In this chapter, we illustrate a number of approaches that have been taken to applying concepts from information theory to enhance medical decision making. We start with an introduction to information theory itself, and the foundational concepts of information content and entropy. We then illustrate how relative entropy can be used to identify the most informative test at a particular stage in a diagnosis. In the case of a binary outcome from a test, Shannon entropy can be used to identify the range of values of test results over which that test provides useful information about the patient’s state. This, of course, is not the only method that is available, but it can provide an easily interpretable visualization. The chapter then moves on to introduce the more advanced concepts of conditional entropy and mutual information and shows how these can be used to prioritise and identify redundancies in clinical tests. Finally, we discuss the experience gained so far and conclude that there is value in providing an informed foundation for the broad application of information theory to medical decision making.

Item Type: Book Section
Divisions : Faculty of Engineering and Physical Sciences > Computer Science
Authors :
Editors :
Scott, Phillip
de Keizer, Nicolette
Georgiou, Andrew
Date : 7 January 2020
DOI : 10.3233/SHTI190108
OA Location :
Copyright Disclaimer : IOS Press Copyright 2018
Uncontrolled Keywords : Shannon entropy; Relative entropy; Conditional entropy; Mutual information; Medical diagnosis
Depositing User : James Marshall
Date Deposited : 28 Jan 2020 11:06
Last Modified : 05 Feb 2020 11:06

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800