University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Potential biases in MUSHRA listening tests

Zielinski, S, Hardisty, P, Hummersone, C and Rumsey, F (2007) Potential biases in MUSHRA listening tests In: 123rd Audio Engineering Society Convention, 2007-10-05 - 2007-10-08, New York.

Available under License : See the attached licence file.

Download (242kB)
[img] Plain Text (licence)

Download (1kB)
Official URL:


The method described in the ITU-R BS.1534-1 standard, commonly known as MUSHRA (MUltiple Stimulus with Hidden Reference and Anchors), is widely used for the evaluation of systems exhibiting intermediate quality levels, in particular low-bit rate codecs. This paper demonstrates that this method, despite its popularity, is not immune to biases. In two different experiments designed to investigate potential biases in the MUSHRA test, systematic discrepancies in the results were observed with a magnitude up to 22%. The data indicates that these discrepancies could be attributed to the stimulus spacing and range equalizing biases.

Item Type: Conference or Workshop Item (Paper)
Divisions : Faculty of Arts and Human Sciences > School of Arts > Sound Recording
Authors :
Date : 5 October 2007
Contributors :
PublisherAudio Engineering Society, UNSPECIFIED
Related URLs :
Additional Information : The papers at this Convention have been selected on the basis of a submitted abstract and extended precis that have been peer reviewed by at least two qualified anonymous reviewers. This convention paper has been reproduced from the author's advance manuscript, without editing, corrections, or consideration by the Review Board. The AES takes no responsibility for the contents. Additional papers may be obtained by sending request and remittance to Audio Engineering Society, 60 East 42nd Street, New York, New York 10165-2520, USA; also see All rights reserved. Reproduction of this paper, or any portion thereof, is not permitted without direct permission from the Journal of the Audio Engineering Society.
Depositing User : Symplectic Elements
Date Deposited : 17 Apr 2012 15:37
Last Modified : 23 Sep 2013 18:45

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800