Title: "The PEASS Toolkit - Perceptual Evaluation methods for Audio
Source Separation"

Authors:
Valentin Emiya, Emmanuel Vincent, INRIA, Centre Inria Rennes - Bretagne
Atlantique, 35042 Rennes Cedex, France
Niklas Harlander, Volker Hohmann, Medizinische Physik, Carl von
Ossietzky-Universität Oldenburg, Oldenburg, Germany

Abstract:
We present the PEASS Toolkit designed for the perceptual evaluation of
audio source separation. It includes a MUSHRA-based listening-test
protocol adapted for the subjective evaluation of audio source
separation; a set of subjective measures - sounds and subjective scores
- obtained by applying the proposed test protocol; and a set of
auditory-motivated objective measures based on a new algorithm to
decompose the estimation error into some distortion components (target
distortion, interference, artefacts) and on integrating the outputs of
the auditory-based objective measure PEMO-Q. This presentation will be
the opportunity to detail the recent release of the PEASS toolkit, as
well as its use in the Signal Separation Evaluation Campaign (SiSEC) in
2010.

References:
V. Emiya, E. Vincent, N. Harlander, V. Hohmann, "Subjective and
objective quality assessment of audio source separation", IEEE
Transactions on Audio, Speech and Language Processing, submitted, 2010.
http://hal.archives-ouvertes.fr/inria-00485729/fr/.
V. Emiya, E. Vincent, N. Harlander, V. Hohmann, "Multi-criteria
subjective and objective evaluation of audio source separation", AES
38th International Conference on Sound Quality Evaluation, Pitea,
Sweden, June 13-15, 2010