cvssp / perceptual-study-source-separation Goto Github PK
View Code? Open in Web Editor NEWRepository for subjective and objective evaluation of source separation algorithms
Home Page: https://cvssp.github.io/perceptual-study-source-separation/
Repository for subjective and objective evaluation of source separation algorithms
Home Page: https://cvssp.github.io/perceptual-study-source-separation/
Hi Dom,
On this updated site https://cvssp.github.io/perceptual-study-source-separation/
I can't play any of the samples under the "Short examples" section.
And when I click "Switch to the main interface" and "move" to this page
https://cvssp.github.io/perceptual-study-source-separation/mini_quality/
the sound plays fine, but when I just use the mini_quality page address and paste it directly on a new browser (so, not via the first welcome page but directly), again I can't play any sample.
I was trying to jump directly to the main interface from my presentation slide using the url so that I could play an example - that's how I found this out. Could you possibly have a look into this? Thanks.
This is something that came up during the experiment.
In general, for task 1, we wanted listeners to rate the overall sound quality of the test sound. That is, even if the separated singing voice (which was the target source for all of the separation algorithms) sounded identical to the reference singing voice, one should also consider the quality of the other instruments in addition to general additive distortions. In this respect, the original mixture should be rated of the highest quality because there are no distortions due to source separation processing.
Two listeners reported that they specifically focused on the singing-voice (vocals) and ignored everything else. They were, however, kind enough to repeat the experiment after clarification.
There are a few ways to overcome this (for next time!):
Emphasise with more sound examples at the familiarisation stage, e.g. reference vocals + highly distorted accompaniment = reduced sound quality. The purpose of the first example was to emphasise that the original mixture should be rated the same as the vocals (because there are no distortions or artefacts), but without further examples, the wording could suggest that one should ignore the accompaniment in their judgement of sound quality, which was not our intent.
Include the original mixture as a second reference, as done in the original PEASS paper.
State that this distortions to the accompaniment should also be considered.
Change wording to overall sound quality, but of course one needs to make it clear that we are referring to the effect of processing artefacts (so relative to the original), rather than 'absolute quality'.
Perhaps the target source isn't actually needed as a reference for this question, the mixture alone should suffice.
There is also nothing wrong with asking for the quality of the singing voice alone (similar to the target preservation task in the PEASS study), but we wanted something more general that was simple for listeners to grasp, without having to conduct further tasks targetting difficult perceptual scales that require extensive training.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.