Sound decomposition

[yamamoto2002]

I imagined the technology from only the phrase "sound decomposition"

as some conversion from string quartet or four part choir sound to four sheets of part score and automatic musical analysis of composition, detect themes and their developments with counter point with analysis of chord progression 

 

Where is the original paper

[yamamoto2002]

this is the link of the preprint paper

https://arxiv.org/abs/2210.14041

[yamamoto2002]

Actual decomposed sound files are on "Listening test sounds" : http://research.spa.aalto.fi/publications/papers/jaes-stn/main.htm

 

it seems original Orig.wav files are decomposed onto 3 wav files: S.wav, T.wav, N.wav

• Melody instruments are stored on S file but its attack part is lost and sound lacks punch
• Snare drum strikes are stored on T file, some older algorithms stores only its beats
• Cymbals and snare wire sounds are stored N files

 

They use STFT, some variant of Fourier transform to perform this separation task and the approach is analytic and practical

[yamamoto2002]

1 hour ago, Jud said:

So all in all, it sounds like a nice approach (though I don't know how these filtering results interfere/intermodulate with each other when combined)),

I experimented it. Add up S+T+N to create mix.wav then orig.wav - mix.wav to create diff.wav. And found diff.wav is silence, only the very last part has error (perhaps implementation bug of overlap-add or fade-out applied)

 

[yamamoto2002]

24 minutes ago, Jud said:

 

Do you use Audirvana and/or HQPlayer? I'd be curious how some of their filters and modulators at DSD256 or DSD512 (with volume equalized) would compare to the Redbook orig.wav.

Unfortunately no. The experiment above is done with Audacity (free software) :

 

• Select tracks of S.wav T.wav and N.wav and Tracks →  Mix → “Mix and render to new track” to create mix.wav
• Select mix.wav and Effect → invert for polarity inversion (to calculate orig.wav minus mix.wav)
• Select orig.wav and mix.wav, then Tracks →  Mix → “Mix and render to new track” to create diff.wav