Analysis and Re-Synthesis of Natural Sound of the Clarinet using Principal Component Analysis


    The representation of the sound of an acoustic musical instrument involves problems of great complexity, among them the mapping of the spectral characteristics of the great variety of sounds this instrument can produce. In this study, different notes in several intensity levels were performed on the clarinet, covering the whole extension of the instrument. Discreet Fourier Transform was used to measure the amplitude and frequency time-varying curves of the partials of these sampled sounds. Using techniques such as Principal Component Analysis (PCA) and spectral matching with Genetic Algorithms, a limited set of orthogonal spectral basis was extracted from these parameters. These bases defined spectral sub-spaces, which were capable to represent the all tested sounds, as well as to group the sounds in contiguous sets of notes of similar timbre characteristics. Clustering and classification was further employed with K-means and Self-Organized Maps (SOM). A re-synthesis tool was also developed to allow validation of these models for timbre representation.



Part 1 : Expressive Content and PCA

    Describes the construction of PCA spaces to compare notes in a musical context.
    Go to the project page.
Part 2 : The PCA timbre sub-space

    Describes the construction of timbre sub-spaces using PCA to analyze the timbre pallete of an instrument. At first, a single note performed in several levels of intensity was analyzed. Then, several notes were concatenated and a timbre sub-space was created. Auditory tests validated the construction of these spaces.
    Go to the project page.
Part 3 : Timbre-space construction by Spectral Matching with Genetic Algorithms

    Describes the construction of timbre sub-spaces using Genetic Algorithms to perform spectral matching. The performance of this new representation is compared to PCA. .
    Go to the project page.
Part 4 : K-means for timbre classification

     . .
    Go to the project page.
Part 5 : Self-organized maps for timbre classification

     . .
    Go to the project page.
Download : The Timbre Toolbox

    The following toolbox was created to perform the analises described above. It was designed for use in Matlab with the statistics toolbox.
    Download the timbreToolbox.zip.

Copyright © 2004 CEFALA/UFMG
Contact the webmaster for website update requests.