Concatenative synthesis
Concatenative synthesis is a technique for synthesising sounds by concatenating short samples of recorded sound (called units). The duration of the units is not strictly defined and may vary according to the implementation, roughly in the range of 10 milliseconds up to 1 second. It is used in speech synthesis and music sound synthesis to generate user-specified sequences of sound from a database (often called a corpus) built from recordings of other sequences.
In contrast to granular synthesis, concatenative synthesis is driven by an analysis of the source sound, in order to identify the units that best match the specified criterion.[1]
In speech
In music
Concatenative synthesis for music started to develop in the 2000s in particular through the work of Schwarz[2] and Pachet[3] (so-called musaicing). The basic techniques are similar to those for speech, although with differences due to the differing nature of speech and music: for example, the segmentation is not into phonetic units but often into subunits of musical notes or events.[1][2][4]
Zero Point, the first full-length album by Rob Clouth (Mesh 2020), features self-made concatenative synthesis software called the 'Reconstructor' which "chops sampled sounds into tiny pieces and rearranges them to replicate a target sound. This allowed Clouth to use and manipulate his own beatboxing, a technique used on 'Into' and 'The Vacuum State'."[5] Clouth's concatenative synthesis algorithm was adapted from 'Let It Bee — Towards NMF-Inspired Audio Mosaicing' by Jonathan Driedger, Thomas Prätzlich, and Meinard Müller.[6][7]
See also
References
- ↑ 1.0 1.1 Schwarz, D. (2005), "Current research in Concatenative Sound Synthesis", Proceedings of the International Computer Music Conference (ICMC), http://recherche.ircam.fr/equipes/analyse-synthese/schwarz/publications/icmc2005/Schwarz_ICMC2005_Current-Research.pdf
- ↑ 2.0 2.1 Schwarz, Diemo (2004-01-23), Data-Driven Concatenative Sound Synthesis, http://recherche.ircam.fr/equipes/analyse-synthese/schwarz/thesis/, retrieved 2010-01-15
- ↑ Zils, A.; Pachet, F. (2001), "Musical Mosaicing", Proceedings of the COST G-6 Conference on Digital Audio Effects (DaFx-01), University of Limerick: 39–44, http://www.csl.sony.fr/downloads/papers/2001/zils-dafx2001.pdf, retrieved 2011-04-27
- ↑ Maestre, E. and Ramírez, R. and Kersten, S. and Serra, X. (2009), "Expressive Concatenative Synthesis by Reusing Samples from Real Performance Recordings", Computer Music Journal 33 (4): 23–42, doi:10.1162/comj.2009.33.4.23
- ↑ "Zero Point, by Rob Clouth" (in en). https://robclouth.bandcamp.com/album/zero-point.
- ↑ (in en) Sónar+D CCCB 2020 Talk: "Journey to the Center of the Musical Brain", https://www.youtube.com/watch?v=O7IpRDuvZJQ, retrieved 2022-07-23
- ↑ "AudioLabs - Let it Bee - Towards NMF-inspired Audio Mosaicing". https://www.audiolabs-erlangen.de/resources/MIR/2015-ISMIR-LetItBee.
 |  |
