View source for Physics:Auditory scene analysis

[[File:Albert S. Bregman.JPG|thumb|Albert Bregman, 2011]]
In [[Perception|perception]] and [[Physics:Psychophysics|psychophysics]], '''auditory scene analysis''' ('''ASA''') is a proposed model for the basis of auditory perception. This is understood as the process by which the human auditory system organizes sound into perceptually meaningful elements. The term was coined by psychologist Albert Bregman.<ref name="bregman90">{{cite book |author=Bregman, A. S. |date=1990 |title=Auditory scene analysis: The Perceptual Organization of Sound |publisher=MIT Press |location=Cambridge, MA |isbn=9780262022972}}</ref>  The related concept in [[Machine perception|machine perception]] is [[Computational auditory scene analysis|computational auditory scene analysis]] (CASA), which is closely related to [[Signal separation|source separation]] and [[Blind signal separation|blind signal separation]].

The three key aspects of Bregman's ASA model are: segmentation, integration, and segregation.

==Background==

Sound reaches the ear and the eardrum vibrates as a whole. This signal has to be analyzed (in some way). Bregman's ASA model proposes that sounds will either be heard as "integrated" (heard as a whole – much like harmony in music), or "segregated" into individual components (which leads to counterpoint).<ref>{{cite journal |last1=Wright |first1=James and Albert S. Bregman |title=Auditory Stream Segregation and the Control of Dissonance in Polyphonic Music. |journal=Contemporary Music Review |date=1987 |volume=2 |issue=1 |page=63-92}}</ref> For example, a bell can be heard as a 'single' sound (integrated), or some people are able to hear the individual components – they are able to segregate the sound. This can be done with chords where it can be heard as a 'color', or as the individual notes. Natural [[Physics:Sound|sound]]s, such as the human voice, [[Musical tone|musical instruments]], or cars passing in the street, are made up of many frequencies, which contribute to the perceived quality (like timbre) of the sounds. When two or more natural sounds occur at once, all the components of the simultaneously active sounds are received at the same time, or overlapped in time, by the ears of listeners. This presents their auditory systems with a problem: which parts of the sound should be grouped together and treated as parts of the same source or object? Grouping them incorrectly can cause the listener to hear non-existent sounds built from the wrong combinations of the original components.

In many circumstances the segregated elements can be linked together in time, producing an auditory stream. This ability of auditory streaming can be demonstrated by the so-called [[Physics:Cocktail party effect|cocktail party effect]]. Up to a point, with a number of voices speaking at the same time or with background sounds, one is able to follow a particular voice even though other voices and background sounds are present.<ref>{{cite journal|last1=Miller|first1=G. A.|title=The masking of speech.|journal=Psychological Bulletin|date=1947|volume=44|issue=2|pages=105–129|doi=10.1037/h0055960|pmid=20288932}}</ref> In this example, the ear is segregating this voice from other sounds (which are integrated), and the mind "streams" these segregated sounds into an auditory stream. This is a skill which is highly developed by musicians, notably conductors who are able to listen to one, two, three or more instruments at the same time (segregating them), and following each as an independent line through auditory streaming{{Citation needed|date=March 2018}}.

==Grouping and streams==

A number of grouping principles appear to underlie ASA, many of which are related to principles of perceptual organization discovered by the school of [[Philosophy:Gestalt psychology|Gestalt psychology]]. These can be broadly categorized into '''sequential grouping''' mechanisms (those that operate across time) and '''simultaneous grouping''' mechanisms (those that operate across frequency):

* Errors in simultaneous grouping can lead to the blending of sounds that should be heard as separate, the blended sounds having different perceived qualities (such as pitch or timbre) to any of the sounds actually received. For instance two vowels presented simultaneously may not be identifiable if they are segregated.<ref>{{cite journal|last1=Assmann|first1=P. F.|last2=Summerfield|first2=Q.|title=Modeling the perception of concurrent vowels: Vowels with different fundamental frequencies|journal=The Journal of the Acoustical Society of America|date=August 1990|volume=88|issue=2|pages=680–697|doi=10.1121/1.399772|pmid=2212292|bibcode=1990ASAJ...88..680A}}</ref>
* Errors in sequential grouping can lead, for example, to hearing a word created out of syllables originating from two different voices.<ref>{{cite journal|last1=Gaudrain|first1=E.|last2=Grimault|first2=N.|last3=Healy|first3=E. W.|last4=Béra|first4=J.-C.|title=Effect of spectral smearing on the perceptual segregation of vowel sequences|journal=Hearing Research|date=2007|volume=231|issue=1–2|pages=32–41|doi=10.1016/j.heares.2007.05.001|pmid=17597319|pmc=2128787}}</ref><ref>{{cite journal|last1=Billig|first1=A. J.|last2=Davis|first2=M. H.|last3=Deeks|first3=J. M.|last4=Monstrey|first4=J.|last5=Carlyon|first5=R. P.|title=Lexical Influences on Auditory Streaming|journal=Current Biology|date=2013|volume=23|issue=16|pages=1585–1589|doi=10.1016/j.cub.2013.06.042|pmid=23891107|pmc=3748342}}</ref>

Segregation can be based primarily on perceptual cues or rely on the recognition of learned patterns ("schema-based").

The job of ASA is to group incoming sensory information to form an accurate mental representation of the individual sounds. When sounds are grouped by the auditory system into a perceived sequence, distinct from other co-occurring sequences, each of these perceived sequences is called an "auditory stream". In the real world, if the ASA is successful, a stream corresponds to a distinct environmental sound source producing a pattern that persists over time, such as a person talking, a piano playing, or a dog barking. However, in the lab, by manipulating the acoustic parameters of the sounds, it is possible to induce the perception of one or more auditory streams.

[[File:Streaming in Auditory Scene Analysis.gif|thumb|Streaming in Auditory Scene Analysis]]

One example of this is the phenomenon of streaming, also called "stream segregation."<ref>{{cite thesis|type=PhD|last=van Noorden|first=L. P. A. S.|title=Temporal coherence in the perception of tones sequences|date=1975|publisher=Eindhoven University of Technology|place=The Netherlands|url=http://alexandria.tue.nl/extra1/PRF2A/7707058.pdf|accessdate=10 March 2018}}</ref> If two sounds, A and B, are rapidly alternated in time, after a few seconds the perception may seem to "split" so that the listener hears two rather than one stream of sound, each stream corresponding to the repetitions of one of the two sounds, for example, A-A-A-A-, etc. accompanied by B-B-B-B-, etc. The tendency towards segregation into separate streams is favored  by differences in the acoustical properties of sounds A and B. Among the differences classically shown to promote segregation are those of frequency (for [[Physics:Pure tone|pure tone]]s), fundamental frequency (for [[Musical tone|complex tone]]s), frequency composition, source location. But it has been suggested that about any systematic perceptual difference between two sequences can elicit streaming,<ref>{{cite journal|last1=Moore|first1=B. C. J.|last2=Gockel|first2=H. E.|title=Properties of auditory stream formation|journal=Philosophical Transactions of the Royal Society B: Biological Sciences|date=2012|volume=367|issue=1591|pages=919–931|doi=10.1098/rstb.2011.0355|pmid=22371614|pmc=3282308}}</ref> provided the speed of the sequence is sufficient.

An interactive web page illustrating this streaming and the importance of frequency separation and speed [http://auditoryneuroscience.com/?q=topics/streaming-galloping-rhythm-paradigm can be found here.]

[[Biography:Andranik Tangian|Andranik Tangian]] argues that the grouping phenomenon is observed not only in dynamics but in statics as well. For instance, the sensation of a chord is the effect of acoustical data representation rather than physical causality (indeed, a single physical body, like a loudspeaker membrane, can produce an effect of several tones, and several physical bodies, like organ pipes tuned as a chord, can produce an effect of a single tone). From the viewpoint of [[Physics:Musical acoustics|musical acoustics]], a chord is a special kind of sound whose [[Spectrum|spectrum]] — the set of partial tones (sinusoidal oscillations) — can be regarded as generated by displacements of a single tone spectrum along the frequency axis. In other words, the chord's interval structure is an acoustical contour drawn by a tone (in dynamics, polyphonic voices are trajectories of tone spectra). This is justified by the information theory. If the generative tone is harmonic (= has a pitch salience) then such a representation is proved to be unique and requires the least amount of memory, i.e. is the least complex in the sense of Kolmogorov. Since it is simpler all other representations, including the one where the chord is regarded as a single complex sound, the chord is perceived as a compound. If the generative tone is inharmonic, like a bell-like sound, the interval structure is still recognizable as displacements of a tone spectrum, whose pitch can be even undetectable. This optimal representation-based definition of a chord explains, among other things, the predominance of interval hearing over the absolute pitch hearing.<ref name="Tanguiane1993">{{Cite book|last=Tanguiane (Tangian) |first=Andranick |date=1993|title= Artificial Perception and Music Recognition|series= Lecture Notes in Artificial Intelligence|volume=746|publisher=Springer |location=Berlin-Heidelberg|isbn=978-3-540-57394-4}}</ref><ref name="Tangian1994">{{Cite journal |last=Tanguiane (Tanguiane)|first=Andranick  |year=1994|title= A principle of correlativity of perception and its application to music recognition|journal=  Music Perception|volume=11 |issue=4 |pages=465–502|doi= 10.2307/40285634 }}</ref>

==Experimental basis==

Many experiments have studied the segregation of more complex patterns of sound, such as a sequence of high notes of different pitches, interleaved with low ones.  In such sequences, the segregation of co-occurring sounds into distinct streams has a profound effect on the way they are heard. Perception of a melody is formed more easily if all its notes fall in the same auditory stream.  We tend to hear the rhythms among notes that are in the same stream, excluding those that are in other streams.  Judgments of timing are more precise between notes in the same stream than between notes in separate streams.  Even perceived spatial location and perceived loudness can be affected by sequential grouping. While the initial research on this topic was done on human adults, recent studies have shown that some ASA capabilities are present in newborn infants, showing that they are built-in, rather than learned through experience.  Other research has shown that non-human animals also display ASA.  Currently, scientists are studying the activity of neurons in the auditory regions of the cerebral cortex to discover the mechanisms underlying ASA.

== See also ==

* Illusory discontinuity
* Phonemic restoration effect
* [[Theory of indispensable attributes]]

==References==
{{reflist}}

[[Category:Sound]]

{{Sourceattribution|Auditory scene analysis}}