Philosophy:Ecological validity (perception)

This entry will describe the proper narrow and technical meaning of "ecological validity" as proposed by Egon Brunswik as part of the Brunswik Lens Model, the relation of "ecological validity" in "representative design" of research, and will outline the common misuses of the "ecological validity." For a more detailed explanation, see Hammond (1998).

Proper Definition of Ecological Validity

Egon Brunswik defined the term "ecological validity" in the 1940s to describe a cue's informativeness. The ecological validity of a sensory cue in perception is the regression weight the cue X (something an organism might be able to measure from the proximal stimulus) in predicting a property of the world Y (some aspect of the distal stimulus). The "ecological validity" of X1 is its multiple regression weight when Y is regressed on X1, X2, and X3. For example, the color of a banana is a cue that indicates whether the banana is ripe. This particular cue has high ecological validity because a banana's ripeness is highly correlated with its color. By contrast, the presence of a sticker on the banana is a cue with an ecological validity close to 0, if (as seems likely) ripe and unripe bananas (in a fruit bowl, say) are equally likely to have stickers on them.

The concept of ecological validity is closely related to likelihood in Bayesian statistical inference and to cue validity in statistics.

Role of "ecological validity" in a "representative design"

Brunswik's concept of "ecological validity" is tied to his concept of "representative design." In a "representative design", the variances and correlations of some dependent variable Y and independent variables X1, X2, and X3 match their values in some specific real world ecology. Quoting Hammond (1998), "Generalizability of results concerning. . . the variables involved [in the experiment] must remain limited unless the range, but better also the distribution. . . of each variable, has been made representative of a carefully defined set of conditions" (1956, p. 53). Brunswik's admonition regarding the representativeness of the formal aspects of the conditions of experiments also includes the (ecological) intercorrelation among the independent variables in the experiment, thus challenging the typical factorial design in which variables are set in orthogonal relation to one another."

To understand why the "ecological validity" of a cue will change if the design is not "representative", consider two admissions officers, at schools A and B. School A is a highly selective university and B is a nonselective college. Admissions officers at A and B may learn to predict freshman GPA (Y) of applicants to their respective colleges on the basis of applicants' high school GPA (X1), ACT score (X2), and a rating of the quality of the student's essay on a 1 to 5 scale (X3). Because, in multiple regression, the weights of X1, X2, and X3 depend on their correlations and their variances, one would likely find very different regression weight (and therefore ecological validity of X1) of applicants at A versus B.

Brunswik believed that people learn over time to weight cues that will predict the criterion Y in a particular environment where they operate and receive feedback. If, in a particular environment where the judge normally operates, X1 and X2 are highly related, one can learn to predict Y using a subset of the cues to predict the criterion without loss of accuracy. But if the same person is put in a new situation with different ranges of the cues and different correlations among them, performance in predicting the criterion will suffer. This is similar to saying that Admissions officer A might have a hard time using what she had learned from experience at her selective employer if now attempting to predict freshman GPAs of applicants at B's university. Brunswik believed similar problems arise when researchers create experiments where the independent variables are not distributed in a way that matches the participants' local environments—for example, by making independent variables uncorrelated or by holding all but one variable constant.

Improper-But-Common Uses of the Term "Ecological Validity"

Brunswik's students have written that the now-common use of "ecological validity" to describe a type of experimental validity was a corruption of his original terminology (see external link to paper by Hammond). Social scientists routinely refer to the "ecological validity" of an experiment as a rough synonym to Aronson and Carlsmith's (1968) concept of the "mundane realism" of the experimental procedures—Mundane realism refers to the extent to which the experimental situation is similar to situations people are likely to encounter outside of the laboratory. See Hammond's (1998) detailed critique of this mis-use. Another common misuse of ecological validity is as a synonym for External Validity.

External links and references

• Kenneth R. Hammond "Ecological validity: Then and now."