Avoid common mistakes on your manuscript.
Introduction
Ensemble perception is, essentially, the perception of groups of things. It has been referred to by various names over the years, including set perception, summary statistical perception, and sometimes even texture perception, among other terms. Ensemble perception is ubiquitous. The norm in natural scenes is to encounter groups or crowds of things, features, textures, or objects. Ensemble perception is therefore relevant throughout perception science. It has been reported in many arenas, not just within vision but across modalities. In particular, there has been rapid growth in the subfield of ensemble visual perception in the last few years. This special issue of AP&P reflects that growth, focusing on vision in particular.
At the August, 2019 European Conference on Visual Perception (ECVP), Solomon and Hochstein organized a symposium on “Ensemble Perception: Theory and Experiment.” Talks included: Five Dichotomies in the Psychophysics of Ensemble Perception (Joshua A. Solomon), Ensemble Perception and the Inference of the Invisible (David Whitney, Zhimin Chen, and Allie Yamanashi), Perceptual Averaging: How to Separate Inattention From Representational Noise? (Aire Raidvee and Jüri Allik), The Properties of Large Receptive Fields Can Explain Ensemble-Related Phenomena (Igor S. Utochkin), and The How and Why of Ensemble Perception (Shaul Hochstein). (See abstracts at Perception, 48(2S), 1–236, 2019). Following the symposium we approached the editors of Attention, Perception & Psychophysics to edit a special issue on Ensemble Processing.
Goals of the special issue
There have been several recent reviews on ensemble perception (Alvarez, 2011; Bauer, 2015; Cohen et al., 2016; Haberman & Whitney, 2012; Hochstein et al., 2015; Whitney & Yamanashi Leib, 2018). This introductory chapter and the special issue as a whole are therefore not intended as reviews, though there are theoretically oriented papers in the special issue that include synthesis across fields (e.g., Solomon, 2020). Instead, our goal in this special issue is to reflect on the exponential growth in the field, the directions that are being taken, and the connections that are made to other areas of vision science (e.g., Cui et al., 2021).
Organization of the special issue
The special issue is organized into seven broad groups of articles. The organization is inevitably fuzzy in virtue of the diversity and growth in the field, but it is also intentional: it is not meant to be rigid. Instead, it is just a rough guide to help the reader navigate between different topics and make connections between them.
-
Section 1: Low-level ensemble perception
The first section encompasses what can arguably be coined lower-level ensemble perception, including ensemble properties such as size (Haberman & Suresh, 2020; Allik et al., 2014; Ariely, 2001; Corbett & Oriet, 2011; Khayat & Hochstein, 2019; Morgan et al., 2008; Solomon, 2010), position (Alvarez & Oliva, 2008; Sun et al., 2021), color and contrast (Bauer, 2009; Khayat & Hochstein, 2019; Rajendran et al., 2020), etc. Of course, the term “low-level” is loaded, and this grou** is not intended to suggest (or exclude) any particular model of visual processing; it does not preclude feedback or necessitate strict feedforward hierarchical processing. For example, ensemble numerosity (Katzin et al., 2020; Lee et al., 2021; Melcher et al., 2020; Rosenbaum et al., 2021) might be an early representation or a late one (or both). Effects of size constancy (Haberman & Suresh, 2020; Tiurina & Utochkin, 2019) might well not be strictly low-level.
-
Section 2: Mid and high-level ensemble perception
The second section encompasses what might be considered mid- and high-level ensemble perception. For our purposes, this operational division could simply reflect visual information beyond features like color and position. This section encompasses the majority of the papers in this special issue, which is, perhaps, unsurprising because the long history of research on ensemble perception stretches back over 100 years and that literature largely focused on the perception of ensemble features (Bauer, 2015).
Much of the new work reported in this special issue explores higher level ensemble representations, the interactions among levels, and the underlying mechanisms. For example, ensemble perception of spatial properties may not require magnocellular or coarse spatial processing (Lee & Chong, 2020), but it does involve information drawn from multiple spatial scales (Sweeny et al., 2020).
A canonical example of high-level ensemble perception is the perception of face crowds, and there has been a great deal of work on ensemble face perception since Haberman’s initial demonstrations (Haberman & Whitney, 2007). In this special issue, several groups explored ensemble face perception. Han et al. (2020) found ensemble coding of holistic representations of faces and Ji and Hayward (2020) found that observers have metacognitive awareness of their explicit ensemble face percepts. Echoing some of the work on faces (e.g., Han et al., 2020), ensemble perception of biological motion speed (Nguyen et al., 2020; Sweeny et al., 2013) also suggests that configural or holistic information can be represented as an ensemble.
-
Section 3: Summary statistics beyond the average
Most of the work on summary statistical perception has been about the average of a group of things. However, ensemble perception occurs for statistical moments beyond just the “average.” Several papers in the special issue explore this issue, such as the effect of variance and outliers on ensemble representations (Avcı & Boduroglu, 2021; Semizer & Boduroglu, 2021; Allard, 2021; Sama et al., 2021) and the representation of variance and statistical distributions, per se (Cha et al., 2020; Im et al., 2020).
More abstract perceptual dimensions may also be represented as ensembles (Leib et al., 2016; Leib et al., 2020).
-
Section 4: Temporal properties of ensemble perception and ensemble perception of temporal properties
The role of time in ensemble representations has been little explored in the past. This is one of the potentially fast-growing areas of ensemble perception work in the future. The papers in this section represent the forefront of the field. Melcher et al. (2020) report qualitatively different relationships between exposure duration and the accuracies of small and large numerosity estimates. Zhu et al. (2020) explicitly probe ensemble representations of duration and provide a model for how the quality of those representations depends on the statistics of the ensemble. Corbett et al. (2020) found negative aftereffects of adaptation to the average duration of sequentially presented sets of visual events, suggesting independent neural mechanisms that are selectively sensitive over a limited range of average durations.
-
Section 5: Attention-related effects
The role of attention in ensemble perception has been studied but remains hotly debated. The papers in this special issue explore a range of related issues. Several examine the role of saliency (Iakovlev & Utochkin, 2020), participant expertise (Sun & Gauthier, 2020) and practice-induced learning (Cha et al., 2020; Hochstein & Pavlovskaya, 2020) on ensemble perception. Another paper proposes a method for distinguishing noise from effects of inattention (Raidvee et al., 2021) when considering the efficiency of ensemble integration (Solomon, 2010; Solomon et al., 2011; Solomon et al., 2016). Additional papers explore ensemble representations within and outside the focus of attention (Chen, Zhuang, et al., 2020), during competing tasks like multiple object tracking (Alzahabi & Cain, 2021), and even with active ignoring (Rafiei et al., 2020).
-
Section 6: Theoretical contributions and reviews
A few papers in the special issue take a broader view. Solomon (2020) outlines a rubric for studying ensemble perception and guidelines for psychophysical explorations of it. Cui and Liu (2021) explore some promising connections between data visualization, ensemble perception, and education. Khayat et al. (2021) suggest that perceptual representations are initially coded in terms of an average computed from a set along with the differences of individual items from that mean (Benna & Fusi, 2019), such that under limited viewing (or memory) conditions only the mean (prototype or “ancestor”) survives.
-
Section 7: The relation between ensemble perception and memory
Although the field of visual memory is vast, there are increasingly apparent connections to ensemble representations because of their efficiency of representation and currency in perceptual experience. Papers by Papenmeier and Timm (2020) and Chen, Kocsis, et al. (2020) explore how visual working memory may be impacted by summary statistics (see Brady & Alvarez, 2011). A Paper by Zepp et al. (2021) tests ensembles in an iconic memory task, relating ensemble mean to central tendency recall (Dubé, 2019; Hollingworth, 1910).
What has the special issue not captured?
The most obvious limit of this special issue is that it only captures vision. However, ensemble and summary statistical perception occur in other modalities, including audition (e.g., Piazza et al., 2013) and probably including smell, taste, and somatosensation. Hopefully the next special issue will reflect this growth.
There are a range of specific debates that are not directly addressed in this special issue. For example, there has been a heated philosophical debate about ensembles as the currency of conscious experience, whether ensembles provide evidence for “consciousness overflow,” and other significant questions directly related to ensemble perception in the philosophy literature (e.g., Bayne & McClelland, 2019; Cohen et al., 2016; McClelland & Bayne, 2016; Openshaw & Weksler, 2020). These have been running essentially in parallel to the empirical work, and we have little representation for that debate in this special issue. This is unfortunate but also an unsurprising consequence of the empirical focus of both the research and the journal. A future special issue that more actively bridges the philosophy with the empirical work would be fruitful.
The diversity and growth in the field of ensemble perception in the last twenty years has been remarkable. We hope that this special issue reflects some of the promise it holds in hel** to address questions in areas ranging from cross modal perception to consciousness, and from data visualization to memory.
References
Allard, R. (2021). Variance-dependent neural activity in an unvoluntary averaging task. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02223-8
Allik, J., Toom, M., Raidvee, A., Averin, K., Kreegipuu K. (2014). An almost general theory of mean size perception Vision research 83, 25–39. https://doi.org/10.1016/j.visres.2013.02.018
Alvarez, G. A. (2011). Representing multiple objects as an ensemble enhances visual cognition. Trends in Cognitive Sciences 15 (3):122–131.
Alvarez, G. A., & Oliva, A. (2008). The representation of simple ensemble visual features outside the focus of attention. Psychological Science 19(4), 392-398.
Alzahabi, R., Cain, M. S. (2021). Ensemble perception during multiple-object tracking. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02219-4
Ariely, D. (2001). Seeing sets: Representation by statistical properties. Psychological Science 12(2), 157–162.
Avcı, B. & Boduroglu, A. (2021) Contributions of ensemble perception to outlier representation precision. Attention, Perception & Psychophysics
Bauer, B. (2009). Does Stevens’s power law for brightness extend to perceptual brightness averaging? The Psychological Record 15(2), 171–185.
Bauer, B. (2015). A selective summary of visual averaging research and issues up to 2000. Journal of Vision, 15(4), 14.
Bayne, T., McClelland, T. (2019). Ensemble representation and the contents of visual experience. Philosophical Studies 176, 733–753. https://doi.org/10.1007/s11098-018-1037-3
Benna, M. K., & Fusi, S. (2019). Are place cells just memory cells? Memory compression leads to spatial tuning and history dependence. bioRxiv, 624239.
Brady, T. F., & Alvarez, G. A. (2011). Hierarchical encoding in visual working memory: statistics bias memory for individual items. Psychological Science, 22, 384–392. https://doi.org/10.1177/0956797610397956
Brezis, N., Bronfman, Z. Z. & Usher, M. (2015). Adaptive spontaneous transitions between two mechanisms of numerical averaging. Scientific Reports, 5.
Brielmann, A.A., Pelli, D.G. (2020). The pleasure of multiple images. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02175-z
Cha, O., Blake, R. & Gauthier, I. (2020). The role of category- and exemplar-specific experience in ensemble processing of objects. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02162-4
Chen, S., Kocsis, A., Liesefeld, H., Müller , H. Conci, M. (2020). Object-based grou** benefits without integrated feature representations in visual working memory. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02153-5
Chen, Z., Zhuang, R., Wang, X. et al. (2020). Ensemble perception without attention depends upon attentional control settings. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02067-2
Cohen, M. A., Dennett, D. C., & Kanwisher, N. (2016). What is the bandwidth of perceptual experience? Trends in Cognitive Sciences, 20(9), 324–335.
Corbett, J.E., Aydın, B. & Munneke, J. (2020). Adaptation to average duration. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02134-8
Corbett, J. E., & Oriet, C. The whole is indeed more than the sum of its parts: Perceptual averaging in the absence of individual item representation. Acta Psychologica (2011). 138(2), 289–301.
Cui, L., Liu, Z. (2021). Synergy between research on ensemble perception, data visualization, and statistics education: A tutorial review. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02212-x
Dubé, C. (2019). Central tendency representation and exemplar matching in visual short–term memory. Memory & Cognition, 47(4), 589–602.
Haberman, J., Suresh, S. (2020). Ensemble size judgments account for size constancy. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02144-6
Haberman, J., & Whitney, D. (2007). Rapid extraction of mean emotion and gender from sets of faces. Current Biology, 17(17), R751–R753. https://doi.org/10.1016/j.cub.2007.06.039.
Haberman, J., & Whitney, D. (2012). Ensemble perception: Summarizing the scene and broadening the limits of visual processing. In J. Wolfe & L. Robertson (Eds.), Oxford series in visual cognition. From perception to consciousness: Searching with Anne Treisman (p. 339–349). Oxford University Press. https://doi.org/10.1093/acprof:osobl/9780199734337.003.0030
Han, L., Yamanashi Leib, A., Chen, Z. et al. (2020). Holistic ensemble perception. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02173-1
Hochstein, S. & Pavlovskaya, M. Perceptual learning of ensemble and outlier perception. Journal of Vision (2020), 20(8):13, 1–17 1
Hochstein, S., Pavlovskaya, M., Bonneh, Y. S., & Soroker, N. Global statistics are not neglected. Journal of Vision (2015), 15(4), 7, 1–17
Hollingworth, H. L. The central tendency of judgment. The Journal of Philosophy, Psychology and Scientific Methods (1910), 7(17), 461–469.
Iakovlev, A. U., Utochkin, I. S. (2020). Roles of saliency and set size in ensemble averaging. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02089-w
Im, H. Y., Tiurina, N. A. & Utochkin, I. S. (2020). An explicit investigation of the roles that feature distributions play in rapid visual categorization. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02046-7
Ji, L., Hayward, W.G. (2020). Metacognition of average face perception. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02189-7
Katzin, N., Rosenbaum, D. & Usher, M. (2020). The averaging of numerosities: A psychometric investigation of the mental line. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02140-w
Khayat, N., Fusi, S. & Hochstein, S. (2021). Perceiving ensemble statistics of novel image sets. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02174-0
Khayat, N., & Hochstein, S. Perceiving set mean and range: Automaticity and precision. Journal of Vision, (2019). 18(23), 1–14. https://doi.org/10.1167/18.9.23
Lee, J., & Chong, S. C. (2020). Quality of average representation can be enhanced by refined individual items. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02139-3
Lee, K. R., Dague, T. D., Sobel, K. V. et al. (2021). Set size and ensemble perception of numerical value. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02196-8
Leib, A., Chang, K., **a, Y., Peng, A., & Whitney, D. (2020). Fleeting impressions of economic value via summary statistical representations. Journal of Experimental Psychology. General 149(10), 1811–1822. https://doi.org/10.1037/xge0000745
Leib, A., Kosovicheva, A., & Whitney, D. (2016). Fast ensemble representations for abstract visual impressions. Nature Communications 7 (1), 1-10. https://doi.org/10.1038/ncomms13186
McClelland, T. & Bayne, T. Ensemble coding and two conceptions of perceptual sparsity. Trends in Cognitive Sciences (2016). 20(9), 641-642. https://doi.org/10.1016/j.tics.2016.06.008
Melcher, D., Huber-Huber, C. & Wutz, A. (2020). Enumerating the forest before the trees: The time courses of estimation-based and individuation-based numerical processing. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02137-5
Morgan, M., Chubb, C., & Solomon, J. A. A ‘dipper’ function for texture discrimination based on orientation variance. Journal of Vision, (2008). (11), 1–8.
Nguyen, T. T. N., Vuong, Q. C., Mather, G. et al. (2020). Ensemble coding of crowd speed using biological motion. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02163-3
Openshaw, J. & Weksler, A. A puzzle about seeing for representationalism. Philosophical Studies (2020). 177:2625–2646. https://doi.org/10.1007/s11098-019-01331-y
Papenmeier, F., Timm, J. D. (2020). Do group ensemble statistics bias visual working memory for individual items? A registered replication of Brady and Alvarez (2011). Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02209-6
Peng, S., Liu, C.H. & Hu, P. (2020). Effects of subjective similarity and culture on ensemble perception of faces. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02133-9
Piazza EA, Sweeny TD, Wessel D, Silver MA, Whitney D. Humans Use Summary Statistics to Perceive Auditory Sequences. Psychological Science 2013;24(8):1389-1397. https://doi.org/10.1177/0956797612473759
Rafiei, M., Hansmann-Roth, S., Whitney, D. et al. (2020). Optimizing perception: Attended and ignored stimuli create opposing perceptual biases. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02030-1
Raidvee, A., et al. (2021). A method for detection of inattentional feature blindness. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02234-5
Rajendran, S., Maule, J., Franklin, A., & Webster, M. A. (2020). Ensemble coding of color and luminance contrast. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02136-6
Rosenbaum, D., de Gardelle, V. & Usher, M. (2021). Ensemble perception: Extracting the average of perceptual versus numerical stimuli. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02192-y
Sama, M. et al. (2021). Global and local interference effects in ensemble encoding are best explained by interactions between summary representations of the mean and range . https://doi.org/10.3758/s13414-020-02224-7
Semizer, Y. & Boduroglu, A. (2021) Variability leads to overestimation of mean summaries. Attention, Perception & Psychophysics
Solomon, J. A. Visual discrimination of orientation statistics in crowded and uncrowded arrays. Journal of Vision, (2010). 10(14), 1-16. https://doi.org/10.1167/10.14.19
Solomon, J. A. (2020). Five dichotomies in the psychophysics of ensemble perception. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02027-w
Solomon, J. A., May, K. A., & Tyler, C. W. Inefficiency of orientation averaging: Evidence for hybrid serial/parallel temporal integration. Journal of Vision (2016). 16(1):13. https://doi.org/10.1167/16.1.13
Solomon, J. A., Morgan, M., & Chubb, C. Efficiencies for the statistics of size discrimination. Journal of Vision, (2011). 11(12):13, 1-11. https://doi.org/10.1167/11.12.13.
Solomon J.A. & Morgan M.J. Calculation Efficiencies for Mean Numerosity. Psychological Science (2018). 29(11):1824-1831. https://doi.org/10.1177/0956797618790545
Sun, J., Gauthier, I. (2020). Car expertise does not compete with face expertise during ensemble coding. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02188-8
Sun, P., Chu, V. & Sperling, G. (2021). Multiple concurrent centroid judgments imply multiple within-group salience maps. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02197-7
Sweeny, T. D., Haroz, S., & Whitney, D. (2013). Perceiving group behavior: Sensitive ensemble coding mechanisms for biological motion of human crowds. Journal of Experimental Psychology: Human Perception and Performance, 39(2), 329–337. https://doi.org/10.1037/a0028712
Sweeny, T.D., Bates, A. & Elias, E. (2020). Ensemble perception includes information from multiple spatial scales. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02109-9
Tiurina, N. A., & Utochkin, I. S. (2019). Ensemble perception in depth: Correct size-distance rescaling of multiple objects before averaging. Journal of Experimental Psychology: General, 148(4), 728.
Whitney, D. & Yamanashi Leib, A. Ensemble Perception, Annual Review of Psychology (2018) 69, 105-129. https://doi.org/10.1146/annurev-psych-010416-044232
Zepp, J., Dubé, C. & Melcher, D. (2021). A direct comparison of central tendency recall and temporal integration in the successive field iconic memory task. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02187-9
Zhu, X., Baykan, C., Müller, H.J. et al. (2020). Temporal bisection is influenced by ensemble statistics of the stimulus set. Attention, Perception, & Psychophysics. https://doi.org/10.3758/s13414-020-02202-z
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Whitney, D., Solomon, J.A. & Hochstein, S. Introduction to the special issue on ensemble perception. Atten Percept Psychophys 83, 899–903 (2021). https://doi.org/10.3758/s13414-021-02275-4
Published:
Issue Date:
DOI: https://doi.org/10.3758/s13414-021-02275-4