Introduction

Autism spectrum disorder (ASD) is a neurodevelopmental disorder that affects 1 in 54 children in the USA [26]. Symptoms of ASD include deficits in social communication and restrictive/repetitive behaviors that often manifest before the age of three and can persist throughout one’s lifetime [22]. Further, early deficits in social communication can negatively impact the development of social-emotional reciprocity [36], nonverbal communicative behaviors [20], cognitive abilities [40], and language development [6, 20, 38]. Therefore, early detection and implementation of therapies is crucial to mitigating downstream negative effects of early deficits and promoting effective individualized strategies to support development.

Atypical face processing in individuals with ASD is hypothesized to negatively impact social communication [19], and such differences may be present in infancy, prior to the emergence of behavioral symptoms. To identify such differences, researchers have studied infant siblings of children diagnosed with ASD, as they have an increased incidence of a later ASD diagnosis as well as other developmental delays [15, 27, 32, 35]. Several eye tracking studies have observed that high familial risk infants show differences in face scanning as early as 6 months of age (e.g., eyes vs mouth) and that early differences in attention to faces is associated with later social communication ability [12, 41, 46].

Electrophysiological recordings, and more specifically event-related potentials (ERPs), from infant siblings have also been used to identify neural differences in face processing. There are several ERP components that have been shown to be sensitive to face processing: Nc, N290, and P400. The Nc or “negative central” waveform is observed over the frontal regions of the brain and is a marker for attention in both infants and adults [4]. The Nc response is larger in response to novel or unfamiliar objects or faces [5, 25, 31]. Across the first 2 years of life, an infant’s response to their mother versus a stranger’s face shifts, with an increased Nc response to their mother’s face before 1 year of age, but a decreased response to their mother versus a stranger by 2 years of age [2].

The N290, measured over the lateral-inferior posterior scalp, is the most commonly studied face-sensitive ERP component and is thought to be a precursor to the adult N170 waveform that has robustly been observed in response to faces [1). After ERP preprocessing pipelines described below, 102 ERPs were available for Nc analysis (42 LRC, 40 HR-NoASD, 20 HR-ASD) and 64 ERPs were available for N290/P400 analyses (24 LRC, 26 HR-NoASD, 14 HR-ASD).

ASD outcome and social communication measures

Final ASD outcome groups were determined using the ADOS [23], administered at 18, 24, and 36 months of age. For participants receiving an ADOS score indicative of ASD or within 3 points of cutoffs, a licensed clinical psychologist reviewed video recordings of concurrent and previous assessments, and using DSM-5 criteria, provided a best estimate clinical judgment in one of three categories: typically develo**, ASD, or non-spectrum disorder (e.g., ADHD, anxiety, language delay). Of the 60 HR infants contributing data for this study, 3 children (2 HR-ASD, 1 HR-No ASD) had final outcome judgements based on only the 18 month ADOS assessment. At 18 months, all participants were administered the ADOS Module 1, and the social affect score was used as one measure of social development.

Infants were evaluated using the Mullen Scales of Early Learning (MSEL; [29]) at 6, 9, 12, 18, 24, and 36-month visits. These evaluations assessed receptive and expressive language, fine motor skills, and visual reception developmental domains. This study utilizes standardized t scores from expressive language and receptive language subscales of the MSEL at 12 months of age as an early measure of social communication. At 12 months, expected MSEL items are largely building blocks of social communication skills (Receptive—responding to voice and face, attending to words and movement, recognizing own name, understanding gesture and commands; Expressive—smiles, vocalizations, plays gestures/language game). At later ages, items focus on more language based skills (recognizing body parts, following directions with objects, saying words, labeling objects). Given this paper’s focus on social communication, only 12 month MSEL scores were used.

Parents completed the MacArthur-Bates Communicative Development Inventory (MB-CDI): Words and Gestures [14] at the 12-month time point. The study utilizes the Early Gesture and Phrases Understood raw scores from this questionnaire. At the 18-month visit, parents completed the Communication and Symbolic Behavior Scales Developmental Profile (CSBS-DP; [42]). The CSBS-DP is a norm-referenced measure of early social communication and symbolic development. The Social composite standard score (comprised of questions related to emotion, eye gaze, communication, and gestures) was used in subsequent data analyses.

Mother/stranger stimuli and EEG task procedure

For this task, infants observed color pictures of their mother and a similarly looking stranger. Images of the mother and stranger were randomly presented for 500 ms, maintaining a ratio of 1:1 for each type of picture. Pictures of the mothers were matched with strangers according to ethnicity and whether or not they wore glasses. The mothers and strangers had neutral expressions for their pictures.

EEG sessions were conducted in a sound attenuated and electrically shielded room with minimal lighting. During the sessions, caregivers held the infant on their lap, approximately 65 cm from the experimental monitor. Continuous EEG was recorded using either 64-channel Geodesic Sensor Net System or a 128-channel Hydrocel Geodesic Sensor Nets (Electrical Geodesics, Inc., Eugene, OR, USA). Signals were amplified with a Net Amps 200 or Net Amps 300 amplifier (Electrical Geodesic Inc., Eugene, OR, USA), sampled at either 250 Hz or 500 Hz. EEG data were online-referenced to a single vertex electrode (Cz), and impedances were kept below 100 kΩ. Stimulus presentation was managed via the ePrime software (Psychology Software Tools, Pittsburgh, PA). Each stimulus was initiated only when the child was attending to the screen, as observed by an examiner in the adjacent room. Trials during which the child’s attention was not maintained on the visual stimulus were marked and then removed from further analysis. A maximum of 100 trials (Mother and Stranger combined) were presented. Fewer trials were presented when the infant became fussy, tired, or inattentive. There was no significant difference in number of trials administered between outcome groups (p > 0.1, Supplemental Table 1).

EEG pre-processing

The continuous EEG data collected over the mother/stranger paradigm was first downsampled to 250 Hz in Netstation and then exported to MATLAB (versionR2017b) for preprocessing analysis using a modified version of the Harvard Automated Processing Pipeline for EEG (HAPPE; [16]) to allow for ERP analyses similar to the recently released HAPPE+ER software (Monachino et al., under review). Within the modified HAPPE pipeline, artifact within the continuous EEG data is first extracted using the following steps: a copy of the data is made and that copy is high-pass filtered at 1 Hz, channels for subsequent ICA analysis are selected (Supplemental Fig. 2), 60 -Hz electrical noise is removed via Cleanline’s multi-taper regression (Mullen 30), bad channels are rejected, and then remaining artifact is extracted first using wavelet-enhanced independent component analysis (W-ICA), and then subsequently using ICA with MARA automated independent component rejection. Next, the original unfiltered EEG file is subjected to the same channel selection and electrical noise removal steps above and the bad channels detected from analysis on the data copy are removed. The artifact signals identified after the W-ICA step on the data copy are then subtracted from the original unfiltered EEG file, and the identified artifact ICA components rejected from the data copy are back-projected to sensor space as timeseries that are then rejected from the original unfiltered signal. This now “clean” unfiltered file is filtered using standard ERP filter settings (0.3–30 Hz), and segmented (− 100 to 700 ms) around the visual stimulus, and baseline corrected via baseline subtraction. Segments with retained artifact in the subset of electrodes used for ERP analyses (Fig. 1A and B) are rejected using HAPPE’s amplitude (amplitude threshold of ± 80 μV) and joint probability criteria, bad channels are interpolated, and data is referenced to the average reference.

Fig. 1
figure 1

A Grand average ERP waveform across group in response to mother versus stranger faces. Electrode groups and ERP response for Nc (top row) and N290/P400 (bottom row). B Difference in ERP response to mother versus stranger across outcome groups. No significant differences were observed

EEG rejection criteria

Children were excluded from the final sample if they had fewer than 10 trials for either the mother or stranger stimuli or did not meet the following HAPPE data quality output parameters previously determined in this dataset (Wilkinson et al. 43): percent good channels > 82%, percent of independent components rejected < 84%, percent variance of data retained after artifact removal > 32%, mean retained artifact probability < 0.3. There were no significant differences in data quality between outcome groups. Supplemental Table 1 shows quality metrics for all outcome groups for both ERP analyses.

ERP analysis

Average waveforms for each individual participant for each stimulus condition (mother and stranger) were calculated across electrodes in corresponding regions of interest (Nc: Fig. 1A top, P400: Fig. 1A bottom), which were chosen based on previous literature [17, 18, 24, 25]. To control for the effect of preceding peak/trough amplitude on the Nc, N290, and P400 amplitudes, all peak amplitudes were calculated by measuring the peak-to-peak amplitude [34], which is the magnitude of the component value subtracted from the maximum value of the previous opposite polarity peak (Supplemental Fig. 3).

For the Nc waveform, the peak negative Nc component was identified as the most negative point between 300 and 600ms after the stimulus. The peak negative N290 components were identified as the most negative point between 200 and 350 ms after the stimulus. The peak positive P400 components were identified as the most positive point between 300 and 500 ms.

To evaluate the difference in response for mother against stranger (Mother-Stranger), for each component, the peak amplitude response to stranger was subtracted from the peak amplitude response to mother.

Statistics

Demographics were analyzed across groups using Fischer’s exact test to determine any differences between groups. Continuous variables (e.g., EEG HAPPE metrics, ERP component amplitudes) were analyzed for normality, and the Kruskal-Wallis H tests (one-way nonparametric ANOVA) were used to compare groups when the Shapiro-Wilk test was p < 0.05, followed by post hoc Dunn’s tests to examine pairwise comparisons. Bonferroni’s correction was used to account for multiple comparisons such that family-wise error rate was set to α < 0.05. Two-way mixed ANOVA were used to determine the effects of group, picture, and group × picture interaction on ERP peak amplitudes.

Simple and multiple linear regressions were used to determine whether ERP peak amplitudes (Mother-Stranger) were associated with social communication measures. To evaluate the effect of outcome group on the relationship between ERP amplitudes and social communication measures, linear regressions models included a two-way interaction between outcome group and the relevant ERP measure. To characterize interaction effects within the models, marginal effects analyses were performed. As maternal education was significantly different between outcome groups, and has been associated with language outcomes in infants, it was included as a covariate in all models.

Results

Sample description

Demographic data for each outcome group (LRC, HR-NoASD, and HR-ASD) are shown in Table 1. There was a significant group difference in maternal education, with both the HR-NoASD and HR-ASD having a high proportion of mothers with less than a 4-year college degree. Notably, the majority of participants across groups were white with household incomes above $75,000.

Table 1 Sample characteristics

Grand average ERP components across groups

Grand averaged Nc and N290/P400 responses to mother and stranger stimuli by outcome groups are shown in Fig. 1A. The effects of group, stimulus, and group × stimulus interaction on peak-peak amplitude, and latency measures were assessed. No significant main effects or interactions were observed. The distribution of Mother-minus-Stranger peak-peak amplitude (Mother-Stranger) across outcome groups is shown in Fig. 1B.

ERP Mother-Stranger responses and social communication measures

While there were no group differences observed at 12 months of age in N290, P400, and Nc responses to mother/stranger stimuli, there was fairly broad distribution in responses across infants. We investigated whether an infant’s brain response to their mother’s versus a stranger’s face was associated with early and later social communication measures. Here, we define social communication as skills that facilitate social engagement with others (e.g., eye contact, gestures, directed vocalization, response to name). To capture early social communication skills, we used Receptive and Expressive t scores on the MSEL, as well as raw scores from the Phrases Understood and Early Gestures sections of the MB-CDI administered at 12 months. At this younger age, both of these measures assess building blocks of social communication (see Methods). To capture later social communication skills, we utilized the social affect score on the ADOS and Social Composite on the CSBS-DP parent questionnaire, both administered at 18 months. Using simple, unadjusted, Pearson correlations across outcome groups, we assessed the relationship between ERP amplitudes and 12-month communication measures (Fig. 2) and 18-month social measures (Fig. 3). We observed that increased Nc response to mother over stranger was positively correlated with Expressive Mullen T scores (Pearson’s r = 0.32, p = 0.0028). Similarly, increased P400 response to mother over stranger was positively correlated with the MB-CDI Phrases Understood (Pearson’s r = 0.41, p = 0.009). Both correlations remained significant after adjusting for 4 comparisons.

Fig. 2
figure 2

Mother-Stranger amplitude difference and communication measures. Correlations and Pearson’s r statistics are shown between ERP amplitudes (A Nc, B N290, C P400) and the following 12-month communication measures: Mullen Scales of Early Learning Expressive Language and Receptive Language t scores, MacArther Bates CDI Phrases Understood and Early Gestures raw scores. Blue, LR; orange, HR-NoASD; green, HR-ASD

Fig. 3
figure 3

Mother-stranger amplitude difference and 18 month social measures. Correlations and Pearson’s r statistics are shown between ERP amplitudes (A Nc, B N290, C P400) and ADOS or CSBS social scores at 18 months. Blue, LR, orange, HR-NoASD, green, HR-ASD

To further evaluate the effect of group on the relationship between Mother-Stranger ERP responses and social communication measures, for each ERP response, two linear regression models were examined. Model 1 included outcome group as an independent variable to account for expected group differences in social communication measures that are independent of ERP responses. Model 2 included two-way interactions between outcome group and the ERP response, with the hypothesis that the relationship between ERP response and social communication measures may be different between outcome groups. For all models, maternal education was also included as a covariate. As expected, significant effects of outcome group on MSEL Expressive and Receptive language scores, MB-CDI measures, and ADOS Social Score were observed (model 1, Table 2). In model 1, after accounting for effects of outcome group and maternal education on social communication measures, the Nc Mother-Stranger response was positively associated with expressive language, and the P400 Mother-Stranger response was positively associated with Number of Phrases Understood (Nc model 1, adjusted R2 = 0.11; p = 0.007; P400 model 1, adjusted R2 = 0.35; p = 0.005).

Table 2 Linear regression models of ERP components vs social communication measures

To assess whether the relationship between ERP response and social communication measures were (1) significant within outcome groups or (2) significantly different between outcome groups, marginal effects analyses were then performed on model 2 in cases where two-interactions had p values < 0.25 (Table 3). In model 2, the significance of the interaction terms represents whether the evaluated association is significantly different between HR-NoASD or HR-ASD groups specifically compared to the LR group. To be inclusive of possible significant associations within outcome groups, that were not significantly different from the LR group, we chose to use a generous p value threshold in determining which analyses to perform. Overall, several significant associations, accounting for multiple comparisons, were observed:

  1. 1.

    Slope comparisons of marginal effects from Nc analyses revealed that LR, but not HR-NoASD or HR-ASD infants showed a positive relationship between Nc Mother-Stranger and MSEL Expressive Language t scores (slope = 1.15, p = 0.007).

  2. 2.

    HR-ASD infants showed a positive association between P400 Mother-Stranger response and both MSEL Expressive and Receptive language t scores (slope = 2.10, p < 0.001; slope 1.68, p = 0.002). Further, these associations for HR-ASD infants were significantly different from both LR and HR-NoASD infants (Fig. 4).

  3. 3.

    For only HR-ASD infants, increased P400 Mother-Stranger response was associated with better social interactions based on lower ADOS Social scores and higher CSBS Social scores. These associations were also significantly different between HR-ASD infants vs either LR (p = 0.0001, p = 0.01) or HR-NoASD (p = 0.001, p = 0.04) infants.

Table 3 Marginal effects ERP components vs social communication measures
Fig. 4
figure 4

Outcome group differences in predicted language scores based on Mother-Stranger amplitude difference. The relationship between Mother-Stranger amplitude difference and A expressive language scores or B receptive language scores was significantly different between HR-ASD and both LR and HR-noASD groups (expressive: LR—p < 0.01; HR-noASD—p < 0.01; receptive: LR—p < 0.01; HR-noASD — p < 0.05). Blue, LR; orange, HR-NoASD; green, HR-ASD

Discussion

Overall, we observed that infants in all three outcome groups had similar ERP responses to pictures of their mother compared to a stranger. The P400 response to mother over stranger was associated with receptive language skills as measured on the MB-CDI. Despite similar ERP responses across groups, we identified outcome group specific relationships between Nc and P400 amplitudes with both communication and social measures. Specifically, for low familial risk infants, Nc was positively associated with expressive language outcomes, whereas, for high familial risk infant with later autism diagnosis, the P400 was positively associated with concurrent expressive and receptive language development and future social skills.

Lack of differences in ERP amplitudes between cohort groups

Overall, the three groups presented in the study showed similar Nc, N290, and P400 components to the mother/stranger paradigm at 12 months. For these components, there were no differences in the mother, stranger, or Mother-Stranger amplitude values for any of the groups or between groups. Previous studies in infants have similarly found no significant main effects for familial risk group on N290 and P400 amplitudes in response to faces [13, 25, 28], but have observed latency differences between risk groups in response to objects. Together, these findings suggest that early face processing is intact in high familial risk infants, including those who later meet ASD criteria. However, studies in preschoolers with ASD have consistently shown differences in ERP responses to familiar/non-familiar faces when compared to typically develo** preschoolers [7, 8]. It has been hypothesized that infants with ASD may have delayed development of familiar/unfamiliar ERP responses, which may not be captured at a single 12-month time point. Visually, when examining grand averages, we do observe specifically in the LRC group, a downward shift in the frontally measured ERP response to mother, compared to stranger. While these differences were not statistically different, they do suggest a trend in differential responses, and it was this group where we observed a significant association between Nc response and language skills. While group differences were not identified at this age for this face paradigm, it is possible that other statistical (e.g., machine learning) approaches incorporating multiple measures of the ERP response and possible longitudinal measures earlier in development could be predictive of ASD outcome. ASD prediction was not the aim of this analysis, and we note here that predictive analyses will require larger sample sizes to be clinically meaningful.

Relationships between ERP amplitudes and communication and social measures

Importantly, this study also investigated whether ERP responses were associated with language and social development, and whether such brain-behavior associations were different between outcome groups. Here we uncovered several interesting findings. First, we observed that for low-familial risk infants, a larger Nc to mother over a stranger was positively associated with concurrent expressive language scores on the MSEL. The Nc amplitude has been observed to change from infancy to preschool years, where in infants under 1 year of age, a more negative response is observed in response to familiar faces; On the other hand, by 3-5 years of age, a more negative response is observed in responses to unfamiliar faces [9, 25]. Visually the grand average waveforms for the LRC group (Fig. 1, top), do show a trend toward increased negative response to mothers, perhaps suggesting that a subset of these infants are making this developmental transition sooner than others. Further, our brain-behavior association suggests that early transition of the Nc’s differential familiar/unfamiliar response is associated with more advanced expressive language development. We also note that a similar positive association was observed in the HR-ASD group but was not significant after adjustment for multiple comparisons, likely due to the small sample size within this group. Together, this suggests that Nc response in infancy may not be different between ASD outcomes, but may be an indicator of brain development as it specifically relates to expressive language. Notably, associations were not observed with receptive language and social communication measures. As a form of communication, it is feasible to assume that attentional resources toward a person are more crucial for one’s active communication, being expressive, compared to one’s passive communication, being receptive. However, since gestures are a precursor to expressive language, it is unclear why gestures would not be similarly significant. More research will be needed to explain these discrepancies in infant attentional resources to their communication and social outcomes.

Second, we observed that the P400 component is significantly associated with MB-CDI Phrases Understood while accounting for maternal education and group, indicating a significant association to early receptive language development. In addition, for high-familial risk infants who later met criteria for autism, a greater P400 response to mother over stranger was associated with better concurrent receptive and expressive language, as well as future social skills measured at 18-month. Several studies have investigated clinical correlations of ERP responses to face in infancy. Increased P400 and Nc response to infrequently over frequently shown faces has been associated with better cognitive development [44]. Differential P400 response changes in facial features has been linked to receptive language [21]. While the P400 has been shown to be differentially responsive to faces versus objects in infants as young as 6 months [11], findings have not been consistent [3], and it is unclear if the P400 is a face specific ERP. Both the P400 and Nc components are also hypothesized to be neural markers of sustained attention, as amplitudes are increased in response to novel objects [10, 33, 45], as well as communicative over non-communicative gestures [1]. We hypothesize that a differential P400 response to mother versus stranger represents an infants’ recognition of saliency in their mother’s face and that this is predictive of language and social development.

Interestingly we did not observe any brain-behavior associations with the N290, which is the most frequently studied face-specific ERP component, and thought to be a precursor for the N170 [3, 9]. This may be related to developmental timing, and future analyses will investigate whether relationships change over the first three years of life.

Limitations

This study contained several limitations. The sample size for the HR-ASD group was small, and while findings within the HR-ASD group were significant, they should be interpreted with caution and will need to be replicated with a larger sample. Additionally, The sample population had substantially higher maternal education than the national average, indicating that the cohort of infants might not be representative of the general population [39]. Furthermore, HR-ASD infants in this particular sample had language development that fell generally in the average range indicating more high functioning individuals in our analysis; therefore, the analysis does not encompass all of the ASD spectrum in terms of language development.

Conclusions and future directions

We found that there was no difference in the Nc, N290, or P400 responses to mother versus stranger across LRC, HR-NoASD, and HR-ASD groups. However, differential mother vs stranger ERP responses in the Nc and P400 were significantly associated with communication and social development, suggesting they could be a useful biomarker of development for high familial risk infants. Future research will require replication in larger datasets. Further analysis of how differential Nc and P400 responses develop over infancy to preschool age across low and high-risk groups will also provide valuable information on differences in brain development as they relate to language and social development.