Background

EMS are defined as safety–critical organisations similar to organisations such as chemical and nuclear installations, military field units and hospital trauma units [1]. Ensuring safety plays a vital role in all of these organisations. Being a safety–critical organisation means that a risk exists for people being injured or dying as a result of performing their tasks [2]. An EMS organisation is considered to be safety–critical even though not all tasks contain an immediate risk for the professionals or the patients; therefore, it is important to explore the EMS safety culture.

The World Health Organization (WHO) has defined the term safety culture as the product of individual and group values, attitudes, perceptions, competencies, and patterns of behavior that determine the commitment to, and the style and proficiency of, an organization’s health and safety management [3]. Regardless of the WHO definition, the terms safety culture and safety climate have usually been used synonymously; researchers have even discussed the terms’ differences and similarities. The literature has described the safety culture as being less flexible and more complex than the safety climate. The safety climate is measurable on several different levels, for example, the individual, team, unit, organisation and environment levels [4, 5]. According to Flin et al., safety climate studies are regarded as attitude studies [6]. Despite the differences between those two terms, we use the term safety culture for clarity in this study and include safety climate in safety culture.

One of the key areas for improving safety in healthcare focuses on building a positive safety culture [7]. A safety culture formulates situation awareness, communality and cooperation between an organisation, its supervisors/managers and employees [8]. The leaders have an important role in fostering safety and team performance [9]. For example, in a health-care setting, management’s commitment to safety is related to teamwork [10]. National guidance and organisation management and leadership in the emergency medical service (EMS) setting play the most significant roles in promoting a safety culture. EMS personnel attitudes toward the organisation, the work environment, teams and staff are components of a safety culture [11].

The WHO has underlined the importance of a safety culture when organisations develop patient safety. It is described that enhancing safety culture in health-care services may have a positive impact on patient safety. Effective leadership and a supportive culture are essential for improving safety. Employees’ safety and patient safety are combined for their well-being at work and for employees’ output. The working and caring environment should encourage the professionals and patients to speak up freely without fear of retribution. People want to report risks and safety incidents in order to learn from them in that kind of environment. It is important to create an environment where people understand that incidents are caused largely by system failures rather than by individuals [12]. Moreover, employees’ well-being, safety and patient safety should be seen as a result of the organisation’s safety culture [4].

Safety culture in the EMS setting has previously been studied by using the Emergency Medical Services Safety Attitudes Questionnaire (EMS-SAQ) [13,14,15]. There is some evidence that the safety outcomes and the safety culture experienced by EMS workers, patients and providers are interrelated. Weaver et al. found that respondents who reported injuries evaluated their safety culture lower than those who did not report injuries. Respondents who reported an error or an adverse event (AE) also evaluated their safety lower than those who did not. Respondents who reported safety-compromising behavior evaluated their safety culture as lower [16]. However, a limited number of safety culture studies have been performed on EMS worldwide, and the EMS-SAQ has never been used to study the safety culture in the Finnish EMS. Therefore, this study aims to test the psychometric properties of EMS-SAQ in a Finnish EMS setting; in addition, we explore the connections between individual- and organisation-based characteristics and safety attitudes in the Finnish EMS setting.

Methods

Study design and instrument

We used a cross-sectional survey design and collected the data using the EMS-SAQ (see Additional File 1). We enquired about receiving permission to use the EMS-SAQ instrument from Ph.D. Patterson. Patterson et al. developed the EMS-SAQ by modifying the Intensive Care Unit Safety Attitude Questionnaire (ICU-SAQ) to be suitable to the EMS setting [14]. Based on the ICU-SAQ [17], the EMS-SAQ has 30 core items. Those items characterise six safety culture domains: (1) safety climate (seven items), (2) job satisfaction (five items), (3) perceptions of management (four items), (4) teamwork climate (six items), (5) working conditions (four items) and (6) stress recognition (four items). Respondents answer every question by using a 5-point Likert scale (1 = Disagree strongly, 2 = Disagree slightly, 3 = Neutral, 4 = Agree slightly, 5 = Agree strongly).

The psychometric-tested Finnish version of the EMS-SAQ comprises 59 questions. Fifty items concern the safety culture in the EMS, four items cover the respondents’ characteristics (age, gender, education level, working experience), and five questions concern organisation-based characteristics (position type, employment status, shift length, employer status and which catchment area for highly specialized medical care the participant works in). Additional file 1 presents the questionnaire we used. We followed the Checklist for Reporting Results of Internet E-Surveys (CHERRIES) to enhance the quality and transparency of this web survey study [18].

EMS-SAQ translation into Finnish

Double blind forward and back translations were used to translate the original English version into Finnish [19]. The translated version was then evaluated by four EMS personnel to pretest the clarity of the EMS-SAQ Finnish version. One question’s word order was adjusted based on their oral feedback to the researcher.

Setting

Finland has 21 different hospital districts responsible for organizing the EMS. They can provide the EMS by themselves, or they can purchase the EMS from another party, for example, from a rescue department, other hospital districts or the private sector [20]. The EMS include advanced level and basic level ambulances. Advanced level ambulances are manned with least one prehospital emergency care nurse or a registered nurse (RN) with 30 European Credit Transfer and Accumulation System (ECTS) study points of prehospital emergency care studies (Bachelor’s level education). The basic level ambulance must be manned by at least one person who is a health-care professional with a vocational education that includes emergency medical training, i.e., Emergency Medical Technician (EMT), practical nurse, firefighter/rescue worker. A master’s degree is not a requirement in any of the work tasks in a Finnish EMS [21]

Every hospital district should have an EMS officer and an EMS medical director in accordance with national regulations. The EMS officer is an operational supervisor of the shift and participates as a leader in challenging tasks and mass casualty situations. The EMS medical directors’ responsibilities are to prepare service standard decisions, participate in preparedness planning with other authorities, write out EMS prescriptions, give guidance to the emergency response centers regarding how to dispatch the EMS units and to confirm the EMS workers’ treatment obligations [21]. The EMS organisations also have managers and/or supervisors who are responsible for human resource management, for example. There are presently no regulations concerning EMS supervisors’ or managers’ educational levels.

Five university hospitals are responsible for providing all highly specialised medical care services required within their catchment areas [20]. The university hospital areas coordinate the EMS performance in their hospital districts regarding the local special features, develop the EMS together nationally with the other university hospital areas, and promote scientific research. Furthermore, all university hospital areas are responsible for having an EMS medical doctor available 24/7 in least one location in their area. The physician’s responsibility is to lead the EMS operational situations in the area together with the EMS officers [21]. Table 1 presents Finland’s geographical size, population, number of full-time EMS personnel and annual number of EMS calls (total and between the catchment areas).

Table 1 Finland’s geographical size, population, number of full-time Emergency Medical Service (EMS) personnel and annual number of EMS calls (total and between the catchment areas)

Data collection, participants and sample size

Data were collected between 5th of December 2019 to 5th of January 2020 by sharing the web-based survey link (Webropol®) to the questionnaire in social media (Facebook® and Instagram®). Social media have been previously shown to be an effective way to collect data in health, medical and social research [22, 23]. The link was posted to the one Facebook® group and the two Facebook® pages with links to Instagram®. Members in those groups are mainly EMS professionals, or they have a special interest in EMS, or they are EMS stakeholders. However, not everyone who is active in these social media channels works in the EMS field. Therefore, we informed them that this questionnaire is intended for those people who are working full time or part time in EMS. No incentives were distributed to the participants.

A data protection statement and information about the study’s purpose were shared to the participants with the questionnaire. Answering the survey was considered consent to participate in the study. Therefore, the need for written informed consent was waived because of the study design. Answering the survey was voluntary, and the participants had the right and possibility to withdraw from the study by suspending their answering or by selecting not to send the answers [24,25,26].

The sample size calculation for multiple factors analysis research should be at least 10 times the number of items [27, 28]. Therefore, the minimum acceptable sample size in this study was 300.The invitation to participate in the study reach 6196 people, 954 of whom opened the link to the questionnaire; 418 started to respond and a total of 333 people completed the survey. The response rate can be calculated by dividing the number of people completing the questionnaire by those who viewed it [29]. It is reasonable to assume a response rate of 34.9% using this calculation.

Statistical analysis

Confirmatory factor analysis (CFA) was carried out to validate the EMS-SAQ in a Finnish setting. Missing values were imputed with the median, which is acceptable when only a small number of values are missing [30]. Missingness varied from 0% (22 questions) to 0.9% (“Q18”). Normality was screened using normality plots of histogram and kurtosis/skewness values [31]. We found in 18 variables indications of nonnormality (kurtosis or skewness values larger than ± 1). The maximum likelihood (ML) with 1000 bootstrapped replications was used because of the nonnormality [27]. We used comparative fit index (CFI); Tucker–Lewis index (TLI)/non-normed fit index (NNFI) and the root-mean-square error of approximation (RMSEA) to assess fit. Following the recommendation by Hair [32], the criteria were set to evaluate the adequacy of the model as CFI > 0.90, NNFI > 0.90, and RMSEA < 0.07. The modification indices (MI) were examined to identify any additional adjustments. The reliability level was set at ≥ 0.7 using Cronbach’s alpha [33].

The 5-point Likert scale was converted to a 100-point scale, where 0 = Disagree strongly, 25 = Disagree slightly, 50 = Neutral, 75 = Agree slightly, 100 = Agree strongly. Two questions (SC4 In this EMS agency it is difficult to discuss errors & TWC2 At this EMS agency, it is difficult to speak up if I perceive a problem with patient care) were reverse coded in the analysis to match the other questions. In line with prior studies, [14, 15, 17] dichotomized the safety culture domain scores as a “positive” (≥ 75) and “non-positive” (< 75). Therefore, the respondents should have answered with an average of Agree Slightly or higher to count as positive. The connections between individual- and organisation-based characteristics and safety attitudes in the Finnish EMS were tested by using appropriate nonparametric tests. The statistical significance level was set at 0.05. P-values have been adjusted by the Bonferroni correction for multiple tests. SPSS AMOS 25.0 was used for the CFA, and IBM SPSS version 25.0 for other statistical analyses.

Results

Respondents

The total sample size was 333. The final sample size was 327 after omitting six responses because of divergent shift length (three-shift, day job). Table 2 presents the respondents’ demographic information.

Table 2 Characteristics of participants

Finnish EMS-SAQ validity and reliability results

According to the chi-square test of model, fit was significant (χ2 = 828.471, degrees of freedom (df) = 390, p = 0.000). RMSEA was 0.059, also suggesting good fit, but the results from CFI (0.896) and TLI (NNFI) (0.884) indicated a slight lack of fit. Factor loadings ranged from 0.86 to 0.42. The correlations between five out of the six factors were high (0.84—0.97). Stress recognition has a negative correlation among the other factors (-0.16 to -0.21). Figure 1 presents the original CFA model with correlations between the safety culture domains and items factor loadings.

Fig. 1
figure 1

Original model with correlations between the safety culture domains and items factor loadings

A better fit was gained by adjusting the model. Based on modification indices (M.I.), two acceptable error terms (questions SC1 I would feel safe being treated by this EMS agency as a patient vs SC4 In this EMS agency it is difficult to discuss errors, and WC1 This EMS agency does a good job of training new personnel vs WC3 Trainees in my discipline are adequately supervised) were allowed to correlate. After adjustments, model fit results were: χ2 790.333, df = 388 p = 0.000, CFI = 0.904, TLI (NNFI) = 0.893 and RMSEA = 0.056.

Total model Cronbach’s alpha was 0.871. Single domains Cronbach’s alpha ranged between 0.851 (Job satisfaction) to 0.660 (Working conditions). Table 3 presents all of the safety culture domains’ reliability results.

Table 3 Variation in safety culture domain scores between the respondent’s characteristic

Connections between individual and organisation-based characteristics and safety attitudes

For the study dimensions (safety climate, teamwork climate, perceptions of management, stress recognition, working conditions and job satisfaction), means and standard deviation scores were calculated for age, gender, education, working level, working experience, employment status, shift length, employer status and catchment area for highly specialised medical care (see Table 3). Total mean scores for each safety culture domain were identified non-positively (< 75), see Fig. 2. A percentage of positive (≥ 75) responses were also calculated. The total percentages for positive responses for each safety culture domain were safety climate 25.4, teamwork climate 26.9, perceptions of management 27.2, stress recognition 37.3, working conditions 18.7 and job satisfaction 51.1 (see Additional File 2).

Fig. 2
figure 2

Total mean scores for each safety culture domains

Gender, age or working experience within the individual characteristics (gender, age, education level, working experience), did not affect variations in safety culture scores. Higher education was connected to a lower teamwork climate and job satisfaction. Master’s educated EMS personnel had a lower score in teamwork climate (p = 0.012) and job satisfaction (p = 0.022) than vocational educated personnel in the pairwise comparisons. None of the individual characteristics had a significant impact on the percentage of positive responses.

Organisation-based characteristics (position type, employment status, shift type, affiliation, working area) were connected to significant variations in safety culture domain scores and the percentage of positive responses on each domain. EMS organisations’ different shift types (24 h/ two-shift/ mix) significantly affected EMS personnel’s views in the teamwork climate, perceptions of management and job satisfaction domain scores. EMS personnel in the pairwise comparisons who work in a two-shift system had a significantly lower score in teamwork climate (p = 0.012), perceptions of management (p = 0.001) and job satisfaction (p = 0.008) than those who work in the 24 h shifts.

EMS personnel’s affiliations (health care district/rescue department/private) had a significant impact on their perceptions of management and working conditions domain scores. Perceptions of management scores in the pairwise comparisons were significantly lower (mean 52.68 vs. 63.03, p = 0.015) for EMS personnel who work in the health-care districts than for those who work in private companies. EMS personnel who work in the health-care districts scored their working conditions lower (mean 49.57 vs. 58.66, p = 0.001) than did those who work in rescue departments.

The working area organisational characteristic created the significant variation between the safety culture domain scores and the percentage of positive responses. The safety climate domain scores had significant variations between the Kuopio University Hospital Districts area and in the Helsinki (p = 0.033) or Oulu (p = 0.046) University Hospital Districts areas in the pairwise comparisons. The teamwork climate domain scores had significant differences between the Kuopio and Oulu University Hospital Districts areas (p = 0.005) and between the Helsinki and Oulu University Hospital Districts areas (p = 0.043). The perceptions of management scores vary significantly between the Kuopio and Turku University Hospital Districts areas (p = 0.015), the Kuopio and Tampere University Hospital Districts areas (p = 0.001), the Kuopio and Oulu University Hospital Districts areas (p = 0.000) and the Helsinki and Oulu University Hospital Districts areas (p = 0.002). Working conditions domain scores had significant differences between the Kuopio and Oulu University Hospital Districts areas (p = 0.013) and the Tampere and Oulu University Hospital Districts areas (p = 0.046). Job satisfaction was lower for EMS personnel who work in the Kuopio University Hospital Districts area than those who work in the Turku University Hospital Districts area (p = 0.019) or the Oulu University Hospital Districts area (p = 0.002).

Discussion

This is the first time, to the best of our knowledge, when this EMS-SAQ instrument has been validated outside of North America. We used the same set of fit indices as Patterson et al. to keep the studies comparable [14, 15]. The CFA results show that the model fit was not entirely optimal with this data collected from Finnish EMS workers. However, the model fit was better with a minor adjustment [32]. On the other hand, reliability scores were close or above the acceptable level (0.7), thus demonstrating good internal consistency of the total model and the individual domains. Therefore, we conclude that the Finnish translation of EMS-SAQ is an appropriate tool for studying safety culture in this EMS setting, even if our CFA results were not as good as in previous EMS-SAQ studies [14, 15]. There also seems to be some variation in SAQ’s CFA results in other health-care settings and different countries [34,35,36,37], and it should be noted that cultural differences could affect the CFA results [38,39,40] in safety culture studies.

Correlations between the safety culture domains were in the same direction as in Sexton et al.’s original SAQ version [17]. The strong correlations shown in the CFA results between the five out of six safety culture domains raise the question of whether it is possible that we could keep strong correlations by improving only one domain with an intervention. Does it have an impact on other safety culture domains if organisations can develop one safety culture domain? For example, if organisations develop their management policies, will the teamwork climate or working condition experience improve at the same time? Measuring EMS personnel’s safety attitudes makes it possible to identify the safety culture’s strengths and weaknesses and utilize this information for safety culture development. Therefore, we think that this EMS-SAQ tool could help the organisations compare their safety culture before and after the interventions.

Organisation-based characteristics caused most of the significant variations in safety culture domain scores, so it is reasonable to think that the safety culture should be evaluated and developed at the organisational level. Previous research has shown that the organisation climate predicts the team-level climate, which has an impact on behavior [41, 42]. Management commitment to safety was positively correlated with teamwork in a hospital setting [10]. Other than that, another study conducted in Finland stated that the social environment and the paramedics’ role in the working community have a significant role establishing a safety culture in an EMS organization [11]. It would improve the safety culture, more specifically the teamwork climate, if EMS teams in the field could create a psychologically safe [43] teamwork environment. As an example, a previous study has shown improvements in safety climate and teamwork climate scores after interventions. That same study also reported that harm, serious safety events and severity-adjusted hospital mortality has decreased in all hospitals [44].

It was interesting to find that the more highly educated EMS personnel evaluated the teamwork climate and job satisfaction lower than did the less educated EMS personnel. All in all, higher-educated EMS personnel evaluated five out of the six safety culture domain scores (three of them p =  >0.05) lower than less-educated EMS personnel. These findings were not in line with previous studies conducted within EMS-SAQ [15, 16]. The reason is unclear, but it seems that the higher-educated EMS personnel recognise stress slightly better than the less-educated EMS personnel, which was a similar finding in previous studies [15, 16]. The lowest scores for five out of the six safety culture domains could indicate that the higher-educated EMS personnel have lower occupational callings that affect safety climate and safety behavior [12]. In parallel, it is relevant to note that the wellbeing and safety of healthcare providers is also related to patient safety [45, 46]. It is described that education level has a positive influence on the accuracy of primary diagnoses made by paramedics who have a bachelor-level degree in prehospital nursing [47] and on the reduction of the mortality and complication rates for patients in surgical wards [48]. Based on this previous knowledge, an assumption is that higher-educated EMS personnel have better capabilities to evaluate critically all the factors affecting safety culture in the EMS. Furthermore, the lowest scores from the higher-educated personnel in five out of six safety culture domains have not, to our knowledge, been shown before. Therefore, this phenomenon needs more research in the future not only in the EMS setting but also in other healthcare settings. This is especially true because studies conducted with other versions of SAQ have rarely used education level as a background variable.

It is important that organisations evaluate not only direct measures (errors and adverse events) of patient safety but also other subareas of patient safety [7]. Safety culture has clear connections to managements’ actions and perceived perceptions of the safety culture [8, 41]; thus, it is crucial to evaluate how safety culture in the EMS setting affects patient safety from that direction. Employee working commitment has an impact on the safety climate, and the most important factors that impact on working commitment are the supervisors’ ability to recognize a growing climate and the extent to which they allow the climate to grow [41, 42]. The EMS-SAQ should be seen as one tool for EMS supervisors when they evaluate patient safety and plan development measures for their organisations.

Limitations

This study has some limitations. Data collection via social media could be considered a limitation. Reducing the risk of receiving responses from participants outside of our target group meant that we did not share any incentives with the participants. Using social media and a web-based survey as data collection methods could constitute a risk for selection biases, which could limit the results’ generalisability [29]. This study’s selection biases occur as a potentially non-representative nature of the social media population and a possible self-selection bias. Our study’s self-selection bias means that respondents could be those who are interested in or maybe concerned with this topic. However, it has been stated that social media and, more specifically, Facebook, have several advantages, for example costs, time and a snowball effect, when collecting data [22, 23]. Also, previous results suggest that data collected via Facebook is similarly representative to data collected via more traditional methods [23]. The aim of this study was to gain an overview of the prevailing safety culture in Finnish EMS rather than to compare the safety culture between the organisations. Therefore, data collection via social media can be seen as a valid data collection method.

Otherwise, this study has limitations similar to other studies that have collected data via web-based survey [49, 50]. This study has one important selection bias. Firefighters also work in ambulances in most rescue department-based EMS systems. However, a limited number of respondents identified as firefighters, yet firefighters usually work most of the time in rescue units, which could cause a different kind of bias to the results.

Another limitation is that we do not know exact organisational information about the respondents. Therefore, this study is not directly generalisable to the organisational level. However, even though we received responses from all over Finland, one might think that the results’ generalisability could be limited because of the data collection method. This study, despite its limitations, presents one of the important dimensions of the prevailing safety culture in Finnish EMS organisations and in EMS settings with similar prerequisites, but further research is needed.

Conclusions

The EMS-SAQ is a valid tool to evaluate safety cultures in Finnish EMS settings. The EMS-SAQ can offer a new method to evaluate safety and patient safety in EMS settings before and after interventions (for example, large software changes, organisational changes, or changes in the working hours) on both the national and organisational levels. The overview of the Finnish EMS personnel’s safety attitudes was identified non-positively. There was a significant variation in the safety culture scores. Of this variation, the organisation-based characteristics more likely had an impact on safety attitudes than did the individual characteristics. Therefore, the safety culture in the Finnish EMS setting requires more evaluation and development at the organisational level. Enhancing the organisational-level development of the safety culture requires national-level attention by EMS managers and supervisor education.