Nursing Unit Communication During a US Public Health Emergency: Natural Experiment

Introduction

Overview

During the second half of 2014, the Ebola virus disease (EVD) epidemic in West Africa became a global public health emergency. On August 5, 2014, the World Health Organization declared EVD an international public health emergency and the US Centers for Disease Control and Prevention (CDC) elevated its Emergency Operations Center to the highest level [1]. On September 30, 2014, the CDC confirmed the first case of EVD in the United States at a Dallas hospital [2]. A few weeks later, two nurses who cared for the patient with EVD were diagnosed with the disease, the first cases of EVD contracted in the United States [1]. During this time period, we were collecting data for the longitudinal study, Measuring Network Stability and Fit (NetFIT), at three acute care hospitals, two in Arizona and one in Texas. One objective of the NetFIT study was to examine the relationship between nursing unit staff communication patterns and patient outcomes. The EVD public health emergency, during the NetFIT data collection time period, resulted in the occurrence of a natural experiment; participants in some hospital units were exposed to situations not controlled by the investigators.

Background

EVD infection prevention and control presents unique challenges in the health care setting because the virus is present in all body fluids and viral loads increase as the illness progresses [3]. Initial symptoms are similar to common but less serious diseases, so persons under investigation (PUI) for EVD may also pose a risk to health care providers [3]. During the EVD crisis in the United States, press reports often focused on what the nurses who contracted EVD did or did not do that resulted in them becoming infected [4]. Simultaneously, practicing nurses expressed concern about insufficient training and the lack of appropriate personal protective equipment (PPE), which could risk their own personal safety [4]. Shortly after the initial EVD case in the United States, the CDC released new guidelines for PPE and infection control protocols for health care providers caring for PUI or diagnosed with EVD [5]. Nonetheless, many hospitals remained unprepared due to limited training opportunities for staff and PPE availability [6]. Further complicating the situation were quarantine policies, which varied by state, for nurses who had cared for patients with confirmed or suspected EVD. Some policies included up to 21 days in quarantine for nurses who had cared for patients with EVD, resulting in nurses having difficulty balancing their work expectations and personal risk [6].

Safety and quality outcomes and coordination of patient care have been shown to depend on communication among providers in the health care setting [7,8]. Understanding provider communication network characteristics that influence patient outcomes can be an important step toward reducing medical error. Many research methods focus on individual behavior or personality traits, but do not examine interactions between individuals. Social network analysis (SNA) is a research method that supports examination of relationships among individuals, including identification of behavior patterns and the situations in which these patterns arise [9]. In health care, SNA has been widely used to examine provider communication network characteristics. These include patterns of communication on hospital units [10-13] and during patient handoff (ie, transfer of responsibility) between providers during shift change and transfer between units [14,15]. Previous reports from the NetFIT study include the use of SNA to examine the relationship between nursing unit design, staff communication, and patient falls [16] with advice networks, staff information sharing, and patient-safety outcomes [17].

The objectives of the NetFIT study were to examine the structure of nursing unit decision-making and information-sharing networks, identify a parsimonious set of network metrics that can be used to measure the longitudinal stability of these networks, examine the relationship between the contextual features of a unit and network metrics, and identify relationships between key network measures and nursing-sensitive patient-safety and quality outcomes. This paper reports on unit communication and outcome changes that occurred during the EVD natural disaster time period on the 10 hospital units that had data collected before, during, and after the crisis period.

Methods

Setting and Sample

For the NetFIT study, data were collected from nursing staff working on 25 patient care units (PCUs), in three hospitals, and at four data collection points over a 7-month period: Baseline (B), Month 1 (M1), Month 4 (M4), and Month 7 (M7). Data collection was staggered by hospital and unit. One unit was dropped from the analysis due to low patient census and staffing. This resulted in 24 units, 96 data collection points, and 1561 licensed and unlicensed nursing staff members who completed questionnaires. To evaluate the influence of this public health emergency on nursing unit outcomes and communication characteristics, this paper focuses on a subsample of 10 units from two hospitals where data were collected before, during, and after the EVD crisis period. The units included in this analysis are Units 5, 6, and 8 from Hospital A and Units 15, 16, 18, 20, 22, 23, and 24 from Hospital C. No data were collected from Hospital B during the crisis period. Table 1 includes the specific data collection time periods and participant response rates for each unit. This analysis includes 40 data collection points and 608 staff members who completed questionnaires. Participants (N=608) included registered nurses (431, 70.9%), licensed vocational nurses (3, 0.5%), patient care technicians (133, 21.9%), unit clerks (28, 4.6%), and monitor watchers (13, 2.1%). Both hospitals are located in urban settings. Hospital A is a not-for-profit institution and Hospital C is a for-profit institution.

Data Collection

Institutional Review Board (IRB) approval was obtained from the University of Arizona, Texas Woman’s University, the University of Texas at Austin, and the participating hospitals. SNA data collection requires the participants to identify those with whom they have interacted. For that reason, we provided a list of possible contacts—limited to those working on their own units and shifts the day data were collected—for selection by the participants. Our team created a novel data collection system comprised of a secure website, application programming interface, and an Android tablet app. For interested readers, a detailed description of the development and implementation is available [18]. Participants were presented with an IRB-approved study disclosure and consent form at the beginning of the survey. To support participant confidentiality, anonymous IDs were generated by the system and used during the transfer of participant data from the app to the website. Anonymized data could then be downloaded from the website in DyNetML format for network analysis and in standard formats (ie, CSV and XML) for statistical analysis.

For this paper, the starting point for the EVD active crisis period (during) was determined by the date when the first EVD case was diagnosed at a Dallas hospital (ie, September 30, 2014). The end point was set as the date when all contacts of this patient completed the 21-day monitoring period (ie, November 7, 2014) [2]. Table 1 provides an overview of response rates, data collection dates, data collection points (ie, B, M1, M4, and M7), and corresponding EVD time period (before, during, and after) for the 10 nursing units included in this analysis.

Measures

Staff recruitment activities included presentations by research team members during staff meetings and flyers posted on the nursing units. A snack or coupon for a cupcake with a value of US $4.00 was provided to encourage participation. At the end of their shifts, individual attribute (ie, demographic) and SNA data were collected from participating PCU staff working on the designated data collection days. Baseline data were collected on a specific weekday—over a 24-hour period to capture all shifts—and on the same weekday 1, 4, and 7 months later. Network data from individual staff were aggregated to the nursing unit level to create 24-hour networks for network analysis. To create an information-sharing network, participating staff members were asked to identify how frequently they discussed patient care with staff members working on their unit during their just-completed shift. They were also asked how frequently they provided patient care-related information to staff on the next shift or received patient care-related information from staff on the previous shift. To create the decision-making network, staff members were asked how often they sought advice from other staff members, how often other staff sought them out for advice, and to rate their confidence in the advice they received.

Participant characteristics (ie, attributes, also called composition variables) provided contextual information to assist the interpretation of network characteristics [19]. Participants in this study were asked how long they had worked in this hospital and to describe the shift they just worked as normal, better than usual, or worse than usual. In addition, three unit-level safety outcome measures—fall rate, medication errors, and hospital-acquired pressure ulcers (HAPUs)—were collected from the hospital quality-management departments. Fall rate and medication errors were obtained for the month of data collection and defined as the number of falls or medication errors per month divided by patient days, then multiplied by 1000 to create a rate per 1000 patient days. HAPU rates were calculated as the number of HAPUs averaged over the number of patients hospitalized on the unit the day that data were collected.

Data Analysis

SNA is a distinct research method that supports the study of relationships among actors (ie, nursing unit staff) and analysis of relationship patterns [19]. Sociograms (ie, network graphs) provide snapshot images of the relationship between the nodes (ie, staff) within a bounded social system (ie, nursing unit) [20]. SNA supports node- (ie, individual), dyad-, and network- (ie, unit) level analysis [21]. The unit of analysis for this study was the nursing unit (ie, network level). ORA, a network analysis software program, was used for analyzing relational (ie, network) data [22]. Table 2 provides an overview of the specific SNA metrics used for this study [20,22].

Results

Response Rates

On September 30, 2014, when the first patient with EVD in the United States was diagnosed, we had not yet started data collection at Hospital B, but we had completed Baseline and Month 1 data collection at Hospital A. At Hospital C, we had completed Baseline data collection on all 10 units and Month 1 data collection on six of the 10 units. Here we focus on the 10 nursing units with data available before, during, and after the EVD crisis. Table 1 provides the data collection time periods and participant response rates for these units. The units at Hospital A exhibited little change in response rate; in comparison, three units at Hospital C—Units 16, 22, and 24—exhibited major changes in response rate during and after the EVD crisis period. Unit 16 dropped from an 88% (15/17) response rate at Baseline and 95% (18/19) during Month 1 to 77% (13/17) during the active period (M4) and 42% (8/19) during Month 7. Unit 22 dropped from 92% (12/13) at Baseline to 73% (11/15) during the active period (M1) and continued to exhibit poor staff participation during Month 4 (7/14, 50%) and Month 7 (10/15, 67%). By contrast, Unit 24 started with a 92% (11/12) response rate at Baseline, dropped to 58% (7/12) during the EVD crisis period (M1), and 60% (6/10) during Month 4, but recovered for a 90% (10/11) response rate during Month 7.

Safety Outcome Measures

Table 3 provides an overview of patient-safety outcome measures by time period and nursing unit. Examining outcome measures before, during, and after the EVD crisis periods reveals changes in fall rates, medication error, and HAPU rates. Unit 5, 18, and 20 fall rates increased after the EVD active period (Unit 5, 1.53-8.66; Unit 18, 2.04-4.12; Unit 20, 1.96-3.04) and Unit 24 showed an increase during the active period (1.98-3.98). Medication errors increased during the active period on four nursing units (Unit 5, 3.49-7.66; Unit 6, 3.99-12.62; Unit 15, 1.69-3.59; Unit 16, 1.61-4.12). Medication errors continued to increase for Unit 16 (11.28 at Month 7). Unit 24 did not show an increase during the active period (M1) but this unit’s medication error rate doubled during the Month 4 time period (1.99-4.03) and then the medication error rate dropped during the Month 7 data collection (4.03-2.19). HAPU rates increased on two units during the active time period (Unit 15, 0-4.76 and Unit 18, 0-5.88). The Unit 18 HAPU rate returned to zero during the next data collection period at Month 4, but Unit 16 continued to rise (6.67 at Month 7).

Network Measures

The NetFIT study was designed to examine the structure of nursing unit decision-making and information-sharing networks. Here we report on the merging of these two networks, as a total interaction network, and the corresponding network metrics (ie, average distance, clustering coefficient, diffusion, density, weighted density, betweenness centralization, and eigenvector centralization). Table 2 provides metric definitions and Table 4 organizes the results by unit and data collection time period [20,22].

Average distance is a measure of information transfer. Two nursing units had increases in average distance during or after the EVD time period. Unit 20 exhibited an increase in average distance during the Month 1 data collection period, which corresponded with the active EVD time period. Unit 16’s Month 1 data collection corresponded with the active EVD time period, but did not show an increase in average distance until the Month 7 data collection period.

The clustering coefficient metric provides information on network characteristics, such as how information spreads between employee groups. A higher metric indicates a decentralized infrastructure and local information diffusion. Standard deviations for each metric, by nursing unit, were calculated using the four data collection time period results (see Table 4). Standard deviation results (0.02-0.11) indicate minimal change during the longitudinal data collection period. The diffusion metric calculates the degree to which something can be spread throughout the network, based on the distance between the nodes (ie, staff). A higher value indicates that nodes are closer to each other [20,22]. The units at Hospital A exhibited consistent diffusion metrics before, during, and after the EVD active period. Hospital C had one unit that was consistent and six units that exhibited changes in diffusion values during and/or after the active EVD period. Units 18, 22, and 24 had decreases in diffusion during and after the EVD time period, while Unit 20 had a decrease in diffusion during the EVD time period. Unit 16 had an increase in diffusion during the EVD time period that dropped afterward, while Unit 23 had an increase in diffusion during the EVD time period but then returned to baseline. Specific metrics are shown in Table 4.

Density is the ratio of all possible links in the network and weighted density indicates the strength of the connections based on how often individual staff indicated they communicated with one another. On nursing Unit 16, the during EVD time period coincided with Month 1 of data collection. Density and weighted density decreased during Month 4 and continued to decrease for Month 7 (see Table 4). This indicates a decrease in both the number of connections (ie, links) between staff and the frequency of those connections. The remainder of the units included in this analysis exhibited consistent density and weighted density measures. Betweenness centralization helps identify how dependent the network is on specific providers, while high eigenvector centralization indicates that a small group of staff members are densely connected [20,22]. Both of these measures were consistent for all 10 units before, during, and after the EVD time period.

Discussion

Principal Findings

Individual respondent characteristics, environment, and the timing of data collection have been shown to influence response rates [23]. Researchers studying the relationship between stressors and survey response behavior have proposed that participation in employee surveys is a form of organizational citizenship behavior and is associated with perceptions of organizational support [24,25]. Overload, including perceptions of time availability, has also been associated with completion of surveys [24,25]. Of particular interest when examining reduction in response rate by hospital employees during a public health emergency is the influence of role ambiguity and role conflict [24]. In the same city as Hospital C, two nurses caring for the patient with confirmed EVD contracted the disease despite following CDC and hospital guidelines [6]. Research exploring nurses’ perceptions of caring for patients with EVD or PUI revealed that nurses were fearful of contracting EVD or transmitting it to their families or other patients and lack of training in infection control protocols led to lack of confidence in hospitals [6,26]. Consequently, it is not surprising that units at Hospital C, located in the same city where the first patient with EVD was identified, exhibited major changes in response rate during this time period.

Understanding the negative changes in patient safety outcomes that occurred during the EVD public health emergency also requires examination of corresponding changes to the hospital work environment. The hospital work environment has been shown to influence patient safety outcomes, including rates of falls, medication errors, and HAPUs [27-29]; structural and psychological empowerment of nurses has been shown to support a culture of patient safety [27], which supports positive patient outcomes. Job strain reduces structural and psychological empowerment and is the result of situations in which the nurse has little control [30], such as the EVD outbreak and the resulting psychological demands.

Communication among providers has been shown to influence patient safety outcomes [7,31]. Research has shown that SNA is a viable way to examine these relationships [10]. Consistent with response rate and patient outcome measure results, the network metrics reveal changes in communication patterns for multiple units at Hospital C. Average distance, diffusion, and density metrics exhibited the most variability during and after the EVD crisis period and reflect changes in communication and network structure on six Hospital C units: 16, 18, 20, 22, 23, and 24. Figures 1-4 provide images of Unit 16 at all four data collection points. Interestingly, Unit 16 is the only unit that had changes in all three metrics—average distance, diffusion, and density—and also showed increases in medication errors during and after the active period, ranging from 1.61 at Baseline and Month 1 to 4.61 at Month 4, followed by 11.28 at Month 7.

Limitations

Retrospective recognition during data analysis that a natural experiment had occurred may be viewed as a study limitation. Generalizability of the findings is influenced by the specific hospital characteristics and inclusion of only 10 units at two hospitals. We recognize that additional factors, such as unit culture or other local events concurrent with the EVD outbreak, may have influenced the nursing unit network communication patterns and unit outcome measures. However, we had not planned to measure unit culture in the larger study and were unable to measure culture and other possible factors retrospectively.  Although additional research is needed, the viability of using social network analysis to study how external events influence communication and patient outcomes is promising.

Conclusions

This paper reported on a natural experiment that occurred during data collection for a longitudinal study designed to explore nursing unit communication patterns through the use of social network analysis. The natural experiment occurred when the first case of EVD in the United States was diagnosed in a hospital blocks away from one of our data collection sites. Findings presented in this paper focused on the 10 units that had data collection results available before, during, and after the EVD crisis period. Units in the hospital site in the same city as the EVD case exhibited negative changes in patient outcomes, network communication metrics, and response rates.

‎View this figure

‎View this figure

‎View this figure

‎View this figure