Validation of the Korean Ford Insomnia Response to Stress Test Questionnaire
Article information
Abstract
Background and Objective
This study aimed to examine psychometric properties of the Korean Ford Insomnia Response to Stress Test (K-FIRST). The FIRST measures personal vulnerability of sleep difficulties in response to stressful events.
Methods
377 participants (mean age = 21.80 ± 2.91 years, 76.9% female) completed online surveys about demographic information, sleep reactivity (K-FIRST), insomnia (Insomnia Severity Index, ISI), perceived stress (Perceived Stress Scale, PSS), and depression (Center for Epidemiological Studies-Depression Scale, CES-D). Exploratory factor analysis was conducted to determine the factor structure of the K-FIRST.
Results
K-FIRST showed adequate internal consistency (Cronbach’s α = 0.85) and significant goodness of fit test result (χ2 = 1386.33, p < 0.001). A two-factor structure was selected as a result of the factor analysis, with rumination and worry as the two factors. K-FIRST was significantly associated with the ISI (r = 0.35, p < 0.01), PSS (r = 0.30, p < 0.01), and CES-D (r = 0.42, p < 0.01).
Conclusions
The results of this present study supported the reliability and validity of K-FIRST. It is expected that the K-FIRST can be used in future research in investigating personal vulnerabilities that may predispose individuals to sleep disturbance.
INTRODUCTION
The prevalence of insomnia has been increasing in Korea, with more than one of five Koreans reporting insomnia symptoms [1]. There are many theories and models that explain onset and maintenance of insomnia. According to the 3-P model of insomnia, there are predisposing, precipitating, and perpetuating factors [2]. Precipitating factors trigger sleep disturbance or acute insomnia that could be a stressful life event. However, everyone who experiences stress does not experience sleep disturbance. This difference could partially be explained by predisposing factors, which can be defined as personal vulnerabilities that are present prior to the onset of insomnia [2,3].
Sleep reactivity is defined as a vulnerability that increases the likelihood of sleep disturbance when exposed to variety of stressful situations, and it has been reported to be influenced by genetic and environmental factors [4,5]. Drake and his colleagues [6] have found that individuals with high sleep reactivity reported higher levels of sleep disturbance following stressful events compared to those with low sleep reactivity.
The Ford Insomnia Response to Stress Test (FIRST) is a self-report measure developed to measure sleep reactivity, including items that assess the extent that one suffers from sleep difficulty following stressful life events [4]. The FIRST has been used in various studies with many clinical populations, such as shift workers, elders, and young adults, and also in various countries [4,6–12].
The current study aimed to validate the Korean version of the FIRST (K-FIRST) by investigating the internal reliability, factor structure, and convergent and discriminant validity. Also, this study also investigated associations of sleep reactivity with insomnia severity, depression, and stress level dependence on high and low sleep reactivity.
METHODS
Participants and Settings
Participants for the study were recruited through classroom announcements and online advertisements between 2016 and 2017. A total of 384 consenting participants completed online self-report questionnaires. The Institutional Review Board at Sungshin Women’s University approved the study (SSWUIRB 2016-027, SSWUIRB 2016-063, and SSWUIRB 2017-016) and all participants signed a consent form before participating in the study.
Measures
FIRST: FIRST is a self-report instrument assessing vulnerability to sleep disturbances in response to nine stressful life events [4]. All items are rated on a 4-point Likert scale ranging from “not likely (1)” and “very likely (4).” The total score ranges from 9 to 36, with higher scores indicating greater vulnerability to sleep disturbances. For the current study, the original version of FIRST was translated and back translated in Korean by two independent individuals who were bilingual.
Insomnia Severity Index (ISI): The ISI is a 7-item self-report measurement that assesses insomnia severity asking about perceived insomnia severity and functional impairment in the past two weeks [13]. The ISI uses items rated on a 4-point Likert scale ranging from 0 to 4, with total scores ranging from 0 to 28. Higher scores reflect more severe symptoms of insomnia. The present study used ISI in Korean, which was translated by Cho et al. [14].
Perceived Stress Scale (PSS): The PSS measures perceived stress levels in the past one month [15]. Each 10 items respond to a 5-point Likert scale, with higher scores reflecting higher perceived stress. The total score ranges from 0 to 40. The PSS translated by Lee and Lee [16] was used in this study.
Center for Epidemiologic Studies Depression Scale (CES-D): The CES-D is a self-report questionnaire that measures behaviors and cognitions associated with depression in the past week [17]. The questionnaire consists of 20 items, with items scored on a 4-point Likert scale. Total scores ranges from 0 to 60; higher scores indicates higher depression level. This study used a Korean version of CES-D, which was validated and revised by Chon et al. [18].
Data Analysis
Data was analyzed using SPSS 21.0 (IBM Corp., Armonk, NY, USA). Factor analysis was conducted by Mplus 7.11 (Muthen & Muthen, Los Angeles, CA, USA). First, descriptive statistics using mean, standard deviation and frequency analyses were conducted to analyze participant characteristics.
Cronbach’s α was used to calculate internal consistency. Additionally, correlation coefficients were calculated between K-FIRST, ISI, PSS, and CES-D. T-tests were used to compare the high and low sleep reactivity groups. The cut-off score of FIRST was 16 divided into groups [19]. Before performing factor analysis, sampling adequacy was verified using Bartlett spherical test and Kaiser-Meyer-Olkin test (KMO). Exploratory factor analysis (EFA) with maximum likelihood was used, and factors were rotated using Geomin. Geomin is one of the oblique rotations that minimizes variable complexity [20,21]. To assess adequate fit of data for EFA, this study followed the following standard recommendations. If the Comparative Fit Index and Tucker Lewis Index values are above 0.95, it is considered an excellent adequate fit. Less than 0.08 of root mean square error of approximation and ≤ 0.10 of standardized root mean square residual presents a good fit [22,23]
RESULTS
Demographic and Clinical Information
377 participants (mean age = 21.80 ± 2.91 years, 76.9% female) completed the questionnaire. The majority of participants were students. Demographic information is presented in Table 1.
Participants were divided into two groups (high and low sleep reactivity) based on their FIRST score, using a cut-off score of 16 [19]. Among the sample, 259 participants (21.49 ± 2.80 years, 82.2% female) were classified as the high sleep reactivity group, and 118 participants were classified as the low sleep reactivity group (22.49 ± 3.04 years, 65.3% female). Participants in the high sleep reactivity group had significantly higher scores on the ISI, PSS, and CES-D compared to the low sleep reactivity group (p < 0.001) (Table 1).
Reliability of the FIRST
The internal consistency of the FIRST was adequate (Cronbach’s α = 0.85), indicating that the scale was homogenous. All items correlated significantly with the full scale (range 0.22–0.80, p < 0.01) (Table 2). Also, the self-reported instrument of ISI, PSS, and CES-D’s Cronbach’s α range was 0.60–0.80 (Table 3).
Validity of the FIRST
The Bartlett spherical test was significant (χ2 = 1386.33, p < 0.001) and the KMO was 0.87. According to these results, factor analysis was determined to be appropriate. EFA was conducted using maximum likelihood estimation. According to the scree plot and eigenvalue, the Korean version of the FIRST, suggested single- or two-factor model. The two-factor model demonstrated better goodness-of-fit indices compared to the one-factor model (Table 4). Based on goodness-of-fit indices, the K-FIRST adopted a 2-factor structure in which all items showed factor loading estimates after Geomin rotation were 0.4 or greater except on item Q5.
In this case, Q5 should be deleted from the FIRST; however, Q5 was kept to compare the total score time with the original FIRST. Items Q2–Q4 and Q6–Q7 were loaded on the first factor, whereas items Q1 and Q8–Q9 were loaded on the second factor (Table 5).
The correlation between factor 1 and 2 was 0.43, indicating a statistically significant yet independent relationship since the correlation did not exceed 0.85 (Table 6) [24,25].
Association of the K-FIRST with Other Measures
There were significant correlations between the K-FIRST with ISI, PSS, and CES-D measures (p < 0.001). High K-FIRST group showed higher scores of ISI, PSS, and CES-D than low K-FIRST.
DISCUSSION
The current study aimed to validate the Korean version of the FIRST. This study validated the FIRST in a Korean sample of young adults and investigated the associations between K-FIRST and insomnia severity, perceived stress, and depression.
In this study, K-FIRST demonstrated adequate internal consistency, and reliability data was similar to other validation studies of the FIRST. EFA results also indicated that K-FIRST supported a two-factor model compared to a single factor model for the K-FIRST. Since the FIRST was developed, it has been validated in various countries such as Japan, Italy, and Portugal etc. [4,10,12,26]. The factor structure of the FIRST has varied across countries. While the original FIRST yielded a 1-factor model, subsequent validations of the FIRST have found the FIRST to support a multi-factor model. While the Japanese version of the FIRST supported the 1-factor model similar to the original version, the Portuguese version reported a 2-factor model (rumination and worry); the Italian version of FIRST extracted three components that metacognitive beliefs could be related to sleep reactivity [10,12,26]. The reasons for differences in various factor structures are unclear, but likely due to heterogeneous methodology and cross-cultural factors. For the K-FIRST, the items loaded on similar factors as the Portuguese version. In particular, item Q5 did not load in both Korean and Portuguese versions of FIRST, likely due to both samples being mainly college students [12]. Unlike the Korean and Portuguese studies, the original and Japanese version participants mean ages were mainly middle-aged [4,10]. Additionally, according to Taylor and his colleagues [27], cultural difference could have also affected the results.
Worry and rumination were distinguished from K-FIRST items as a two-factor model. The K-FIRST validated as two-factor model in this study and it was similar outcome to the Portuguese version of the FIRST, which also yielded a two-factor model, labeled rumination and worry (worry = Q1, Q8, and Q9; rumination = Q2, Q3, Q4, Q6, and Q7). Rumination is related to thinking about stressful events after they have happened. In comparison, worry activates before experiencing a stressful event. The concepts of rumination and worry, while related, are usually viewed as independent constructs and considered as part of repetitive thought process [28]. Maladaptive metacognitions about repetitive thought is one of mechanisms to maintain repetitive thoughts that are related to both rumination and worry [29,30]. Sleep disturbance is related to cognitive arousal that is explained by repetitive thoughts, and rumination and worry are often present that prolongs sleep onset latency [30,31]. Several studies which informed participants that they had to give a speech upon waking before they go to bed increased worry in participants, which led to sleep disturbances [30,32–34]. Thus, worry is often associated with future events. In contrast, there was a study showed people with higher trait rumination experienced more sleep disturbance than lower people, and frequently thought content is associated with rethinking past events [30,35]. Findings from validation studies of FIRST were supported by previous studies. Based on past studies, the FIRST score was significantly correlated with rumination and closely related with metacognitive beliefs about sleep.
This study divided participants into high and low sleep reactivity groups, similar to previous studies [4,10,12]. Results indicated that high sleep reactivity group reported higher insomnia severity, perceived stress, and depression than low sleep reactivity group. These results are consistent with previous studies and reflect that people with high sleep reactivity may frequently experience severe sleep disturbance, more stress, and undergo greater depression symptoms.
Limitations
This study has several limitations. First, only self-report questionnaires were used measuring insomnia and other clinical indices. Thus, it is necessary to use objective sleep measures like actigraphy in future studies. Second, the results could be difficult to generalize due to the homogeneous nature of the sample. In this study, the proportion of women was high. Finally, the present study did not test test-retest validity, and thus may have been difficult to ascertain sleep reactivity as a personal trait compared to state in this study.
Conclusion
In conclusion, this study aimed to establish the psychometric properties of FIRST in a sample of Korean population. Our findings showed that the K-FIRST demonstrated good reliability and validity. The K-FIRST was validated as two-factor model unlike the original version, with rumination and worry as the two prevailing factors. It is expected that the K-FIRST can be used in future research in investigating personal vulnerabilities that may predispose individuals to sleep disturbance.
Acknowledgments
This work was supported by Sungshin University Research Grant of 2017 (2017-1-29-007).
Notes
Conflicts of Interest
The authors have no financial conflicts of interest.
Authors’ Contribution
Conceptualization: Chang J, Suh S. Data curation: Chang J, Suh S. Formal analysis: Chang J. Methodology: Chang J, Suh S. Writing—original draft: Chang J. Writing—review & editing: Suh S.