Skip to main content

Evaluation of the psychometric properties of a modified version of the Social Phobia Screening Questionnaire for use in adolescents

Abstract

Background

Social phobia (social anxiety disorder - SAD) is a rather common but often undetected and undertreated psychiatric condition in youths. Screening of SAD in young individuals in community samples is thus important in preventing negative outcomes. The present study is the first report on the psychometric properties of the Social Phobia Screening Questionnaire for Children and adolescents (SPSQ-C).

Methods

The SPSQ-C was administered to a community sample of high-school students. Test-retest reliability over three weeks was evaluated (n = 127) and internal consistency was calculated for items measuring level of fear in eight social situations. To measure concurrent validity, subjects who reported SAD on at least one occasion and randomly selected non-cases were blindly interviewed with the Structured Clinical Interview for DSM-IV Axis-I disorders (SCID-I), as gold standard (n = 51).

Results

A moderate test-retest reliability, r = .60 (P < .01), and a satisfactory alpha coefficient of .78 was found. Values of sensitivity and specificity were 71% and 86% respectively, and area under the curve (AUC) was .79. Positive likelihood ratio (LR+) showed that a positive screening result was five times more likely to be correct than to reflect a non-case. Negative likelihood ratio (LR -) was .34. In addition, positive predictive value was 45% and negative predictive value was 95%. The prevalence of self-reported SAD was found to be 7.2% at the first assessment.

Conclusion

The SPSQ-C is a short and psychometrically sound questionnaire for screening of SAD in adolescents, with the advantage of being based on the DSM-IV criteria.

Background

Social anxiety disorder, also called social phobia, is a rather common anxiety disorder in adolescents, though prevalence rates are varying due to methodological and cultural reasons as well as due to what age groups are studied [14]. For many young sufferers, it is a disabling condition associated with a significantly increased risk for negative outcomes like dropping out from school [5], depression and suicide [6, 7], alcohol use disorder [8] and cannabis dependence [9].

Even though effective psychosocial and pharmacological treatments for childhood SAD exist [1013] help-seeking is low [4, 14, 15]. Children are usually referred to mental health service via parents but SAD is rarely recognized by parents and teachers [16] and mental health referral and treatment utilization is lower in anxiety disorders than in externalizing disorders in children and adolescents [17, 18]. If help is sought, identification of symptoms needs to take place before treatment can be offered. While SAD is common in primary care populations, it is often not detected by primary care providers [19]. The use of a reliable and valid, brief screening instrument in primary care paediatric settings can facilitate the detection of SAD in adolescents [20]. According to the Practice parameters for anxiety disorders in children and adolescents [21], routine screening for anxiety symptoms is recommended during the initial mental health assessment due to the high prevalence of anxiety disorders. Also, given the high rates of comorbidity among anxiety disorders, there is a need to correctly identify the primary diagnosis, and rule out phenomenologically similar conditions that may be of importance for treatment selection [22]. The Practice parameters recommend that screening questions are based on DSM-IV criteria [23] and use developmentally appropriate language.

There are a few psychometrically evaluated self-report instruments for use in the assessment of SAD in children and adolescents. The most widely used and well established instruments are the Social Anxiety Scale for Children - Revised (SASC-R) [24], the Social Anxiety Scale for Adolescents (SAS-A) [25] and the Social Phobia and Anxiety Inventory for Children (SPAI-C) [26]. The SPAI-C has also been evaluated in a shorter 16-item version [27]. In addition, the Screen for Child Anxiety Related Emotional Disorders (SCARED) [28] can be used for the assessment of social anxiety disorder in children. The Social Phobia Inventory (SPIN) [2931] has a more categorical format and has primarily been used with adolescents. The SPIN and the SPAI-C have been developed from instruments that have been used in adults, as well as an established Swedish screening instrument for use in adults, the Social Phobia Screening Questionnaire (SPSQ) [32]. The SPSQ has shown excellent psychometric properties, showing a sensitivity of 100% and specificity of 95%, and has been used in several epidemiological and treatment studies on adults [3237]. The SPAI-C mentioned above, has been translated and evaluated in a Norwegian sample [38], but to date there is no validated instrument for screening of social anxiety in Swedish children and adolescents. In backdrop of the need of a brief, DSM-based screening questionnaire for use with Swedish children and adolescents, a modified version for children and adolescents, the Social Phobia Screening Questionnaire for children and adolescents (SPSQ-C), has been developed and used in epidemiological and descriptive studies of children ranging in age from twelve to eighteen years [1, 39].

While the SPSQ-C is a time-efficient and potentially useful instrument based on DSM-IV criteria, it has yet to be psychometrically evaluated. Thus, the objective of the present study was to report preliminary results of the psychometric properties of the SPSQ-C in a community sample of high-school students. Reliability was investigated by test-retest analysis over a three-week period and by calculating internal consistency for the first eight items of the SPSQ-C, covering level of fear in different social situations. Concurrent validity, i.e. sensitivity and specificity of the questionnaire, was evaluated using the Structured Clinical Interview for the DSM-IV Axis I-disorders (SCID-I) [40] as gold standard.

Methods

Procedure

Data were collected on three occasions. On the first two, the SPSQ-C was used for the purpose of evaluating reliability and on the third occasion a clinical interview was used for establishing concurrent validity.

Two weeks before the investigation took place written information about the study were mailed to students and their parents. The students were also informed about voluntary participation at all three assessments. Data-collection for the reliability evaluation was done at the classes' weekly class-council. Students signed written consent, completed the screening questionnaire and answered additional questions regarding socio-demographics. The same procedure, with the same classes of students, was used three weeks later. As a compensation for their participation, the students had a chance of winning a ticket to a movie in a lottery that was conducted in each class after all students had completed their questionnaires at the first and second assessment.

A case-control design was adopted for the evaluation of validity. The procedure of a case-control study starts with the selection of known cases and then an appropriate number of controls are selected [41]. One week after the last assessment, adolescents meeting the criteria for social phobia according to the SPSQ-C, were selected if they had reported SAD on at least one occasion except if reporting SAD at the first assessment but not the second. Non-cases were randomly selected for the control group.

The clinical interview was conducted by telephone by two interviewers who were blind to the participants' diagnostic status on the SPSQ-C. A telephone format was chosen due to that many of the students were living in geographically distant areas, leading to transportation difficulties. Telephone administration of structured clinical interviews has been found to yield reliable, valid and time-effective data in the assessment of anxiety disorders in children [42]. Subjects were compensated for their participation in the interview, by movie-tickets. The study was approved by the local ethics committee.

Subjects

Total sample

Subjects were recruited from a compulsory high school, in a small municipality (12 000 inhabitants) in the south middle of Sweden. The students were following the high school Social Science Programme or the Child Recreation Programme. These two programmes were chosen in order to have students from a theoretically oriented and a practically oriented programme.

In order to obtain a sample of ten subjects reporting SAD, as a minimum for the statistical analyses, a convenience sample of 180 subjects from eight classes (year 1-3) was selected. The size was due to an estimated prevalence rate of 4-14% of SAD in adolescents [1, 2, 14, 43] and an expected absent rate of 10-15% on one school day [44]. The response rate at the first assessment was 85% and 79% at the second, resulting in a total of 169 subjects participating at any of the assessments. The subjects in the total sample were in the 1st (n = 62), 2nd (n = 67) and 3rd (n = 40) year of studies. Mean age was 16.8 years (range 15-18 years). See Table 1 for further demographics of the total sample.

Table 1 Socio-demographics of the total sample (N = 169).

Reliability sample

At the first assessment (n = 153) 89 boys, (58%) and 64 girls (42%) participated and at the second assessment (n = 143), 88 boys (61%) and 55 girls (39%). A total of 127 subjects participated at both measurements with the SPSQ-C and data from these subjects were used for the analysis of test-retest reliability.

Validity sample

In the present study a sample size of fifty subjects was chosen in order to have enough power for the evaluation of validity. Thirteen subjects reported SAD at both assessments or at one if only participating at one occasion and were eligible for the validity study (6/13 subjects had participated at both assessments and seven at one assessment). In order to get a sample of fifty subjects, thirty-eight non-cases were blindly and randomly selected by a person who was not involved in the project. A total of fifty-one subjects (26 males and 25 females) were interviewed. Seven subjects declined to participate and were substituted by the next numbered subject on the list for randomized selection. Non-responders consisted of one subject who reported SAD on the SPSQ-C and seven subjects who had not reported SAD. The non-responders were all male from the second year of their social science studies.

Instruments

The Social Phobia Screening Questionnaire for Children and adolescents (SPSQ-C)

The SPSQ-C is a modified version of the Social Phobia Screening Questionnaire (SPSQ) for adults [32]. The SPSQ has shown satisfactory psychometric properties; an alpha coefficient of .90 concerning the section with fear ratings and high values of sensitivity and specificity [32].

The diagnostic section of the SPSQ-C is based on 8 potentially phobic situation: "speaking in front of the class", "raising your hand during a lesson", "being together with others during breaks", "initiating a conversation with someone one does not know very well", "looking someone in the eyes during a conversation", "making a phone-call to someone one does not know very well", "going to a party", and "eating together with others during the lunch-break". The respondents rate their perceived social fear in these potentially phobic situations on a three-point scale corresponding to no fear, some fear, and marked fear. Five diagnostic questions follow, assessing whether the individual meets the DSM-IV social phobia criteria A, B and D for one or more of the phobic situations. Since the instrument is developed for adolescents up to the age of 18, the C-criteria, realizing that the fear is excessive or unreasonable, does not have to be fulfilled. The E-criterion is assessed with three yes/no questions, i.e. the student is asked whether the social fear is of such nature that it severely interfere with or severely interfered with his/her activities in school, during leisure-time or when being with peers. The last question covers the F-criterion of 6-month duration (yes/no question). Criteria G (the fear is not due to direct physiological effects of a substance or medical condition, and not better accounted for by another mental disorder) and H (if a general medical condition or another mental disorder is present, the social fear is unrelated to it) are not assessed.

In order to establish a diagnosis of SAD on the SPSQ-C, i.e. a probable case of SAD, the student had to rate at least one potentially phobic situation as "marked fear" on the social fear scale. This particular situation had to be consistently endorsed in the diagnostic questions covering social phobia criteria A, B and D. The E-criterion had to be met, i.e. the report of impairment in at least one of the three life domains assessed. Lastly, the F-criterion, concerning persistence of symptoms for more than six months, also had to be fulfilled.

The SPSQ-C can be used dimensionally to determine subtypes of SAD and to measure severity of social anxiety. In the present paper, only data on a categorical level is presented. Different cut-off levels have beentested in the development phase of the SPSQ-C [1] and this was also done when the adult version of the SPSQ was developed [32]. The cut-off used is the closest to adhere to the DSM-IV definition of social phobia.

A paper and pencil format of the SPSQ-C was used. The instrument took about 5-10 minutes to fill out.

The Structured Clinical Interview for DSM-IV Axis 1 Disorder (SCID-1)

To evaluate concurrent validity, the SPSQ-C was compared with the SCID-I [40] used as gold standard. For the purpose of this study, only the section covering SAD in the research version of the SCID-I was used. The social phobia section of the SCID has previously been used in a telephone format with students from the age of 17 [45]. The interviews were made by a student in the last year of his master graduation of psychology studies with basic training in the diagnostic procedures and by a mental health professional with long experience in using rating scales and diagnostic interviews in clinical and research contexts. The mental health professional conducted 35 of the 51 interviews. The respondents were interviewed by telephone and the interview took 5-20 minutes to conduct. The interviewers were blind to the subjects' response on the SPSQ-C.

Statistical analyses

Chi-square or Fisher's exact tests were used for evaluating group differences with respect to categorical variables. Test-retest reliability was assessed using Spearman's correlation coefficient. The internal consistency of the scale was assessed using the Cronbach's coefficient alpha for the first eight items of the SPSQ-C (data from the first assessment). Specificity (1-α) and sensitivity (1-β), positive and negative likelihood ratios were calculated as well as positive predictive value (PPV) and negative predictive value (NPV). All analyses were performed in SPSS version 15.0 (SPSS, Inc., Chicago, IL, USA).

Results

Descriptives

At the first measurement (n = 153) eleven subjects (7.2%) met the criteria for SAD according to the SPSQ-C (4.5% of the males and 10.9% of the females) and 7.7% (4.5% of the males and 12.7% of the females) at the second measurement (n = 143). There was no significant difference between the genders in reporting SAD on the SPSC-Q neither at the first measurement (χ2 = 2.32, df = 1, = ns) or the second (χ2 = 3.19, df = 1, = ns). No significant differences were found between cases and non-cases on any of the demographic variables.

Measures of reliability

The alpha coefficient for the first items on eight phobic situations in the SPSQ-C was .77. Reliability test-retest analysis yielded a correlation of r = .60 (P < .01) between the two assessments. In addition, we also calculated an intraclass correlation (ICC) and a significant correlation coefficient of .75, was found.

Measures of validity

The overall test accuracy, i.e. the percentage of correct diagnoses in the validity sample, was 84%. The area under the curve (AUC) was .79 which was significant in comparison to a random ROC line (P < .015), see Figure 1. ROC-analysis showed sensitivity to be 71% and specificity 86%. This means that 71% of the respondents who were screened positive on the SPSQ-C were diagnosed with SAD on the SCID-I (5/7), and that 86% (38/44) scored negative on the SPSQ-C and were not diagnosed with SAD on the SCID-I. Accordingly, the positive likelihood ratio (LR+) was 5.07. This means that a self-reported case of SAD is about 5 times more likely to be a true case than a non-case. The negative likelihood ratio (LR-) was .34. This means that a negative screen on the SPSQ-C is marginally likely to identify a true non-case.

Figure 1
figure 1

Receiver operation characteristics (ROC) curve for the SPSQ-C.

Predictive values represent the probability of an outcome after the results are known. In the present study, positive predictive value (PPV), the percentage of positive screens that are accurate, was 45% (5/11). Negative predictive value (NPV), i.e. the percentage of respondents screening with a negative test result who were not diagnosed with SAD, was 95% (38/40).

Discussion

The aim of the present study was to evaluate the psychometric properties of a screening questionnaire for SAD in a community sample of Swedish adolescents. Firstly, satisfactory reliability was found. Concerning internal consistency, an alpha coefficient should be at least .60 for a self-report instrument to be reliable [46]. In the present study an alpha coefficient of .78 was found, showing that the eight items on the SPSQ-C are highly internally consistent and that the items appear to measure a common structure. In measuring test-retest reliability, we found a positive correlation of temporal stability over a three week period of r = .60. In measuring reliability, values of .50 to .70 are considered moderate [47]. Studies of other self-report measurements of SAD or social anxiety show long-term and short-term test-retest correlations ranging from .47 to .86 [26, 29, 48]. The test-retest reliability and intra-class correlation of SPSQ-C is thus by and large comparable to those of well-established measures in use for the assessment of SAD in children and adolescents.

Secondly, concurrent validity was assessed, yielding a specificity of 86% and a sensitivity of 71%. These values are comparable to other instruments screening for symptoms of social anxiety [20]. Sensitivity values of at least 70% are considered essential [49]. The greater value of specificity, the more cost-efficient is the instrument and a specificity value above 80% is considered useful [49]. The AUC was .79. Values of .70-.80 are considered fair and >.80 as good [20, 50]. In determining the optimal cut-off point, it has been suggested that the costs of false positives and false negatives should be considered [51]. In the present study we did not calculate cut-off scores based on cost-efficiency.

In addition to evaluating sensitivity and specificity, it is of clinical interest to describe predictive values. The negative predictive value was 95%, i.e. the probability that SPSQ-C correctly identifies individuals with no SAD. We found a positive predictive value of 45%. The predictive values are influenced by prevalence rates and low prevalence rates produce higher NPV and lower PPV. In the present study a prevalence rate of 7.2% was found at the first assessment and 7.7% at the second assessment.

There are some limitations to be mentioned in relation to the results from the present study. First, only concurrent validity was assessed. For clinical purpose, it would be of value to differentiate SAD from other clinical conditions but in the present study discriminant validity of the SPSQ-C was not investigated. Symptoms of anxiety are part of normal development and screening instruments need to have the ability to discriminate those with disabling symptoms from those within normal levels of worry and anxiety [47]. Thus, the SPSQ-C should be evaluated in comparisons with other instruments and behavioral assessment. Detection of social anxiety needs to take place early in order to prevent the development of further mental illness. Thus, it is of interest to evaluate the SPSQ-C in a community sample in the first place. It is also of interest to evaluate the SPSQ-C in clinical groups and to study the instrument's ability to measure severity and treatment efficacy [22, 52]. Further studies of the SPSQ-C should include the evaluation of convergent validity by comparing the SPSQ-C to other self-report measures.

Second, the subjects in the present study were high-school students. Onset of SAD is usually in early- to mid-adolescence but has been diagnosed in children as young as 7-8 years-old [53]. Assessment methods should be developmentally sensitive [21, 52, 54]. There are difficulties in developing questionnaires that are suitable for different ages [55] and little work has been done on early identification and assessment of social anxiety in children [54]. In this first report only adolescents were included but psychometric evaluation in younger age groups is needed.

A third limitation is the small sample size. The power of the statistical analyses would have increased by a larger number of subjects.

Lastly, recruitment of participants for the evaluation of validity was made from two different assessments. This was done in order to make ecological use of data but it also results in variability between subjects regarding the time-span between the measurements with SPSQ-C and the SCID-I.

As a final comment, better detection of social anxiety disorder is not a goal in itself, i.e. screening should be done only when further assessment, treatment and follow-up also is offered [56]. Unfortunately, there are frequently barriers to treatment utilization [57, 58] and little is known on how to increase mental health utilization among socially phobic individuals [59]. Finding methods that could make treatment available for socially anxious children and adolescents remains a challenge.

Conclusion

Screening of SAD in adolescents is critical for prevention and treatment. Compared to other self-reports questionnaires, the SPSQ-C has the advantage of being a short and cost-efficient screening instrument, based on the DSM-IV criteria of social anxiety disorder including measures of impairment and duration of SAD but also measures on a dimensional level. The results lend support to that it is a reliable and valid screening device for non-clinical older adolescents.

References

  1. Gren-Landell M, Tillfors M, Furmark T, Bohlin G, Andersson G, Svedin C: Social phobia in Swedish adolescents: prevalence and gender. Soc Psych Psych Epidem. 2009, 44: 1-7. 10.1007/s00127-008-0400-7.

    Article  Google Scholar 

  2. Wittchen HU, Stein MB, Kessler RC: Social fears and social phobia in a community sample of adolescents and young adults: prevalence, risk factors and co-morbidity. Psychol Med. 1999, 29: 309-323. 10.1017/S0033291798008174.

    Article  CAS  PubMed  Google Scholar 

  3. Essau CA, Conradt J, Petermann F: Frequency and comorbidity of social phobia and social fears in adolescents. Behav Res Ther. 1999, 37: 831-843. 10.1016/S0005-7967(98)00179-X.

    Article  CAS  PubMed  Google Scholar 

  4. Ranta K, Kaltiala-Heino R, Rantanen P, Marttunen M: Social phobia in Finnish general adolescent population: prevalence, comorbidity, individual and family correlates, and service use. Depress Anxiety. 2009, 26: 528-536.

    PubMed  Google Scholar 

  5. Van Ameringen M, Mancini C, Farvolen P: The impact of anxiety disorders on educational achievement. Anx Disord. 2003, 17: 561-571. 10.1016/S0887-6185(02)00228-1.

    Article  Google Scholar 

  6. Beesdo K, Bittner A, Pine D, Stein MB, Höfler M, Lieb R, Wittchen H-U: Incidence of social anxiety disorder and the consistent risk for secondary depression in the first three decades of life. Arch Gen Psychiatry. 2007, 64: 903-912. 10.1001/archpsyc.64.8.903.

    Article  PubMed  Google Scholar 

  7. Stein M, Fuetsch M, Müller N, Höfler M, Lieb S, Wittchen H-U: Social anxiety disorder and the risk of depression. A prospective community study of adolescents and young adults. Arch Gen Psychiatry. 2001, 58: 251-256. 10.1001/archpsyc.58.3.251.

    Article  CAS  PubMed  Google Scholar 

  8. Zimmerman P, Wittchen H-U, Hofler M, Pfister H, Kessler RC, Lieb R: Primary anxiety disorders and the development of subsequent alcohol use disorders: a 4-year community study of adolescents and young adults. Psych Med. 2003, 30: 1211-1222. 10.1017/S0033291703008158.

    Article  Google Scholar 

  9. Buckner JD, Schmidt NB, Lang AR, Small JW, Schlauch RC, Lewinsohn PM: Specificity of social anxiety disorder as a risk factor for alcohol and cannabis dependence. J Psychiatr Res. 2008, 42: 230-239. 10.1016/j.jpsychires.2007.01.002.

    Article  PubMed Central  PubMed  Google Scholar 

  10. Spence SH, Donovan C, Brechman-Toussaint M: The treatment of childhood social phobia: the effectiveness of a social skills training-based, cognitive-behavioural intervention, with and without parental involvement. J Child Psychol Psychiatry. 2000, 41: 713-726. 10.1111/1469-7610.00659.

    Article  CAS  PubMed  Google Scholar 

  11. Masia-Warner C, Klein RG, Dent HC, Fisher PH, Alvir J, Albano AM, Guardino M: School-based intervention for adolescents with social anxiety disorder: results of a controlled study. J Abnorm Child Psychol. 2005, 33: 707-722. 10.1007/s10802-005-7649-z.

    Article  PubMed  Google Scholar 

  12. Beidel DC, Ferrell C, Alfano CA, Yeganeh R: The treatment of childhood social anxiety disorder. Psychiatr Clin North Am. 2001, 24: 831-846. 10.1016/S0193-953X(05)70266-5.

    Article  CAS  PubMed  Google Scholar 

  13. Beidel DC, Turner SM, Sallee FR, Ammerman RT, Crosby LA, Pathak S: SET-C versus fluoxetine in the treatment of childhood social phobia. J Am Acad Child Adolesc Psychiatry. 2007, 46: 1622-1632. 10.1097/chi.0b013e318154bb57.

    Article  PubMed  Google Scholar 

  14. Magee WJ, Eaton W, Wittchen H-U, McGonagle KA, Kessler RC: Agoraphobia, simple phobia and social phobia in the National Comorbidity Survey. Arch Gen Psychiatry. 1996, 53: 159-168.

    Article  CAS  PubMed  Google Scholar 

  15. Essau CA: Frequency and patterns of mental health services utilization among adolescents with anxiety and depressive disorders. Depress Anxiety. 2005, 22: 130-137. 10.1002/da.20115.

    Article  PubMed  Google Scholar 

  16. Kashdan TB, Herbert JD: Social anxiety disorder in childhood and adolescence: current status and future directions. Clin Child Fam Psychol Rev. 2001, 4: 37-61. 10.1023/A:1009576610507.

    Article  CAS  PubMed  Google Scholar 

  17. Garland AF, Hough RL, McCabe KM, Yeh M, Wood PA, Aarons GA: Prevalence of psychiatric disorders in youths across five sectors of care. J Am Acad Child Adolesc Psychiatry. 2001, 40: 409-418. 10.1097/00004583-200104000-00009.

    Article  CAS  PubMed  Google Scholar 

  18. Chavira DA, Stein MB, Bailey K, Stein MT: Child anxiety in primary care: prevalent but untreated. Depr Anx. 2004, 20: 155-164. 10.1002/da.20039.

    Article  Google Scholar 

  19. Culpeppar : Social anxiety disorder in the primary care setting. J Clin Psychiatry. 2006, 67: 31-37.

    Google Scholar 

  20. Bailey KA, Chavira DA, Stein MT, Stein MB: Brief measures to screen for social phobia in primary care pediatrics. J Pediatric Psychol. 2006, 31: 512-521. 10.1093/jpepsy/jsj044.

    Article  Google Scholar 

  21. Connolly SD, Bernstein GA: Practice parameter for the assessment and treatment of children and adolescents with anxiety disorders. J Am Acad Child Adolesc Psychiatry. 2007, 46: 267-283. 10.1097/01.chi.0000246070.23695.06.

    Article  PubMed  Google Scholar 

  22. Langley AK, Bergman LR, Picentini JC: Assessment of childhood anxiety. International Review of Psychiatry. 2002, 14: 102-113. 10.1080/09540260220132626.

    Article  Google Scholar 

  23. American Psychiatric Association: Diagnostic and statistical manual of mental disorders. 1994, Washington DC: American Psychiatric Association, 4

    Google Scholar 

  24. La Greca AM, WL S: Social Anxiety Scale for Children-Revised Factor structure and concurrent validity. Jnl Clin Child Psych. 1993, 22: 17-27. 10.1207/s15374424jccp2201_2.

    Article  Google Scholar 

  25. La Greca AM, Lopez N: Social anxiety among adolescents: linkages with peer relations and friendships. J Abn Child Psychol. 1998, 26: 83-94. 10.1023/A:1022684520514.

    Article  CAS  Google Scholar 

  26. Beidel DC, Turner SM, Morris TL: A new inventory to assess childhood social anxiety and phobia: the social phobia and anxiety inventory for children. Psychological Assessment. 1995, 7: 73-79. 10.1037/1040-3590.7.1.73.

    Article  Google Scholar 

  27. Garcia-Lopez LJ, Hidalgo MD, Beidel DC, Olivares J, Turner S: Brief Form of the Social Phobia and Anxiety Inventory (SPAI-B) for Adolescents. Eur J Psychol Assess. 2008, 24: 150-156.

    Article  Google Scholar 

  28. Birmaher B, Khetarpal S, Brent D, Cully M, Balach L, Kaufman J, Neer SM: The Screen for Child Anxiety Related Emotional Disorders (SCARED): scale construction and psychometric characteristics. J Am Acad Child Adolesc Psychiatry. 1997, 36: 545-553. 10.1097/00004583-199704000-00018.

    Article  CAS  PubMed  Google Scholar 

  29. Ranta K, Kaltiala-Heino R, Koivisto AM, Tuomisto MT, Pelkonen M, Marttunen M: Age and gender differences in social anxiety symptoms during adolescence: the Social Phobia Inventory (SPIN) as a measure. Psychiatry Res. 2007, 153: 261-270. 10.1016/j.psychres.2006.12.006.

    Article  PubMed  Google Scholar 

  30. Connor KM, Davidson JRT, Churchill LE, Sherwood A, Foa E, Weisler RH: Psychometric properties of the Social Phobia Inventory (SPIN): new self-rating scale. Br J Psychiatry. 2000, 176: 379-386. 10.1192/bjp.176.4.379.

    Article  CAS  PubMed  Google Scholar 

  31. Ranta K, Kaltiala-Heino R, Rantanen P, Tuomisto MT, Marttunen M: Screening social phobia in adolescents from general population: the validity of the Social Phobia Inventory (SPIN) against a clinical interview. Eur Psychiatry. 2007, 22: 244-251. 10.1016/j.eurpsy.2006.12.002.

    Article  PubMed  Google Scholar 

  32. Furmark T, Tillfors M, Everz P-O, Marteinsdottir I, Gefvert O, Fredrikson M: Social phobia in the general population: prevalence and sociodemographic profile. Soc Psychiatry Psychiatr Epidemiol. 1999, 34: 416-424. 10.1007/s001270050163.

    Article  CAS  PubMed  Google Scholar 

  33. Tillfors M, Furmark T: Social phobia in Swedish university students: prevalence, subgroups and avoidant behavior. Soc Psychiatry Psychiatr Epidemiol. 2007, 42: 79-86. 10.1007/s00127-006-0143-2.

    Article  PubMed  Google Scholar 

  34. Carlbring P, Gunnarsdóttir M, Hedensjö L, Andersson G, Ekselius L, Furmark T: Treatment of social phobia from a distance: A randomized trial of internet delivered cognitive behaviour therapy (CBT) and telephone support. Br J Psychiatry. 2007, 190: 123-128. 10.1192/bjp.bp.105.020107.

    Article  PubMed  Google Scholar 

  35. Andersson G, Carlbring P, Holmstrom A, Sparthan E, Furmark T, Nilsson-Ihrfelt E, Buhrman M, Ekselius L: Internet-based self-help with therapist feedback and in vivo group exposure for social phobia: a randomized controlled trial. J Consult Clin Psychol. 2006, 74: 677-686. 10.1037/0022-006X.74.4.677.

    Article  PubMed  Google Scholar 

  36. Furmark T, Carlbring P, Hedman E, Sonnenstein A, Clevberger P, Bohman B, Eriksson A, Hållén A, Frykman M, Holmström A: Guided and unguided self-help for social anxiety disorder: randomised controlled trial. Br J Psychiatry. 2009, 195: 440-447. 10.1192/bjp.bp.108.060996.

    Article  PubMed  Google Scholar 

  37. Tillfors M, Carlbring P, Furmark T, Lewenhaupt S, Spak M, Eriksson A, Westling BE, Andersson G: Treating university students with social phobia and public speaking fears: Internet delivered self-help with or without live group exposure sessions. Depress Anxiety. 2008, 25: 708-717. 10.1002/da.20416.

    Article  PubMed  Google Scholar 

  38. Aune T, Stiles TC, Svarva K: Psychometric properties of the Social Phobia and Anxiety Inventory for Children using a non-American population-based sample. J Anxiety Disord. 2008, 22: 1075-1086. 10.1016/j.janxdis.2007.11.006.

    Article  PubMed  Google Scholar 

  39. Tillfors M, El-Khouri B, Stein MB, Trost K: Relationships between social anxiety, depressive symptoms, and antisocial behaviors: evidence from a prospective study of adolescent boys. J Anxiety Disord. 2009, 23: 718-724. 10.1016/j.janxdis.2009.02.011.

    Article  PubMed  Google Scholar 

  40. First M, Gibbon M, Spitzer R, Williams JBW: Structured clinical interview for DSM-IV Axis I Disorders (SCID-I). 1997, Washington, DC: American Psychiatric Press

    Google Scholar 

  41. Gordis L: Epidemiology. 2004, Philadelphia: Elsevier Saunders, 3

    Google Scholar 

  42. Lyneham HJ, Rapee RM: Agreement between telephone and in-person delivery of a structured interview for anxiety disorders in children. J Am Acad Child Adolesc Psychiatry. 2005, 44: 274-282. 10.1097/00004583-200503000-00012.

    Article  PubMed  Google Scholar 

  43. Kessler RC, McGonagle KA, Zhao S, Nelson CB, Hughes M, Eshleman S, Wittchen H-U, Kendler KS: Life-time and 12-month prevalence of DSM-III-R psychiatric disorders in the United States. Arch Gen Psychiatry. 1994, 51: 8-19.

    Article  CAS  PubMed  Google Scholar 

  44. Härmä AM, Kaliala-Heino R, Rimpelä M, Rantanen P: Are adolescents with frequent pain symptoms more depressed?. Scandinavian Journal of Primary Health Care. 2003, 20: 92-96. 10.1080/713796398.

    Article  Google Scholar 

  45. Osório F, Crippa J, Loureiro S: A study of the discriminative validity of a screening tool (MINI-SPIN) for social anxiety disorder applied to Brazilian university students. Eur Psychiatry. 2007, 22: 239-243. 10.1016/j.eurpsy.2007.01.532.

    Article  Google Scholar 

  46. Holmbeck GN, Thill AW, Bachanas P, Garber J, Miller KB, Abad M, Bruno EF, Carter JS, David-Ferdon C, Jandasek B: Evidence-based assessment in pediatric psychology: measures of psychosocial adjustment and psychopathology. J Pediatr Psychol. 2008, 33: 958-980. 10.1093/jpepsy/jsm059.

    Article  PubMed Central  PubMed  Google Scholar 

  47. Myers K, Winters NC: Ten-year review of rating scales. II: Scales for internalizing disorders. J Am Acad Child Adolesc Psychiatry. 2002, 41: 634-659. 10.1097/00004583-200206000-00004.

    Article  PubMed  Google Scholar 

  48. Storch EA, Masia-Warner C, Dent HC, Roberti JW, Fisher PH: Psychometric evaluation of the Social Anxiety Scale for Adolescents and the Social Phobia and Anxiety Inventory for Children: construct validity and normative data. J Anxiety Disord. 2004, 18: 665-679. 10.1016/j.janxdis.2003.09.002.

    Article  PubMed  Google Scholar 

  49. Matthey S, Petrovski P: The Children's Depression Inventory: error in cutoff scores for screening purposes. Psychol Assess. 2002, 14: 146-149. 10.1037/1040-3590.14.2.146.

    Article  PubMed  Google Scholar 

  50. Katon W, Russo J, Richardson L, McCauley E, Lozano P: Anxiety and depression screening for youth in a primary care population. Ambulatory Pediatrics. 2008, 8: 182-188. 10.1016/j.ambp.2008.01.003.

    Article  PubMed Central  PubMed  Google Scholar 

  51. Cuijpers P, Smits N, Donker T, Ten Have M, de Graaf R: Screening for mood and anxiety disorders with the five-item, the three-item, and the two-item Mental Health Inventory. Psychiatry Res. 2009, 168: 250-255. 10.1016/j.psychres.2008.05.012.

    Article  PubMed  Google Scholar 

  52. Brooks SJ, Kutcher S: Diagnosis and measurement of anxiety disorder in adolescents: a review of commonly used instruments. J Child Adolesc Psychopharmacol. 2003, 13: 351-400. 10.1089/104454603322572688.

    Article  PubMed  Google Scholar 

  53. Beidel DC, Turner SM, Morris TL: Psychopathology of childhood social phobia. J Am Acad Child Adolesc Psychiatry. 1999, 38: 643-650. 10.1097/00004583-199906000-00010.

    Article  CAS  PubMed  Google Scholar 

  54. Morris TL, Hirshfeld-Becker DR, Henin A, Storch EA: Developmentally sensitive assessment of social anxiety. Cognitive & Behavioural Practice. 2004, 11: 13-28. 10.1016/S1077-7229(04)80004-X.

    Article  Google Scholar 

  55. Schniering CA, Hudson JL, Rapee RM: Issues in the diagnosis and assessment of anxiety disorders in children and adolescents. Clin Psychol Rev. 2000, 20: 453-478. 10.1016/S0272-7358(99)00037-9.

    Article  CAS  PubMed  Google Scholar 

  56. Pignone MP, Gaynes BN, Rushton JL, Burchell CM, Orleans CT, Mulrow CD: Screening for depression in adults: a summary of evidence for the U.S. Preventive Services Task Force. Ann Intern Med. 2002, 136: 765-776.

    Article  PubMed  Google Scholar 

  57. Olfson M, Guardino M, Struening E, Schneier F, Hellman BA, Klein F: Barriers to treatment of social anxiety. Am J Psychiatry. 2000, 157: 521-527. 10.1176/appi.ajp.157.4.521.

    Article  CAS  PubMed  Google Scholar 

  58. Fehm L, Pelissolo A, Furmark T, Wittchen H-U: Size and burden of social phobia in Europe. Eur Neuropharmacol. 2005, 15: 453-462. 10.1016/j.euroneuro.2005.04.002.

    Article  CAS  Google Scholar 

  59. Coles ME, Turk CL, Jindra L, Heimberg RG: The path from initial inquiry to initiation of treatment for social anxiety disorder in an anxiety specialty clinic. J Anx Disord. 2004, 8: 371-383. 10.1016/S0887-6185(02)00259-1.

    Article  Google Scholar 

Download references

Acknowledgements

This study was supported by grants from: the Mayflower Foundation, the Research Council of South-Eastern Sweden (FORSS), the Swedish Psychiatry Foundation, the Bror Gadelius foundation and the Organon Foundation.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Gerhard Andersson.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

MGLl planned the design of the study, took part in collecting data, analysed data and was primarily responsible for writing the manuscript. AB planned the design of the study, collected data and conducted the analyses, took part in reading the ms and approved to the final version of the ms. TF developed the SPSQ-C, took part in the preparation of the manuscript and made major contributions to the manuscript including language revision. MT developed the SPSQ-C, took part in the statistical analyses, discussion of the design and in the preparation of the ms. CGS supervised the design and execution of the study and made contributions to the ms.GA supervised the design and execution of the study and made contributions to the ms. All authors have read and approved the final ms.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Gren-Landell, M., Björklind, A., Tillfors, M. et al. Evaluation of the psychometric properties of a modified version of the Social Phobia Screening Questionnaire for use in adolescents. Child Adolesc Psychiatry Ment Health 3, 36 (2009). https://doi.org/10.1186/1753-2000-3-36

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1753-2000-3-36

Keywords