Evaluation of the psychometric properties of a modified version of the Social Phobia Screening Questionnaire for use in adolescents

1753-2000-3-36 1753-2000 Research Evaluation of the psychometric properties of a modified version of the Social Phobia Screening Questionnaire for use in adolescents Gren-Landell Malin malin.green.landell@liu.se Björklind Andreas andreas.bjorklind@gmail.com Tillfors Maria maria.tillfors@oru.se Furmark Tomas tomas.furmark@psyk.uu.se Svedin Göran Carl carl.goran.svedin@liu.se Andersson Gerhard gerhard.andersson@ki.se

Linköping University, Department of Clinical and Experimental Medicine, Linköping, Sweden

Linköping University, Department of Behavioral Sciences and Learning, The Swedish Institute for Disability Research, Linköping, Sweden

Örebro University, School of Law, Psychology and Social work, Örebro, Sweden

Uppsala University, Department of Psychology, Uppsala, Sweden

Karolinska Institutet, Department of Clinical Neuroscience, Stockholm, Sweden

Child and Adolescent Psychiatry and Mental Health 1753-2000 2009 3 1 36 http://www.capmh.com/content/3/1/36 19906313 10.1186/1753-2000-3-36 20 8 2009 11 11 2009 11 11 2009 2009 Gren-Landell et al; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Social phobia (social anxiety disorder - SAD) is a rather common but often undetected and undertreated psychiatric condition in youths. Screening of SAD in young individuals in community samples is thus important in preventing negative outcomes. The present study is the first report on the psychometric properties of the Social Phobia Screening Questionnaire for Children and adolescents (SPSQ-C).

Methods

The SPSQ-C was administered to a community sample of high-school students. Test-retest reliability over three weeks was evaluated (n = 127) and internal consistency was calculated for items measuring level of fear in eight social situations. To measure concurrent validity, subjects who reported SAD on at least one occasion and randomly selected non-cases were blindly interviewed with the Structured Clinical Interview for DSM-IV Axis-I disorders (SCID-I), as gold standard (n = 51).

Results

A moderate test-retest reliability, r = .60 (P < .01), and a satisfactory alpha coefficient of .78 was found. Values of sensitivity and specificity were 71% and 86% respectively, and area under the curve (AUC) was .79. Positive likelihood ratio (LR+) showed that a positive screening result was five times more likely to be correct than to reflect a non-case. Negative likelihood ratio (LR -) was .34. In addition, positive predictive value was 45% and negative predictive value was 95%. The prevalence of self-reported SAD was found to be 7.2% at the first assessment.

Conclusion

The SPSQ-C is a short and psychometrically sound questionnaire for screening of SAD in adolescents, with the advantage of being based on the DSM-IV criteria.

Background

Social anxiety disorder, also called social phobia, is a rather common anxiety disorder in adolescents, though prevalence rates are varying due to methodological and cultural reasons as well as due to what age groups are studied 1234. For many young sufferers, it is a disabling condition associated with a significantly increased risk for negative outcomes like dropping out from school 5, depression and suicide 67, alcohol use disorder 8 and cannabis dependence 9.

Even though effective psychosocial and pharmacological treatments for childhood SAD exist 10111213 help-seeking is low 41415. Children are usually referred to mental health service via parents but SAD is rarely recognized by parents and teachers 16 and mental health referral and treatment utilization is lower in anxiety disorders than in externalizing disorders in children and adolescents 1718. If help is sought, identification of symptoms needs to take place before treatment can be offered. While SAD is common in primary care populations, it is often not detected by primary care providers 19. The use of a reliable and valid, brief screening instrument in primary care paediatric settings can facilitate the detection of SAD in adolescents 20. According to the Practice parameters for anxiety disorders in children and adolescents 21, routine screening for anxiety symptoms is recommended during the initial mental health assessment due to the high prevalence of anxiety disorders. Also, given the high rates of comorbidity among anxiety disorders, there is a need to correctly identify the primary diagnosis, and rule out phenomenologically similar conditions that may be of importance for treatment selection 22. The Practice parameters recommend that screening questions are based on DSM-IV criteria 23 and use developmentally appropriate language.

There are a few psychometrically evaluated self-report instruments for use in the assessment of SAD in children and adolescents. The most widely used and well established instruments are the Social Anxiety Scale for Children - Revised (SASC-R) 24, the Social Anxiety Scale for Adolescents (SAS-A) 25 and the Social Phobia and Anxiety Inventory for Children (SPAI-C) 26. The SPAI-C has also been evaluated in a shorter 16-item version 27. In addition, the Screen for Child Anxiety Related Emotional Disorders (SCARED) 28 can be used for the assessment of social anxiety disorder in children. The Social Phobia Inventory (SPIN) 293031 has a more categorical format and has primarily been used with adolescents. The SPIN and the SPAI-C have been developed from instruments that have been used in adults, as well as an established Swedish screening instrument for use in adults, the Social Phobia Screening Questionnaire (SPSQ) 32. The SPSQ has shown excellent psychometric properties, showing a sensitivity of 100% and specificity of 95%, and has been used in several epidemiological and treatment studies on adults 323334353637. The SPAI-C mentioned above, has been translated and evaluated in a Norwegian sample 38, but to date there is no validated instrument for screening of social anxiety in Swedish children and adolescents. In backdrop of the need of a brief, DSM-based screening questionnaire for use with Swedish children and adolescents, a modified version for children and adolescents, the Social Phobia Screening Questionnaire for children and adolescents (SPSQ-C), has been developed and used in epidemiological and descriptive studies of children ranging in age from twelve to eighteen years 139.

While the SPSQ-C is a time-efficient and potentially useful instrument based on DSM-IV criteria, it has yet to be psychometrically evaluated. Thus, the objective of the present study was to report preliminary results of the psychometric properties of the SPSQ-C in a community sample of high-school students. Reliability was investigated by test-retest analysis over a three-week period and by calculating internal consistency for the first eight items of the SPSQ-C, covering level of fear in different social situations. Concurrent validity, i.e. sensitivity and specificity of the questionnaire, was evaluated using the Structured Clinical Interview for the DSM-IV Axis I-disorders (SCID-I) 40 as gold standard.

Methods

Procedure

Data were collected on three occasions. On the first two, the SPSQ-C was used for the purpose of evaluating reliability and on the third occasion a clinical interview was used for establishing concurrent validity.

Two weeks before the investigation took place written information about the study were mailed to students and their parents. The students were also informed about voluntary participation at all three assessments. Data-collection for the reliability evaluation was done at the classes' weekly class-council. Students signed written consent, completed the screening questionnaire and answered additional questions regarding socio-demographics. The same procedure, with the same classes of students, was used three weeks later. As a compensation for their participation, the students had a chance of winning a ticket to a movie in a lottery that was conducted in each class after all students had completed their questionnaires at the first and second assessment.

A case-control design was adopted for the evaluation of validity. The procedure of a case-control study starts with the selection of known cases and then an appropriate number of controls are selected 41. One week after the last assessment, adolescents meeting the criteria for social phobia according to the SPSQ-C, were selected if they had reported SAD on at least one occasion except if reporting SAD at the first assessment but not the second. Non-cases were randomly selected for the control group.

The clinical interview was conducted by telephone by two interviewers who were blind to the participants' diagnostic status on the SPSQ-C. A telephone format was chosen due to that many of the students were living in geographically distant areas, leading to transportation difficulties. Telephone administration of structured clinical interviews has been found to yield reliable, valid and time-effective data in the assessment of anxiety disorders in children 42. Subjects were compensated for their participation in the interview, by movie-tickets. The study was approved by the local ethics committee.

Subjects

Total sample

Subjects were recruited from a compulsory high school, in a small municipality (12 000 inhabitants) in the south middle of Sweden. The students were following the high school Social Science Programme or the Child Recreation Programme. These two programmes were chosen in order to have students from a theoretically oriented and a practically oriented programme.

In order to obtain a sample of ten subjects reporting SAD, as a minimum for the statistical analyses, a convenience sample of 180 subjects from eight classes (year 1-3) was selected. The size was due to an estimated prevalence rate of 4-14% of SAD in adolescents 121443 and an expected absent rate of 10-15% on one school day 44. The response rate at the first assessment was 85% and 79% at the second, resulting in a total of 169 subjects participating at any of the assessments. The subjects in the total sample were in the 1^st(n = 62), 2^nd(n = 67) and 3^rd(n = 40) year of studies. Mean age was 16.8 years (range 15-18 years). See Table 1 for further demographics of the total sample.

Table 1

Socio-demographics of the total sample (N = 169).

Age*

n (%)

2 (1.2)

63 (37.3)

61 (36.1)

42 (24.9)

Gender

Male

100 (59.2)

Female

69 (40.8)

Birth of origin

Swedish

156 (92.3)

Foreign

13 (7.7)

Parents' birth of origin

Swedish, both

150 (88.9)

Foreign, one parent

9 (5.3)

Foreign, both

10 (5.9)

Living arrangement*

With parents

136 (80.5)

With non-family**

31 (18.3)

Alone

1 (0.6)

*data missing in one case

** living with friend, partner or at boarding-school

Reliability sample

At the first assessment (n = 153) 89 boys, (58%) and 64 girls (42%) participated and at the second assessment (n = 143), 88 boys (61%) and 55 girls (39%). A total of 127 subjects participated at both measurements with the SPSQ-C and data from these subjects were used for the analysis of test-retest reliability.

Validity sample

In the present study a sample size of fifty subjects was chosen in order to have enough power for the evaluation of validity. Thirteen subjects reported SAD at both assessments or at one if only participating at one occasion and were eligible for the validity study (6/13 subjects had participated at both assessments and seven at one assessment). In order to get a sample of fifty subjects, thirty-eight non-cases were blindly and randomly selected by a person who was not involved in the project. A total of fifty-one subjects (26 males and 25 females) were interviewed. Seven subjects declined to participate and were substituted by the next numbered subject on the list for randomized selection. Non-responders consisted of one subject who reported SAD on the SPSQ-C and seven subjects who had not reported SAD. The non-responders were all male from the second year of their social science studies.

Instruments

The Social Phobia Screening Questionnaire for Children and adolescents (SPSQ-C)

The SPSQ-C is a modified version of the Social Phobia Screening Questionnaire (SPSQ) for adults 32. The SPSQ has shown satisfactory psychometric properties; an alpha coefficient of .90 concerning the section with fear ratings and high values of sensitivity and specificity 32.

The diagnostic section of the SPSQ-C is based on 8 potentially phobic situation: "speaking in front of the class", "raising your hand during a lesson", "being together with others during breaks", "initiating a conversation with someone one does not know very well", "looking someone in the eyes during a conversation", "making a phone-call to someone one does not know very well", "going to a party", and "eating together with others during the lunch-break". The respondents rate their perceived social fear in these potentially phobic situations on a three-point scale corresponding to no fear, some fear, and marked fear. Five diagnostic questions follow, assessing whether the individual meets the DSM-IV social phobia criteria A, B and D for one or more of the phobic situations. Since the instrument is developed for adolescents up to the age of 18, the C-criteria, realizing that the fear is excessive or unreasonable, does not have to be fulfilled. The E-criterion is assessed with three yes/no questions, i.e. the student is asked whether the social fear is of such nature that it severely interfere with or severely interfered with his/her activities in school, during leisure-time or when being with peers. The last question covers the F-criterion of 6-month duration (yes/no question). Criteria G (the fear is not due to direct physiological effects of a substance or medical condition, and not better accounted for by another mental disorder) and H (if a general medical condition or another mental disorder is present, the social fear is unrelated to it) are not assessed.

In order to establish a diagnosis of SAD on the SPSQ-C, i.e. a probable case of SAD, the student had to rate at least one potentially phobic situation as "marked fear" on the social fear scale. This particular situation had to be consistently endorsed in the diagnostic questions covering social phobia criteria A, B and D. The E-criterion had to be met, i.e. the report of impairment in at least one of the three life domains assessed. Lastly, the F-criterion, concerning persistence of symptoms for more than six months, also had to be fulfilled.

The SPSQ-C can be used dimensionally to determine subtypes of SAD and to measure severity of social anxiety. In the present paper, only data on a categorical level is presented. Different cut-off levels have beentested in the development phase of the SPSQ-C 1 and this was also done when the adult version of the SPSQ was developed 32. The cut-off used is the closest to adhere to the DSM-IV definition of social phobia.

A paper and pencil format of the SPSQ-C was used. The instrument took about 5-10 minutes to fill out.

The Structured Clinical Interview for DSM-IV Axis 1 Disorder (SCID-1)

To evaluate concurrent validity, the SPSQ-C was compared with the SCID-I 40 used as gold standard. For the purpose of this study, only the section covering SAD in the research version of the SCID-I was used. The social phobia section of the SCID has previously been used in a telephone format with students from the age of 17 45. The interviews were made by a student in the last year of his master graduation of psychology studies with basic training in the diagnostic procedures and by a mental health professional with long experience in using rating scales and diagnostic interviews in clinical and research contexts. The mental health professional conducted 35 of the 51 interviews. The respondents were interviewed by telephone and the interview took 5-20 minutes to conduct. The interviewers were blind to the subjects' response on the SPSQ-C.

Statistical analyses

Chi-square or Fisher's exact tests were used for evaluating group differences with respect to categorical variables. Test-retest reliability was assessed using Spearman's correlation coefficient. The internal consistency of the scale was assessed using the Cronbach's coefficient alpha for the first eight items of the SPSQ-C (data from the first assessment). Specificity (1-α) and sensitivity (1-β), positive and negative likelihood ratios were calculated as well as positive predictive value (PPV) and negative predictive value (NPV). All analyses were performed in SPSS version 15.0 (SPSS, Inc., Chicago, IL, USA).

Results

Descriptives

At the first measurement (n = 153) eleven subjects (7.2%) met the criteria for SAD according to the SPSQ-C (4.5% of the males and 10.9% of the females) and 7.7% (4.5% of the males and 12.7% of the females) at the second measurement (n = 143). There was no significant difference between the genders in reporting SAD on the SPSC-Q neither at the first measurement (χ²= 2.32, df = 1, = ns) or the second (χ²= 3.19, df = 1, = ns). No significant differences were found between cases and non-cases on any of the demographic variables.

Measures of reliability

The alpha coefficient for the first items on eight phobic situations in the SPSQ-C was .77. Reliability test-retest analysis yielded a correlation of r = .60 (P < .01) between the two assessments. In addition, we also calculated an intraclass correlation (ICC) and a significant correlation coefficient of .75, was found.

Measures of validity

The overall test accuracy, i.e. the percentage of correct diagnoses in the validity sample, was 84%. The area under the curve (AUC) was .79 which was significant in comparison to a random ROC line (P < .015), see Figure 1. ROC-analysis showed sensitivity to be 71% and specificity 86%. This means that 71% of the respondents who were screened positive on the SPSQ-C were diagnosed with SAD on the SCID-I (5/7), and that 86% (38/44) scored negative on the SPSQ-C and were not diagnosed with SAD on the SCID-I. Accordingly, the positive likelihood ratio (LR+) was 5.07. This means that a self-reported case of SAD is about 5 times more likely to be a true case than a non-case. The negative likelihood ratio (LR-) was .34. This means that a negative screen on the SPSQ-C is marginally likely to identify a true non-case.

Figure 1

Receiver operation characteristics (ROC) curve for the SPSQ-C

Receiver operation characteristics (ROC) curve for the SPSQ-C.

Predictive values represent the probability of an outcome after the results are known. In the present study, positive predictive value (PPV), the percentage of positive screens that are accurate, was 45% (5/11). Negative predictive value (NPV), i.e. the percentage of respondents screening with a negative test result who were not diagnosed with SAD, was 95% (38/40).

Discussion

The aim of the present study was to evaluate the psychometric properties of a screening questionnaire for SAD in a community sample of Swedish adolescents. Firstly, satisfactory reliability was found. Concerning internal consistency, an alpha coefficient should be at least .60 for a self-report instrument to be reliable 46. In the present study an alpha coefficient of .78 was found, showing that the eight items on the SPSQ-C are highly internally consistent and that the items appear to measure a common structure. In measuring test-retest reliability, we found a positive correlation of temporal stability over a three week period of r = .60. In measuring reliability, values of .50 to .70 are considered moderate 47. Studies of other self-report measurements of SAD or social anxiety show long-term and short-term test-retest correlations ranging from .47 to .86 262948. The test-retest reliability and intra-class correlation of SPSQ-C is thus by and large comparable to those of well-established measures in use for the assessment of SAD in children and adolescents.

Secondly, concurrent validity was assessed, yielding a specificity of 86% and a sensitivity of 71%. These values are comparable to other instruments screening for symptoms of social anxiety 20. Sensitivity values of at least 70% are considered essential 49. The greater value of specificity, the more cost-efficient is the instrument and a specificity value above 80% is considered useful 49. The AUC was .79. Values of .70-.80 are considered fair and >.80 as good 2050. In determining the optimal cut-off point, it has been suggested that the costs of false positives and false negatives should be considered 51. In the present study we did not calculate cut-off scores based on cost-efficiency.

In addition to evaluating sensitivity and specificity, it is of clinical interest to describe predictive values. The negative predictive value was 95%, i.e. the probability that SPSQ-C correctly identifies individuals with no SAD. We found a positive predictive value of 45%. The predictive values are influenced by prevalence rates and low prevalence rates produce higher NPV and lower PPV. In the present study a prevalence rate of 7.2% was found at the first assessment and 7.7% at the second assessment.

There are some limitations to be mentioned in relation to the results from the present study. First, only concurrent validity was assessed. For clinical purpose, it would be of value to differentiate SAD from other clinical conditions but in the present study discriminant validity of the SPSQ-C was not investigated. Symptoms of anxiety are part of normal development and screening instruments need to have the ability to discriminate those with disabling symptoms from those within normal levels of worry and anxiety 47. Thus, the SPSQ-C should be evaluated in comparisons with other instruments and behavioral assessment. Detection of social anxiety needs to take place early in order to prevent the development of further mental illness. Thus, it is of interest to evaluate the SPSQ-C in a community sample in the first place. It is also of interest to evaluate the SPSQ-C in clinical groups and to study the instrument's ability to measure severity and treatment efficacy 2252. Further studies of the SPSQ-C should include the evaluation of convergent validity by comparing the SPSQ-C to other self-report measures.

Second, the subjects in the present study were high-school students. Onset of SAD is usually in early- to mid-adolescence but has been diagnosed in children as young as 7-8 years-old 53. Assessment methods should be developmentally sensitive 215254. There are difficulties in developing questionnaires that are suitable for different ages 55 and little work has been done on early identification and assessment of social anxiety in children 54. In this first report only adolescents were included but psychometric evaluation in younger age groups is needed.

A third limitation is the small sample size. The power of the statistical analyses would have increased by a larger number of subjects.

Lastly, recruitment of participants for the evaluation of validity was made from two different assessments. This was done in order to make ecological use of data but it also results in variability between subjects regarding the time-span between the measurements with SPSQ-C and the SCID-I.

As a final comment, better detection of social anxiety disorder is not a goal in itself, i.e. screening should be done only when further assessment, treatment and follow-up also is offered 56. Unfortunately, there are frequently barriers to treatment utilization 5758 and little is known on how to increase mental health utilization among socially phobic individuals 59. Finding methods that could make treatment available for socially anxious children and adolescents remains a challenge.

Conclusion

Screening of SAD in adolescents is critical for prevention and treatment. Compared to other self-reports questionnaires, the SPSQ-C has the advantage of being a short and cost-efficient screening instrument, based on the DSM-IV criteria of social anxiety disorder including measures of impairment and duration of SAD but also measures on a dimensional level. The results lend support to that it is a reliable and valid screening device for non-clinical older adolescents.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

MGLl planned the design of the study, took part in collecting data, analysed data and was primarily responsible for writing the manuscript. AB planned the design of the study, collected data and conducted the analyses, took part in reading the ms and approved to the final version of the ms. TF developed the SPSQ-C, took part in the preparation of the manuscript and made major contributions to the manuscript including language revision. MT developed the SPSQ-C, took part in the statistical analyses, discussion of the design and in the preparation of the ms. CGS supervised the design and execution of the study and made contributions to the ms.GA supervised the design and execution of the study and made contributions to the ms. All authors have read and approved the final ms.

Acknowledgements

This study was supported by grants from: the Mayflower Foundation, the Research Council of South-Eastern Sweden (FORSS), the Swedish Psychiatry Foundation, the Bror Gadelius foundation and the Organon Foundation.

Social phobia in Swedish adolescents: prevalence and gender Gren-Landell M Tillfors M Furmark T Bohlin G Andersson G Svedin C Soc Psych Psych Epidem 2009 44 1 7 10.1007/s00127-008-0400-7 Social fears and social phobia in a community sample of adolescents and young adults: prevalence, risk factors and co-morbidity Wittchen HU Stein MB Kessler RC Psychol Med 1999 29 309 323 10.1017/S0033291798008174 10218923 Frequency and comorbidity of social phobia and social fears in adolescents Essau CA Conradt J Petermann F Behav Res Ther 1999 37 831 843 10.1016/S0005-7967(98)00179-X 10458047 Social phobia in Finnish general adolescent population: prevalence, comorbidity, individual and family correlates, and service use Ranta K Kaltiala-Heino R Rantanen P Marttunen M Depress Anxiety 2009 26 528 536 19170089 The impact of anxiety disorders on educational achievement Van Ameringen M Mancini C Farvolen P Anx Disord 2003 17 561 571 10.1016/S0887-6185(02)00228-1 Incidence of social anxiety disorder and the consistent risk for secondary depression in the first three decades of life Beesdo K Bittner A Pine D Stein MB Höfler M Lieb R Wittchen H-U Arch Gen Psychiatry 2007 64 903 912 10.1001/archpsyc.64.8.903 17679635 Social anxiety disorder and the risk of depression. A prospective community study of adolescents and young adults Stein M Fuetsch M Müller N Höfler M Lieb S Wittchen H-U Arch Gen Psychiatry 2001 58 251 256 10.1001/archpsyc.58.3.251 11231832 Primary anxiety disorders and the development of subsequent alcohol use disorders: a 4-year community study of adolescents and young adults Zimmerman P Wittchen H-U Hofler M Pfister H Kessler RC Lieb R Psych Med 2003 30 1211 1222 10.1017/S0033291703008158 Specificity of social anxiety disorder as a risk factor for alcohol and cannabis dependence Buckner JD Schmidt NB Lang AR Small JW Schlauch RC Lewinsohn PM J Psychiatr Res 2008 42 230 239 2254175 17320907 10.1016/j.jpsychires.2007.01.002 The treatment of childhood social phobia: the effectiveness of a social skills training-based, cognitive-behavioural intervention, with and without parental involvement Spence SH Donovan C Brechman-Toussaint M J Child Psychol Psychiatry 2000 41 713 726 10.1111/1469-7610.00659 11039684 School-based intervention for adolescents with social anxiety disorder: results of a controlled study Masia-Warner C Klein RG Dent HC Fisher PH Alvir J Albano AM Guardino M J Abnorm Child Psychol 2005 33 707 722 10.1007/s10802-005-7649-z 16328746 The treatment of childhood social anxiety disorder Beidel DC Ferrell C Alfano CA Yeganeh R Psychiatr Clin North Am 2001 24 831 846 10.1016/S0193-953X(05)70266-5 11723636 SET-C versus fluoxetine in the treatment of childhood social phobia Beidel DC Turner SM Sallee FR Ammerman RT Crosby LA Pathak S J Am Acad Child Adolesc Psychiatry 2007 46 1622 1632 10.1097/chi.0b013e318154bb57 18030084 Agoraphobia, simple phobia and social phobia in the National Comorbidity Survey Magee WJ Eaton W Wittchen H-U McGonagle KA Kessler RC Arch Gen Psychiatry 1996 53 159 168 8629891 Frequency and patterns of mental health services utilization among adolescents with anxiety and depressive disorders Essau CA Depress Anxiety 2005 22 130 137 10.1002/da.20115 16175563 Social anxiety disorder in childhood and adolescence: current status and future directions Kashdan TB Herbert JD Clin Child Fam Psychol Rev 2001 4 37 61 10.1023/A:1009576610507 11388563 Prevalence of psychiatric disorders in youths across five sectors of care Garland AF Hough RL McCabe KM Yeh M Wood PA Aarons GA J Am Acad Child Adolesc Psychiatry 2001 40 409 418 10.1097/00004583-200104000-00009 11314566 Child anxiety in primary care: prevalent but untreated Chavira DA Stein MB Bailey K Stein MT Depr Anx 2004 20 155 164 10.1002/da.20039 Social anxiety disorder in the primary care setting Culpeppar J Clin Psychiatry 2006 67 31 37 Brief measures to screen for social phobia in primary care pediatrics Bailey KA Chavira DA Stein MT Stein MB J Pediatric Psychol 2006 31 512 521 10.1093/jpepsy/jsj044 Practice parameter for the assessment and treatment of children and adolescents with anxiety disorders Connolly SD Bernstein GA J Am Acad Child Adolesc Psychiatry 2007 46 267 283 10.1097/01.chi.0000246070.23695.06 17242630 Assessment of childhood anxiety Langley AK Bergman LR Picentini JC International Review of Psychiatry 2002 14 102 113 10.1080/09540260220132626 American Psychiatric Association Diagnostic and statistical manual of mental disorders Washington DC: American Psychiatric Association 4 1994 Social Anxiety Scale for Children-Revised Factor structure and concurrent validity La Greca AM WL S Jnl Clin Child Psych 1993 22 17 27 10.1207/s15374424jccp2201_2 Social anxiety among adolescents: linkages with peer relations and friendships La Greca AM Lopez N J Abn Child Psychol 1998 26 83 94 10.1023/A:1022684520514 A new inventory to assess childhood social anxiety and phobia: the social phobia and anxiety inventory for children Beidel DC Turner SM Morris TL Psychological Assessment 1995 7 73 79 10.1037/1040-3590.7.1.73 Brief Form of the Social Phobia and Anxiety Inventory (SPAI-B) for Adolescents Garcia-Lopez LJ Hidalgo MD Beidel DC Olivares J Turner S Eur J Psychol Assess 2008 24 150 156 The Screen for Child Anxiety Related Emotional Disorders (SCARED): scale construction and psychometric characteristics Birmaher B Khetarpal S Brent D Cully M Balach L Kaufman J Neer SM J Am Acad Child Adolesc Psychiatry 1997 36 545 553 10.1097/00004583-199704000-00018 9100430 Age and gender differences in social anxiety symptoms during adolescence: the Social Phobia Inventory (SPIN) as a measure Ranta K Kaltiala-Heino R Koivisto AM Tuomisto MT Pelkonen M Marttunen M Psychiatry Res 2007 153 261 270 10.1016/j.psychres.2006.12.006 17707088 Psychometric properties of the Social Phobia Inventory (SPIN): new self-rating scale Connor KM Davidson JRT Churchill LE Sherwood A Foa E Weisler RH Br J Psychiatry 2000 176 379 386 10.1192/bjp.176.4.379 10827888 Screening social phobia in adolescents from general population: the validity of the Social Phobia Inventory (SPIN) against a clinical interview Ranta K Kaltiala-Heino R Rantanen P Tuomisto MT Marttunen M Eur Psychiatry 2007 22 244 251 10.1016/j.eurpsy.2006.12.002 17346941 Social phobia in the general population: prevalence and sociodemographic profile Furmark T Tillfors M Everz P-O Marteinsdottir I Gefvert O Fredrikson M Soc Psychiatry Psychiatr Epidemiol 1999 34 416 424 10.1007/s001270050163 10501711 Social phobia in Swedish university students: prevalence, subgroups and avoidant behavior Tillfors M Furmark T Soc Psychiatry Psychiatr Epidemiol 2007 42 79 86 10.1007/s00127-006-0143-2 17160591 Treatment of social phobia from a distance: A randomized trial of internet delivered cognitive behaviour therapy (CBT) and telephone support Carlbring P Gunnarsdóttir M Hedensjö L Andersson G Ekselius L Furmark T Br J Psychiatry 2007 190 123 128 10.1192/bjp.bp.105.020107 17267928 Internet-based self-help with therapist feedback and in vivo group exposure for social phobia: a randomized controlled trial Andersson G Carlbring P Holmstrom A Sparthan E Furmark T Nilsson-Ihrfelt E Buhrman M Ekselius L J Consult Clin Psychol 2006 74 677 686 10.1037/0022-006X.74.4.677 16881775 Guided and unguided self-help for social anxiety disorder: randomised controlled trial Furmark T Carlbring P Hedman E Sonnenstein A Clevberger P Bohman B Eriksson A Hållén A Frykman M Holmström A Br J Psychiatry 2009 195 440 447 19880935 10.1192/bjp.bp.108.060996 Treating university students with social phobia and public speaking fears: Internet delivered self-help with or without live group exposure sessions Tillfors M Carlbring P Furmark T Lewenhaupt S Spak M Eriksson A Westling BE Andersson G Depress Anxiety 2008 25 708 717 10.1002/da.20416 18729147 Psychometric properties of the Social Phobia and Anxiety Inventory for Children using a non-American population-based sample Aune T Stiles TC Svarva K J Anxiety Disord 2008 22 1075 1086 10.1016/j.janxdis.2007.11.006 18182274 Relationships between social anxiety, depressive symptoms, and antisocial behaviors: evidence from a prospective study of adolescent boys Tillfors M El-Khouri B Stein MB Trost K J Anxiety Disord 2009 23 718 724 10.1016/j.janxdis.2009.02.011 19304451 First M Gibbon M Spitzer R Williams JBW Structured clinical interview for DSM-IV Axis I Disorders (SCID-I) Washington, DC: American Psychiatric Press 1997 Gordis L Epidemiology Philadelphia: Elsevier Saunders 3 2004 Agreement between telephone and in-person delivery of a structured interview for anxiety disorders in children Lyneham HJ Rapee RM J Am Acad Child Adolesc Psychiatry 2005 44 274 282 10.1097/00004583-200503000-00012 15725972 Life-time and 12-month prevalence of DSM-III-R psychiatric disorders in the United States Kessler RC McGonagle KA Zhao S Nelson CB Hughes M Eshleman S Wittchen H-U Kendler KS Arch Gen Psychiatry 1994 51 8 19 8279933 Are adolescents with frequent pain symptoms more depressed? Härmä AM Kaliala-Heino R Rimpelä M Rantanen P Scandinavian Journal of Primary Health Care 2003 20 92 96 10.1080/713796398 A study of the discriminative validity of a screening tool (MINI-SPIN) for social anxiety disorder applied to Brazilian university students Osório F Crippa J Loureiro S Eur Psychiatry 2007 22 239 243 10.1016/j.eurpsy.2007.01.532 17346942 Evidence-based assessment in pediatric psychology: measures of psychosocial adjustment and psychopathology Holmbeck GN Thill AW Bachanas P Garber J Miller KB Abad M Bruno EF Carter JS David-Ferdon C Jandasek B J Pediatr Psychol 2008 33 958 980 2543094 17728305 10.1093/jpepsy/jsm059 Ten-year review of rating scales. II: Scales for internalizing disorders Myers K Winters NC J Am Acad Child Adolesc Psychiatry 2002 41 634 659 10.1097/00004583-200206000-00004 12049439 Psychometric evaluation of the Social Anxiety Scale for Adolescents and the Social Phobia and Anxiety Inventory for Children: construct validity and normative data Storch EA Masia-Warner C Dent HC Roberti JW Fisher PH J Anxiety Disord 2004 18 665 679 10.1016/j.janxdis.2003.09.002 15275945 The Children's Depression Inventory: error in cutoff scores for screening purposes Matthey S Petrovski P Psychol Assess 2002 14 146 149 10.1037/1040-3590.14.2.146 12056076 Anxiety and depression screening for youth in a primary care population Katon W Russo J Richardson L McCauley E Lozano P Ambulatory Pediatrics 2008 8 182 188 2453063 18501865 10.1016/j.ambp.2008.01.003 Screening for mood and anxiety disorders with the five-item, the three-item, and the two-item Mental Health Inventory Cuijpers P Smits N Donker T Ten Have M de Graaf R Psychiatry Res 2009 168 250 255 10.1016/j.psychres.2008.05.012 19185354 Diagnosis and measurement of anxiety disorder in adolescents: a review of commonly used instruments Brooks SJ Kutcher S J Child Adolesc Psychopharmacol 2003 13 351 400 10.1089/104454603322572688 14642023 Psychopathology of childhood social phobia Beidel DC Turner SM Morris TL J Am Acad Child Adolesc Psychiatry 1999 38 643 650 10.1097/00004583-199906000-00010 10361781 Developmentally sensitive assessment of social anxiety Morris TL Hirshfeld-Becker DR Henin A Storch EA Cognitive & Behavioural Practice 2004 11 13 28 10.1016/S1077-7229(04)80004-X Issues in the diagnosis and assessment of anxiety disorders in children and adolescents Schniering CA Hudson JL Rapee RM Clin Psychol Rev 2000 20 453 478 10.1016/S0272-7358(99)00037-9 10832549 Screening for depression in adults: a summary of evidence for the U.S. Preventive Services Task Force Pignone MP Gaynes BN Rushton JL Burchell CM Orleans CT Mulrow CD Ann Intern Med 2002 136 765 776 12020146 Barriers to treatment of social anxiety Olfson M Guardino M Struening E Schneier F Hellman BA Klein F Am J Psychiatry 2000 157 521 527 10.1176/appi.ajp.157.4.521 10739410 Size and burden of social phobia in Europe Fehm L Pelissolo A Furmark T Wittchen H-U Eur Neuropharmacol 2005 15 453 462 10.1016/j.euroneuro.2005.04.002 The path from initial inquiry to initiation of treatment for social anxiety disorder in an anxiety specialty clinic Coles ME Turk CL Jindra L Heimberg RG J Anx Disord 2004 8 371 383 10.1016/S0887-6185(02)00259-1