Skip to main content

Global impression of perceived difficulties in children and adolescents with attention-deficit/hyperactivity disorder: Reliability and validity of a new instrument assessing perceived difficulties from a patient, parent and physician perspective over the day

Abstract

Background

The objective of this analysis was to evaluate the psychometric properties of a brief scale developed to assess the degree of difficulties in children with Attention-Deficit/Hyperactivity Disorder (ADHD). The Global Impression of Perceived Difficulties (GIPD) scale reflects overall impairment, psychosocial functioning and Quality of Life (QoL) as rated by patient, parents and physician at various times of the day.

Methods

In two open-label studies, ADHD-patients aged 6–17 years were treated with atomoxetine (target-dose 0.5–1.2 mg/kg/day). ADHD-related difficulties were assessed up to week 24 using the GIPD. Data from both studies were combined to validate the scale.

Results

Overall, 421 patients received atomoxetine. GIPD scores improved over time. All three GIPD-versions (patient, parent, physician) were internally consistent; all items showed at least moderate item-total correlation. The scale showed good test-retest reliability over a two-week period from all three perspectives. Good convergent and discriminant validity was shown.

Conclusion

GIPD is an internally consistent, reliable and valid measure to assess difficulties in children with ADHD at various times of the day and can be used as indicator for psychosocial impairment and QoL. The scale is sensitive to treatment-related change.

Background

Attention-deficit/hyperactivity disorder (ADHD) is a disorder characterized by inattention, impulsivity and hyperactivity that affects 3–7% of school-age children [1]. ADHD is associated with significant impairment of cognitive and psychosocial functioning [2, 3] and quality of life (QoL) in patients and their families [49]. Psychostimulants and behavior therapy are known to be effective in the treatment of ADHD, as reported in the MTA study [10] and other studies (e.g. Döpfner et al. 2004) [11]. Atomoxetine is a non-stimulant treatment option for ADHD [12, 13] for which efficacy and tolerability in children and adolescents has been demonstrated in a number of randomized, placebo-controlled trials [1417], supported by a recent meta-analysis [18]. In addition, several studies have shown improvement of health-related QoL in children and adolescents treated with atomoxetine [16, 1925]. In most of these studies, investigator-rated questionnaires such as the ADHD-Rating Scale (ADHD-RS) [26, 27], the Clinical Global Impression (CGI) [28, 29], or the parent-rated ADHD-symptom checklists and other questionnaires such as the Child Health Questionnaire (CHQ) [30] were used. However, when assessing QoL in children and adolescents with ADHD, both symptom severity and ADHD-related difficulties may be perceived and rated differently by patients, parents and physicians [9, 31], potentially resulting in inconsistent findings. Therefore ADHD-related difficulties (and thus the impairment) as perceived from various perspectives were assessed in two studies undertaken in Germany in children and adolescents with ADHD [25, 32]. The aim of these two studies was to compare the various perspectives as reflected by the newly devised Global Impression of Perceived Difficulties (GIPD) scale. The GIPD can be taken to reflect the difficulties related to ADHD and common co-morbid disorders such as oppositional-defiant disorder (ODD) or conduct disorder (CD) if present. The difficulties captured by the GIPD obviously relate to the degree of impairment, the level of psychosocial functioning and QoL in such children and adolescents at various times of the day [25, 32]. Three versions of this scale were used to assess ADHD-related difficulties as perceived from three different perspectives: the patient, parent, and physician perspective. The results of this comparison have been published elsewhere [25, 32]. The primary aim of this secondary analysis was to assess the psychometric properties of the GIPD scale in terms of validity and reliability [33]. Using valid and reliable scales is important when measuring QoL in pediatric patients [3437], especially when assessing children and adolescents with ADHD [3841].

Methods

Study design and procedures

This is a secondary analysis of data from two almost identical multi-center, single-arm, open-label studies in two different age groups (children and adolescents) that were designed to investigate the quality of life in patients with ADHD treated with atomoxetine as reflected by the degree of difficulties perceived by patients, parents and physicians [25, 32]. Patients were recruited from child and adolescent psychiatric and pediatric practices and outpatient clinics throughout Germany. Patients aged 6–17 years with ADHD as defined in the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR) [1] were eligible for the studies. The diagnosis was confirmed using the "Diagnose-Checkliste Hyperkinetische Störungen" (Diagnostic Checklist for Hyperkinetic Disorders), a structured instrument which is routinely used for the diagnostic assessment of ADHD in Germany [42]. The items of this instrument correspond to those of the ADHD-RS. Patients had to have an IQ of ≥ 70 based on the clinical judgment of the investigator. The exclusion criteria included clinically significant abnormal laboratory findings, acute or unstable medical conditions, cardiovascular disorder, history of seizures, pervasive developmental disorder, psychosis, bipolar disorder, suicidal ideation, any medical condition that might increase sympathetic nervous system activity, or the need for psychotropic medication other than study drug. Patients already being treated with atomoxetine were also excluded. The protocol was approved by an ethics committee, and the study was conducted in accordance with the principles of the Declaration of Helsinki.

Following a wash-out period, baseline assessments were carried out with all the instruments used. During the first week of treatment, the patients received atomoxetine at a dose of approximately 0.5 mg/kg body weight (BW) per day. During the following 7 weeks, the recommended target dose was 1.2 mg/kg BW per day, but could be adjusted within a range of 0.5–1.4 mg/kg BW per day, depending on effectiveness and tolerability. Medication was given once a day in the morning. Assessments were carried out weekly during the first two weeks of treatment, and every two weeks thereafter. After the 8 week treatment period, the physicians decided in accordance with the patients and their parents whether the patient was to continue treatment for additional 16 weeks. Those who participated in this extension period continued on the same atomoxetine dose which again could be adjusted within a range of 0.5–1.4 mg/kg BW per day as considered appropriate by the physician. During the extension period, three assessments were carried out, after 12, 16, and 24 weeks after baseline. The following instruments were used: Global Impression of Perceived Difficulties (GIPD), Attention-Deficit/Hyperactivity Disorder Rating Scale (ADHD-RS), Clinical Global Impression-Severity (CGI-S), and Weekly Rating of Evening and Morning Behavior – Revised (WREMB-R). The data from both studies were combined and analyzed together.

Table 1 shows the items of the GIPD instrument, which is a five-item rating of ADHD-related difficulties that assesses difficulties in the morning, during school, during homework, in the evening, and overall difficulties over the entire day and night [25]. Each item is rated on a seven point scale (1 = not at all difficult, 7 = extremely difficult) and reflects the situation during the past week (see Figure 1). This instrument was newly devised to detect the perception of the patient's ADHD-related difficulties from a patient, parent (or primary caregiver), and physician perspective. Accordingly, three different versions of the instrument were developed: a patient, a parent, and a physician version, allowing comparison. The GIPD total score was calculated for each rater as the mean of the item scores ranging from 1 to 7. If one item was missing, the total score was also considered to be missing. If the child was unable to fill in the scale on his/her own an independent person (e. g. a study nurse) was allowed to give assistance.

Figure 1
figure 1

The seven possible answers to each of the five items on the Global Impression of Perceived Difficulties (GIPD) scale as they appear on the report form for each rater (patient, parent, physician).

Table 1 The five items of the GIPD scale. The wordings of the questions vary slightly, depending on the rater (patient, parent, physician).

The Attention-Deficit/Hyperactivity Disorder Rating Scale-IV-Parent Version: Investigator-Administered and Scored (ADHD-RS) is an 18-item scale, with one item for each of the 18 ADHD symptoms listed in DSM-IV-TR [26, 27]. There are two subscales: the "hyperactivity/impulsivity" subscale is the sum of the even items, and the "inattention" subscale is the sum of the odd items. This scale is scored by an investigator while interviewing the parent or primary caregiver. Reliability and validity of this scale has been demonstrated in several European samples including one from Germany [33]

The Clinical Global Impression-Severity-Attention-Deficit/Hyperactivity Disorder scale (CGI-S ADHD) is a seven point single-item rating scale of the clinician's assessment of the severity of ADHD symptoms [28, 29].

The WREMB-R-Inv scale is based on the Daily Parent Rating of Evening and Morning Behavior – Revised (DPREMB-R) scale [14]. It has been modified to allow a weekly assessment of behavioral symptoms. In this study, the investigator-rated version was used. The investigator rating was based on information provided by the parent. The DPREMB-R measures 11 specific morning or evening activities (e.g., getting up and out of bed, doing or completing homework, sitting through dinner). The possible score for each item ranges from 0 (no difficulty) to 3 (a lot of difficulty). The DPREMB-R has been validated for the assessment of ADHD behaviors [43] and has been used in several studies to assess behavior in children and adolescents with ADHD [14, 15].

Sample size and statistical analysis

Details on the sample size calculation for the two studies first using the GIPD have been published elsewhere [25, 32]. The data of all patients were evaluated (Full Analysis Set, FAS) using SAS version 8. The dataset for all analyses of changes from baseline to endpoint consisted of all patients with a baseline measurement and at least one post-baseline measurement during the 8 week treatment phase.

Evaluation was largely descriptive. All tests of statistical significance were carried out at a nominal level of 5% using two-tailed test procedures. Two-sided confidence intervals (CIs) were computed using a 95% confidence level. All inferences regarding statistical significance were based on comparisons of the 95% confidence intervals (CI). This is equivalent to significance tests with p-values and a two-sided α-level of 5%. To avoid correlations of imputed values, only observed cases (OC) analyses were performed. No imputation of missing values like last observation carried forward (LOCF) was applied.

Percentages of missing values of the GIPD items were calculated for each visit and each perspective. Ceiling and floor effects for the GIPD total score were calculated by the percentage of ratings with the lowest and highest achievable scores for each visit and each perspective. Internal consistency of the GIPD total score was analyzed by using Cronbach's alpha for each visit and each perspective. Additionally, part-whole corrected item-total correlations were provided. Test-retest reliability of the GIPD total score was checked by comparing weeks 6 and 8 in terms of Spearman's correlation coefficient for the items and Pearson's correlation coefficient for the total score for each perspective. The rank-based Spearman's correlation coefficient was used for the items as they have an ordinal structure with only five categories. Pearson's correlation coefficient, which is based on the original values, was used for the total scores in order to assess the linear association of the more continuous total scores. Weeks 6 and 8 were chosen because the treatment and the disease severity was expected to be fairly stable during this period. 95% confidence intervals for the correlation coefficients were computed based on Fisher's z-transformation. Additionally, a weighted version of Cohen's kappa was provided together with 95% CIs.

The validity of the GIPD total score was evaluated as follows: 1) Means over time were provided together with 95% CIs for each perspective. 2) The agreement between the perspectives was described using Cohen's kappa for each visit and each pair of perspectives. 3) The GIPD total score was compared with the WREMB-R total score, the CGI-S score, and the ADHD-RS total score by Pearson's correlation coefficients with 95% CIs for each perspective, at each time point, and for all time points pooled. 4) The GIPD items for morning and evening were compared with the respective sub-scores of the WREMB-R in the same way. 5) Mean GIPD total scores were calculated for each level of the CGI-S with all visits pooled for each perspective to evaluate the relationship between the severity of the disease and the GIPD total score.

Results

Patient population and disposition

Of the 425 patients screened, 421 patients (100%) were enrolled in the two studies and treated with atomoxetine [25, 32]. The four patients identified as screening failures initially seemed to be eligible for the study by the investigator. During the baseline visit, it was discovered that the patients did not meet all inclusion criteria or met at least one of the exclusion criteria. The 8-week treatment period was completed by 355 (84.3%) patients. 27 (6.4%) of these did not continue into the extension period because of physician decision. 68 (16.2%) patients discontinued the study between week 8 and week 24. The extension period was completed at week 24 by 260 (61.8%) patients. The reasons for discontinuation were lack of efficacy (12.4%), parent decision (6.9%), adverse event (4.8%), protocol violation (3.6%), patient decision (2.4%), entry criteria exclusion (0.7%), physician decision (0.7%), and patient lost to follow-up (0.5%). The patient disposition is shown in Figure 2.

Figure 2
figure 2

Patient disposition.

Table 2 shows the patient characteristics. Boys and patients with combined subtype tended to be younger and were diagnosed earlier than girls or patients with predominantly inattentive subtype. 239 (70.7%) of the boys and 39 (47.0%) of the girls were diagnosed with the combined subtype. The predominantly inattentive subtype was diagnosed in 86 (25.4%) of the boys and 38 (45.8%) of the girls. The subgroups "predominantly hyperactive-impulsive subtype" and "ADHD, not otherwise specified" were too small for subgroup analysis (6 and 13 individuals, respectively).

Table 2 Patient characteristics

349 (82.9%) of the 421 patients had previously been treated for ADHD. The percentage was similar for the predominantly inattentive subtype (N = 101, 81.5%) and the combined subtype (N = 231, 83.1%). Medications most frequently used were short-acting methylphenidate (N = 290, 68.9%), long-acting methylphenidate (N = 196, 46.6%), amphetamines (N = 56, 13.3%), antipsychotic drugs (N = 12, 2.9%) and herbal/complementary therapies (N = 10, 2.4%). Commonly reported non-drug therapies prior to study were: occupational therapy (N = 48, 11.4%), "other" psychotherapy (N = 31, 7.4%), structured psychotherapy (N = 42, 10.0%), and remedial education (N = 10, 2.4%). The most frequent reason for discontinuation of previous therapy in patients with pre-treatment was inadequate response (N = 216, 61.9%).

The mean dose of atomoxetine given during the first week of treatment was 0.50 mg/kg BW per day (SD 0.07, range 0.40 – 0.80 mg/kg per day). Thereafter, the mean dose for the respective visit intervals ranged between 1.17 and 1.18 mg/kg BW per day (range 0.40 – 1.50 mg/kg day).

Concomitant medication, other concomitant treatments and the presence of any comorbidities in the patient sample are reported elsewhere [25, 32].

Missing values

For patients, missing values were between 0 and 0.38% for items 1, 4, and 5, and between 0.24% and 1.61% for items 2 and 3. For parents, missing values for the morning and evening ratings (items 1 and 4) were between 0 and 0.25% of all ratings for the respective items and the various visits. For items 2, 3, and 5 missing values occurred between 0 and 3.13% of all ratings for the respective item and visit. For physicians, there were no missing values for items 1, 4, and 5 at all but one visit. For items 2 and 3 there were missing values between 0 and 2.1% of all ratings for the respective item and visit. Thus, the items related to school and homework were those with the highest percentage of missing values. However, the percentage of missing values did not exceed 3.1%, indicating a tolerable lack of information. For the other three items, missing values were negligible.

Floor and ceiling effects

At baseline, floor effects (GIPD total score = 1) were 15.38% for the patient, 2.91% for the parent, and 1.45% for the physician perspective. The ceiling effects (GIPD total score = 7) were 0.96% for the patient, 2.18% for the parent, and 0.97% for the physician perspective. At endpoint (week 24) floor effects increased to 45.17% for the patient, 26.07% for the parent, and 27.59% for the physician perspective (as would be expected after successful treatment). The ceiling effects decreased to 0.39% for the patient, 0.39% for the parent, and 0% for the physician perspective.

Internal consistency

Table 3 shows the internal consistencies (Cronbach's alpha) of the GIPD total scores reflecting the ratings of the patients, the parents and the physicians at baseline and the following 8 points in time. Except for the first rating by the patients, all alpha values were above 0.80, indicating a good to excellent internal consistency of the scale. None of the consistency scores could be increased by deleting one of the items. The part-whole corrected item-total correlations were found to be above 0.46 for all weeks and raters, indicating moderate to good item-total Pearson's correlations of all items at all assessment points.

Table 3 Internal consistency (Cronbach's alpha) and part-whole corrected item-total Pearson's correlation coefficient (minimum and maximum of the 5 items) in brackets for the GIPD-Total Score (OC) over time

Test-retest reliability

Spearman's correlations between items rated at weeks 6 and 8 ranged from 0.473 [CI 0.380 to 0.554] (item 1) to 0.557 [CI 0.474 to 0.629] (item 5) for the patient, 0.551 [CI 0.466 to 0.624] (item 2) and 0.600 [CI 0.521 to 0.667] (item 4) for the parent, 0.525 [CI 0.439 to 0.600] (item 2) and 0.578 [CI 0.498 to 0.647] (item 5) for the physician perspective. The respective Cohen's kappas were between 0.410 [CI 0.278 to 0.542] (item 3) and 0.597 [CI 0.505 to 0.688] (item 5) for the patient, 0.509 [CI 0.410 to 0.609] (item 2) and 0.607 [CI 0.511 to 0.704] (item 1) for the parent, and between 0.543 [CI 0.433 to 0.652] (item 3) and 0.580 [CI 0.487 to 0.673] (item 5) for the physician perspective.

Pearson's correlation coefficients of the total scores rated at weeks 6 and 8 were 0.644 [CI 0.573 to 0.704] for the patient, 0.670 [CI 0.602 to 0.728] for the parent, and 0.654 [CI 0.584 to 0.713] for the physician perspective. The respective Cohen's kappas were 0.642 [CI 0.555 to 0.729], 0.669 [CI 0.589 to 0.749], and 0.653 [CI 0.559 to 0.746]. These results indicate a moderate to good test-retest reliability within a period of two weeks.

Validity

Agreement between patient, parent and physician perspectives over time (convergent validity)

The courses of the mean GIPD total scores over time (OC) were generally parallel in terms of the three rater groups for all patients (Figure 3).

Figure 3
figure 3

Mean GIPD total score (OC) over time for the three perspectives (patient, parent, physician).

Parents rated the ADHD-related difficulties at baseline as significantly less severe than physicians (mean GIPD total score, baseline parent: 18.6 [CI 18.0 to 19.2]), physician: 20.3 [CI 19.7 to 20.8]). However, the parent and physician total scores converged as early as week 2 (parent: 14.3 [CI 13.6 to 14.9], physician: 14.3 [CI 13.7 to 14.9]) and overlapped for the remainder of the observation period (week 24, parent: 11.5 [CI 10.8 to 12.2], physician: 11.5 [CI 10.9 to 12.2]). Compared to the parent and physician ratings, the children and adolescents perceived their difficulties as significantly less severe over the entire observation period (mean GIPD-total score patient baseline: 13.1 [CI 12.5 to 13.6], week 2: 10.4 [CI 9.9 to 11.0], week 24: 8.9 [CI 8.3 to 9.4]).

At baseline, Cohen's kappa for the GIPD total scores revealed the highest agreement between physician and parent ratings (kappa baseline: 0.521 [CI: 0.471 to 0.572]). Over all, the degree of agreement increased over time (kappa week 8: 0.653 [CI: 0.606 to 0.700], kappa week 24: 0.661 [CI: 0.609 to 0.712]). Agreement between patients and parents as well as patients and physicians was almost identical at baseline (kappa patient/physician baseline: 0.142 [CI: 0.106 to 0.178]; kappa patient/parent baseline: 0.162 [CI: 0.116 to 0.207]). Agreement between patient ratings and parent or physician ratings increased from baseline to week 8 and to week 24 (kappa patient/physician week 8: 0.327 [CI: 0.258 to 0.395]; kappa patient/parent week 8: 0.312 [CI: 0.239 to 0.386], kappa patient/physician week 24: 0.319 [CI: 0.253 to 0.385]; kappa patient/parent week 24: 0.262 [CI: 0.196 to 0.328]). Agreement between patients and physicians as well as between patients and parents was significantly lower than agreement between physicians and parents at any point in time (Table 4).

Table 4 Cohen's kappa for GIPD total scores (OC) with 95% confidence intervals (CI) over time.

Comparison of GIPD total scores with WREMB-R (convergent validity), CGI-S, and ADHD-RS total scores (discriminant validity) over time

As shown in Table 5, the correlation between GIPD total score and WREMB-R total score from the three perspectives at baseline was significantly lower from a patient perspective (0.265, 95% CI: 0.173 to 0.352) than from a parent (0.554, 95% CI: 0.482 to 0.617) or physician perspective (0.675, 95% CI: 0.618 to 0.724). Over time, this pattern persisted, although with slightly higher correlations. At week 24, correlation of the GIPD with the WREMB-R was significantly lower from a patient perspective (0.381, 95% CI: 0.271 to 0.480) than from a parent (0.731, 95% CI: 0.667 to 0.783) or physician perspective (0.774, 95% CI: 0.720 to 0.818).

Table 5 Comparison of GIPD total scores with WREMB-R, CGI-S, and ADHD-RS total scores over time (Pearson's Correlation Coefficients with 95% CIs).

Correlation between the physician-rated CGI-S total score and GIPD total score from the three perspectives at baseline was significantly lower both from a patient (0.269, 95% CI: 0.185 to 0.363) and a parent perspective (0.407, 95% CI: 0.323 to 0.485) than from a physician perspective (0.570, 95% CI: 0.501 to 0.631). Over time, this pattern persisted, although with slightly higher correlations. However, the differences between parent and physician ratings were not always statistically significant. At endpoint, correlation was significantly lower from a patient perspective (0.312, 95% CI: 0.197 to 0.418) than from a physician perspective (0.674, 95% CI: 0.600 to 0.734). The correlation was 0.578 (95% CI: 0.490 to 0.654) from a parent perspective and therefore significantly higher than from a patient perspective.

Comparing the confidence intervals (CI), the correlation between the physician-rated ADHD-RS total score and GIPD total score from the three perspectives at baseline was significantly lower from a patient perspective (0.201, 95% CI: 0.106 to 0.291) than from a parent (0.427, 95% CI: 0.344 to 0.503) or physician perspective (0.514, 95% CI: 0.439 to 0.581). Over time, this pattern persisted, although with slightly higher correlations. At week 24, correlation was significantly lower from a patient perspective (0.311, 95% CI: 0.196 to 0.417) than from a parent (0.661, 95% CI: 0.585 to 0.724) or physician perspective (0.680, 95% CI: 0.608 to 0.740).

Comparison of GIPD scores for the morning and evening items with the WREMB-R morning and evening subscales (convergent validity)

As shown in Table 6, the comparison of GIPD scores for the morning and evening items with the WREMB-R morning and evening subscales showed a similar pattern as was seen with the GIPD and WREMB-R total scores.

Table 6 Comparison of GIPD scores for the morning and evening items with the WREMB-R morning and evening subscales (Pearson's Correlation Coefficients with 95% CIs).

Mean GIPD total scores by symptom severity (CGI-S) (discriminant validity)

When relating GIPD total scores to the seven severity levels on the CGI-S, a monotone but not linear increase can be found. Both parent and physician GIPD total scores increased similarly with increasing CGI-S scores (Figure 4). In contrast, the patient-rated mean GIPD total scores increased to a much lower degree with increasing CGI-S scores.

Figure 4
figure 4

Mean GIPD total scores (OC) by CGI-S levels (OC) based on all time points for the three perspectives (patient, parent, physician).

Discussion

The aim of this post-hoc analysis was to evaluate and validate the newly devised GIPD scale that measures the degree of ADHD-related difficulties perceived by patients, parents and physicians at various times of the day. Other scales available so far to assess the level of psychosocial functioning from several perspectives, such as the Child Health Questionnaire (CHQ) [44], Child Health and Illness Profile (CHIP) [45], or the Marburg System of Quality Assurance and Therapy Evaluation (MARSYS) [46, 47], do not distinguish between various times of the day. Furthermore, the GIPD can be taken to reflect the health-related quality of life in children and adolescents with ADHD [25]. However, since the introduction of various long-acting ADHD medications, interest in duration of action of these medications over the day has increased [12]. The GIPD was therefore designed both to capture ADHD-related difficulties and to distinguish between various times of the day. Thus, results obtained by using the GIPD can be compared with results obtained by using other instruments that distinguish between various times of the day, such as the Daily Parent Rating of Evening and Morning Behavior (DPREMB) scale [14] or the Weekly Rating of Evening and Morning Behavior (WREMB) scale [43]. As the GIPD was designed as a global impression scale, all five items of the GIPD resemble the Clinical Global Impression (CGI) scale [28, 29] quite closely.

A total of 421 children and adolescents diagnosed with ADHD according to DSM-IV criteria were included in this analysis of data from two open-label studies. The mean age of the patients was 11.1 (SD 2.74) years, 338 (80.3%) were boys, 83 (19.7%) were girls.

One of the findings of the two studies on which the GIPD validation is based was a relatively high percentage of patients with the predominantly inattentive type of ADHD. One can only speculate about the reasons. Perhaps there was some sort of selection bias in these open-label studies towards patients with the inattentive type, particularly the study with adolescents. In the study with children, only 19.5% of patients were of the inattentive type, whilst considerable 45.9% were of the inattentive type in the study with adolescents. This obviously resulted in a proportion of 29.5% with the inattentive type in the pooled data (children and adolescents). One further reason could be the fact that the symptoms change as patients grow older: hyperactive or impulsive behaviour tends to decline, whilst inattentive symptoms tend to remain. This would explain the greater proportion of patients with the inattentive subtype in the study with adolescents compared to the study with children.

Although it is short (5 items), the GIPD scale rated by parents, physicians and patients has been shown to be internally consistent. For all items at least a moderate item-total correlation was found. Moreover, the scale has also shown good test-retest reliability over a period of two weeks for all three perspectives. The mean GIPD total scores (OC) generally showed a parallel course over time from all three rater perspectives (Figure 3). Parents rated ADHD-related difficulties at baseline as significantly less severe than physicians, but the parent and physician total scores converged as early as week 2 and the Cohen's kappa coefficients indicate a moderate agreement between parents' and physicians' ratings. However, the agreement between parents and physicians on the one hand and the patients on the other hand were quite low, as indicated by the kappa coefficients. Thus, adults seem to agree to a greater extent on the degree of perceived ADHD-related difficulties in the patients than the children and adolescents.

However, patients, parents and physicians perceived an improvement of ADHD-related difficulties over time. Compared to the parent and physician ratings, the children and adolescents perceived their difficulties as significantly less severe throughout the entire study. This suggests that children and adolescents perceive their ADHD-related difficulties to a lower extent than adults do. These findings reflect the findings from the two studies that assessed children and adolescents separately [25, 32]. Moreover, studies on the correlations between the ratings of behavioral and emotional problems as rated by parents and children or adolescents also reveal little agreement in the ratings of parents and their children. For example, Achenbach et al. [48] found in their meta-analysis a correlation of r = 0.25 between parents and children ratings of behavioral and emotional problems. This result was replicated in a German sample [49].

The higher correlation between parent and physician perspectives may also be due to the fact that the physicians based their ratings primarily on the information from the parents rather than the patients. Thus, convergent validity may be artificially inflated. However, the patient perspective on daily difficulties provides important additional information when evaluating the efficacy and effectiveness of a treatment. The low to moderate correlations of the different perspectives underline the need for assessing these perspectives separately.

The moderate correlations between physician-rated ADHD symptoms on the ADHD rating scale and the GIPD indicate a reasonable discriminant validity of the difficulties and the impairment of the child in different settings throughout the day as assessed by the GIPD scale on the one hand and the ADHD-RS on the other. Somewhat higher correlations were found with the WREMB-R which assesses a similar construct (i. e. 11 specific common morning or evening behaviors). This finding indicates the convergent validity of the GIPD in showing higher correlations to scales assessing similar constructs.

These studies and analyses have several limitations. Most importantly, they did not include a placebo control, so that the degree to which the results reflect drug-specific effects cannot be determined definitively. Also, sensitivity regarding differences between placebo and active comparator cannot be determined. In these studies, no further instrument assessing behavioral or emotional problems as perceived by the patients were used. Such self-report scales on ADHD symptoms or ADHD-related difficulties allow the calculation of convergent and discriminant validity and allow comparisons with other self report measures [42]. A future comparison of this sample with children without ADHD or with other behavioral or emotional problems would be interesting. This would allow the assessment of perceived difficulties in a more representative sample. A further limitation of this study is the age-distribution of the sample that does not reflect the age-distribution of individuals with ADHD in the general population. This is due to the fact that this analysis is based on two identical studies, one in children and one in adolescents. Beyond age as a covariate, other factors such as ADHD subtype, co-morbid disorders, type of school, family environment or other environmental factors may also influence a range of GIPD results (e.g. agreement between perspectives or treatment response as reflected by the GIPD). Further research on these factors is warranted.

Treatment-emergent adverse events during the course of the two studies have been reported elsewhere [25, 32].

Overall, the GIPD can be considered an internally consistent, reliable and valid measure to assess difficulties experienced by children with ADHD throughout the day and can be used as an indicator for psychosocial impairment and quality of life [25]. Moreover, the two treatment studies on which this analysis is based also show that the scale is sensitive to treatment-related change.

References

  1. American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR). 2000, Washington, DC, American Psychiatric Association

    Book  Google Scholar 

  2. Barkley RA: Major life activity and health outcomes associated with attention-deficit/hyperactivity disorder. J Clin Psychiatry. 2002, 10-15. Suppl 12

  3. Biederman J, Faraone SV: Attention-deficit hyperactivity disorder. Lancet. 2005, 366: 237-248. 10.1016/S0140-6736(05)66915-2.

    Article  PubMed  Google Scholar 

  4. Escobar R, Soutullo CA, Hervas A, Gastaminza X, Polavieja P, Gilaberte I: Worse quality of life for children with newly diagnosed attention-deficit/hyperactivity disorder, compared with asthmatic and healthy children. Pediatrics. 2005, 116: e364-e369. 10.1542/peds.2005-0386.

    Article  PubMed  Google Scholar 

  5. Harpin VA: The effect of ADHD on the life of an individual, their family, and community from preschool to adult life. Arch Dis Child. 2007, i2-i7. Suppl 1

  6. Klassen AF, Miller A, Fine S: Health-related quality of life in children and adolescents who have a diagnosis of attention-deficit/hyperactivity disorder. Pediatrics. 2004, 114: e541-e547. 10.1542/peds.2004-0844.

    Article  PubMed  Google Scholar 

  7. Matza LS, Rentz AM, Secnik K, Swensen AR, Revicki DA, Michelson D, Spencer T, Newcorn JH, Kratochvil CJ: The link between health-related quality of life and clinical symptoms among children with attention-deficit hyperactivity disorder. J Dev Behav Pediatr. 2004, 25: 166-174. 10.1097/00004703-200406000-00005.

    Article  PubMed  Google Scholar 

  8. Riley AW, Spiel G, Coghill D, Döpfner M, Falissard B, Lorenzo MJ, Preuss U, Ralston SJ, ADORE Study Group: Factors related to Health-Related Quality of Life (HRQoL) among children with ADHD in Europe at entry into treatment. Eur Child Adolesc Psychiatry. 2006, i38-i45. 10.1007/s00787-006-1006-9. Suppl 1

  9. Sawyer MG, Whaites L, Rey JM, Hazell PL, Graetz BW, Baghurst P: Health-related quality of life of children and adolescents with mental disorders. J Am Acad Child Adolesc Psychiatry. 2002, 41: 530-537. 10.1097/00004583-200205000-00010.

    Article  PubMed  Google Scholar 

  10. Jensen PS, Hinshaw SP, Swanson JM, Greenhill LL, Conners CK, Arnold LE, Abikoff HB, Elliott G, Hechtman L, Hoza B, March JS, Newcorn JH, Severe JB, Vitiello B, Wells K, Wigal T: Findings from the NIMH multimodal treatment study of ADHD (MTA): implications and applications for primary care providers. Dev Behav Pediatrics. 2001, 22 (1): 60-73.

    Article  CAS  Google Scholar 

  11. Döpfner M, Breuer D, Schürmann S, Metternich TW, Rademacher C, Lehmkuhl G: Effectiveness of an adaptive multimodal treatment in children with Attention-Deficit Hyperactivity Disorder – global outcome. Eur Child Adolesc Psychiatry. 2004, I117-I129. Suppl 1

  12. Banaschewski T, Roessner V, Dittmann RW, Santosh PJ, Rothenberger A: Non-stimulant medications in the treatment of ADHD. Eur Child Adolesc Psychiatry. 2004, I102-I116. Suppl 1

  13. Becker K, Wehmeier PM, Schmidt MH: The Noradrenergic Transmitter System in ADHD: Principles and Implications for Treatment. 2006, Stuttgart (Germany): Thieme

    Google Scholar 

  14. Kelsey DK, Sumner CR, Casat CD, Coury DL, Quintana H, Saylor KE, Sutton VK, Gonzales J, Malcolm SK, Schuh KJ, Allen AJ: Once-daily atomoxetine treatment for children with attention-deficit/hyperactivity disorder, including an assessment of evening and morning behavior: a double-blind, placebo-controlled trial. Pediatrics. 2004, 114: e1-e8. 10.1542/peds.114.1.e1.

    Article  PubMed  Google Scholar 

  15. Michelson D, Allen AJ, Busner J, Casat C, Dunn D, Kratochvil C, Newcorn J, Sallee FR, Sangal RB, Saylor K, West S, Kelsey D, Wernicke J, Trapp NJ, Harder D: Once-daily atomoxetine treatment for children and adolescents with attention deficit hyperactivity disorder: a randomized, placebo-controlled study. Am J Psychiatry. 2002, 159: 1896-1901. 10.1176/appi.ajp.159.11.1896.

    Article  PubMed  Google Scholar 

  16. Michelson D, Faries D, Wernicke J, Kelsey D, Kendrick K, Sallee FR, Spencer T, Atomoxetine ADHD Study Group: Atomoxetine in the treatment of children and adolescents with attention-deficit/hyperactivity disorder: a randomized, placebo-controlled, dose-response study. Pediatrics. 2001, 108: e83-e91. 10.1542/peds.108.5.e83.

    Article  CAS  PubMed  Google Scholar 

  17. Spencer T, Heiligenstein JH, Biederman J, Faries DE, Kratochvil CJ, Conners CK, Potter WZ: Results from 2 proof-of-concept, placebo-controlled studies of atomoxetine in children with attention-deficit/hyperactivity disorder. J Clin Psychiatry. 2002, 63: 1140-1147.

    Article  CAS  PubMed  Google Scholar 

  18. Cheng JYW, Chen RYL, Ko JSN, Ng EML: Efficacy and safety of atomoxetine for attention-deficit/hyperactivity disorder in children and adolescents. Meta-analysis and meta-regression analysis. Psychopharmacology (Berl). 2007, 194: 197-209. 10.1007/s00213-007-0840-x.

    Article  CAS  Google Scholar 

  19. Brown RT, Perwien A, Faries DE, Kratochvil CJ, Vaughan BS: Atomoxetine in the management of children with ADHD: effects on quality of life and school functioning. Clin Pediatr (Phila). 2006, 45: 819-827.

    Article  Google Scholar 

  20. Buitelaar JK, Danckaerts M, Gillberg C, Zuddas A, Becker K, Bouvard M, Fagan J, Gadoros J, Harpin V, Hazell P, Johnson M, Lerman-Sagie T, Soutullo CA, Wolanczyk T, Zeiner P, Fouche DS, Krikke-Workel J, Zhang S, Michelson D, Stomoxetine International Study Group: A prospective, multi-center, open-label assessment of atomoxetine in non-North American children and adolescents with ADHD. Eur Child Adolesc Psychiatry. 2004, 13: 249-257.

    PubMed  Google Scholar 

  21. Matza LS, Stoeckl MN, Shorr JM, Johnston JA: Impact of atomoxetine on health-related quality of life and functional status in patients with ADHD. Expert Rev Pharmacoeconomics Outcomes Res. 2006, 6: 379-390. 10.1586/14737167.6.4.379.

    Article  Google Scholar 

  22. Perwien AR, Kratochvil CJ, Faries DE, Vaughan BS, Spencer T, Brown RT: Atomoxetine Treatment in Children and Adolescents with Attention-Deficit Hyperactivity Disorder: What Are the Long-Term Health-Related Quality-of-Life Outcomes?. J Child Adolesc Psychopharmacol. 2006, 16: 713-724. 10.1089/cap.2006.16.713.

    Article  PubMed  Google Scholar 

  23. Perwien AR, Faries DE, Kratochvil CJ, Sumner CR, Kelsey DK, Allen AJ: Improvement in health-related quality of life in children with ADHD: an analysis of placebo controlled studies of atomoxetine. J Dev Behav Pediatr. 2004, 25: 445-10.1097/00004703-200408000-00006.

    Article  Google Scholar 

  24. Prasad S, Harpin V, Poole L, Zeitlin H, Jamdar S, Puvanendran K, The SUNBEAM Study Group: A multicentre, randomised, open-label study of atomoxetine compared with standard current therapy in UK children and adolescents with attention-deficit/hyperactivity disorder (ADHD). Curr Med Res Opin. 2007, 23: 379-394. 10.1185/030079906X167309.

    Article  CAS  PubMed  Google Scholar 

  25. Wehmeier PM, Dittmann RW, Schacht A, Minarzyk A, Lehmann M, Sevecke K, Lehmkuhl G: Effectiveness of atomoxetine in children with attention-deficit/hyperactivity disorder and quality of life as perceived by patients, parents and physicians in an open-label study. J Child Adolesc Psychopharmacol. 2007, 17: 813-829. 10.1089/cap.2007.0025.

    Article  PubMed  Google Scholar 

  26. DuPaul GJ, Power TJ, Anastopoulos AD, Reid R: ADHD Rating Scale-IV: Checklists, Norms, and Clinical Interpretations. 1998, New York (NY): Guilford

    Google Scholar 

  27. Faries DE, Yalcin I, Harder D, Heiligenstein JH: Validation of the ADHD Rating Scale as a clinician administered and scored instrument. J Atten Disord. 2001, 5: 39-47. 10.1177/108705470100500204.

    Article  Google Scholar 

  28. Guy W: ECDEU Assessment Manual for Psychopharmacology: Publication ADM 76-338. 1976, Washington, DC: US Department of Health, Education and Welfare, 218-222.

    Google Scholar 

  29. National Institutes of Mental Health (NIMH): Psychopharmacology Bulletin. 1985, 21: 839-943.

    Google Scholar 

  30. Landgraf J, Abetz L, Ware J: Child Health Questionnaire (CHQ): A Users Manual. 1996, Boston: Integrated Therapeutics Group

    Google Scholar 

  31. Klassen AF, Miller A, Fine S: Agreement between parent and child report of quality of life in children with attention-deficit/hyperactivity disorder. Child Care Health Dev. 2006, 32: 397-406. 10.1111/j.1365-2214.2006.00609.x.

    Article  CAS  PubMed  Google Scholar 

  32. Dittmann RW, Wehmeier PM, Lehmann M, Schacht A, Helsberg K, Lehmkuhl G: Behandlung von ADHS bei Jugendlichen in Deutschland: Offene Studie zur Effektivität und Verträglichkeit von Atomoxetin aus Sicht von Arzt, Eltern und Patient. Nervenarzt. 2006, S300-Suppl 3

  33. Döpfner M, Steinhausen HC, Coghill D, Dalsgaard S, Poole L, Ralston SJ, Rothenberger A, the ADORE Study Group: Cross-cultural reliability and validity of ADHD assessed by the ADHD Rating Scale in a pan-European study. Eur Child Adolesc Psychiatry. 2006, I/46-I/55. Suppl 1

  34. Connolly MA, Johnson JA: Measuring quality of life in paediatric patients. Pharmacoeconomics. 1999, 16: 605-625. 10.2165/00019053-199916060-00002.

    Article  CAS  PubMed  Google Scholar 

  35. Eiser C, Morse R: A review of measures of quality of life for children with chronic illness. Arch Dis Child. 2001, 84: 205-211. 10.1136/adc.84.3.205.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  36. Raat H, Bonsel GJ, Essink-Bot ML, Landgraf JM, Gemke RJBJ: Reliability and validity of comprehensive health status measures in children: the Child Health Questionnaire in relation to the Health Utilities Index. J Clin Epidemiol. 2002, 55: 67-76. 10.1016/S0895-4356(01)00411-5.

    Article  PubMed  Google Scholar 

  37. Schmidt LJ, Garratt AM, Fitzpatrick R: Child/parent-assessed population health outcome measures: a structured review. Child Care Health Dev. 2002, 28 (3): 227-237. 10.1046/j.1365-2214.2002.00266.x.

    Article  CAS  PubMed  Google Scholar 

  38. Hakkaart-van Roijen L, Zwirs BWC, Bouwmans C, Tan SS, Schulpen TWJ, Vlasveld L, Buitelaar JK: Societal costs and quality of life of children suffering from attention deficit hyperactivity disorder (ADHD). Eur Child and Adolesc Psychiatry. 2007, 16 (5): 316-326. 10.1007/s00787-007-0603-6.

    Article  CAS  Google Scholar 

  39. Landgraf JM, Rich M, Rappaport L: Measuring quality of life in children with attention-deficit/hyperactivity disorder and their families. Arch Pediatr Adolesc Med. 2002, 156: 384-391.

    Article  PubMed  Google Scholar 

  40. Rentz AM, Matza LS, Secnik K, Swensen A, Revicki DA: Psychometric validation of the child health questionnaire (CHQ) in a sample of children and adolescents with attention-deficit/hyperactivity disorder. Qual Life Res. 2005, 14: 719-734. 10.1007/s11136-004-0832-9.

    Article  PubMed  Google Scholar 

  41. Varni JW, Burwinkle TM: The PedsQL as a patient-reported outcome in children and adolescents with attention-deficit/hyperactivity disorder: a population-based study. Health and Qual Life Outcomes. 2006, 4: 26-35. 10.1186/1477-7525-4-26.

    Article  Google Scholar 

  42. Döpfner M, Lehmkuhl G: DISYPS-JK: Diagnostik-System für psychische Störungen im Kindes- und Jugendalter nach ICD-10 und DSM-IV. 2000, Bern (Switzerland): Verlag Hans Huber

    Google Scholar 

  43. Sutton V, Summer C, Allen AJ, Feng W, Schuh K, Michelson D: Validity, reliability, and responsiveness of the DPREMB-R scale for ADHD [abstract]. Scientific Proceedings of the 50th Anniversary Meeting of the American Academy of Child and Adolescent Psychiatry (AACAP), Miami Beach, USA, 14th–19th October. 2003, 169-170.

    Google Scholar 

  44. Landgraf JM, Maunsell E, Nixon-Speechley K, Bulllinger M, Campbell S, Abetz L, Ware JE: Canadian-French, German, and United Kingdom versions of the Child Health Questionnaire (CHQ-PF50): Methodology and preliminary item scaling results. Qual Life Res. 1998, 7: 433-445. 10.1023/A:1008810004694.

    Article  CAS  PubMed  Google Scholar 

  45. Riley AW, Forrest CB, Starfield B, Green BF, Robertson JA, Friello P: The parent report form of the CHIP-Child Edition. Reliability and Validity. Medical Care. 2004, 42: 210-220. 10.1097/01.mlr.0000114909.33878.ca.

    Article  PubMed  Google Scholar 

  46. Mattejat F, Remschmidt H: Die Erfassung des Therapieerfolges in der Kinder- und Jugendpsychiatrie unter naturalistischen Bedingungen. Konzeption und Realisierung des Marburger Systems zur Qualitätssicherung und Therapieevaluation (MARSYS). Z Kinder Jugendpsychiatr Psychother. 2006, 34: 445-454. 10.1024/1422-4917.34.6.445.

    Article  CAS  PubMed  Google Scholar 

  47. Remschmidt H, Mattejat F: Wie erfolgreich sind stationäre kinder- und jugendpsychiatrische Behandlungen? Erste Ergebnisse aus dem Marburger Evaluationsprojekt. Z Kinder Jugendpsychiatr Psychother. 2006, 34: 455-464. 10.1024/1422-4917.34.6.455.

    Article  PubMed  Google Scholar 

  48. Achenbach TM, McConaughy SH, Howell CT: Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specifity. Psychological Bulletin. 1987, 101: 213-232. 10.1037/0033-2909.101.2.213.

    Article  CAS  PubMed  Google Scholar 

  49. Plück J, Döpfner M, Berner W, Fegert J, Huss M, Lenz K, Schmeck K, Lehmkuhl U, Poustka F, Lehmkuhl G: Die Bedeutung unterschiedlicher Informationsquellen bei der Beurteilung psychischer Störungen im Jugendalter – ein Vergleich von Elternurteil und Selbsteinschätzung der Jugendlichen. Praxis der Kinderpsychologie und Kinderpsychiatrie. 1997, 46: 566-582.

    PubMed  Google Scholar 

Download references

Acknowledgements

We wish to thank Ms. Anette Minarzyk for her help in preparing the tables and the figures and for editing the manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Peter M Wehmeier.

Additional information

Competing interests

Research was funded by Lilly Deutschland GmbH, Bad Homburg, Germany. Dr. Peter M. Wehmeier (PMW), Prof. Ralf W. Dittmann (RWD) and Dr. Alexander Schacht (AS) are full-time employees of Lilly Deutschland. Prof. Manfred Döpfner (MD) has received research grants and speaker honoraria from Eli Lilly and he is a member of several Lilly Advisory Boards.

Authors' contributions

PMW, RWD, and AS developed the two clinical trials, AS developed the analyses used for this manuscript. All authors participated in development of the GIPD scale and the interpretation of data, PMW and AS drafted the manuscript, RWD and MD revised it critically for important intellectual content. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Wehmeier, P.M., Schacht, A., Dittmann, R.W. et al. Global impression of perceived difficulties in children and adolescents with attention-deficit/hyperactivity disorder: Reliability and validity of a new instrument assessing perceived difficulties from a patient, parent and physician perspective over the day. Child Adolesc Psychiatry Ment Health 2, 10 (2008). https://doi.org/10.1186/1753-2000-2-10

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1753-2000-2-10

Keywords