Skip to main content

Effectiveness of a technology-assisted, family volunteers delivered, brief, multicomponent parents’ skills training intervention for children with developmental disorders in rural Pakistan: a cluster randomized controlled trial

Abstract

Background

Globally, there is a large documented gap between needs of families and children with developmental disorders and available services. We adapted the World Health Organization’s mental health Gap-Intervention Guidelines (mhGAP-IG) developmental disorders module into a tablet-based android application to train caregivers of children with developmental disorders. We aimed to evaluate the effectiveness of this technology-assisted, family volunteers delivered, parents’ skills training intervention to improve functioning in children with developmental disorders in a rural community of Rawalpindi, Pakistan.

Methods

In a single-blinded, cluster randomized controlled trial, 30 clusters were randomised (1:1 ratio) to intervention (n = 15) or enhanced treatment as usual (ETAU) arm (n = 15). After screening, 540 children (18 participants per cluster) aged 2–12 years, with developmental disorders and their primary caregivers were recruited into the trial. Primary outcome was child’s functioning, measured by Childhood Disability Assessment Schedule for Developmental Disorders (DD-CDAS) at 6-months post-intervention. Secondary outcomes were parents’ health related quality of life, caregiver-child joint engagement, socio-emotional well-being of children, family empowerment and stigmatizing experiences. Intention-to-treat analyses were done using mixed-models adjusted for covariates and clusters.

Results

At 6-months post-intervention, no statistically significant mean difference was observed on DD-CDAS between intervention and ETAU (mean [SD], 47.65 [26.94] vs. 48.72 [28.37], Adjusted Mean Difference (AMD), − 2.63; 95% CI − 6.50 to 1.24). However, parents in the intervention arm, compared to ETAU reported improved health related quality of life (mean [SD] 65.56 [23.25] vs. 62.17 [22.63], AMD 5.28; 95% CI 0.44 to 10.11). The results were non-significant for other secondary outcomes.

Conclusions

In the relatively short intervention period of 6 months, no improvement in child functioning was observed; but, there were significant improvements in caregivers’ health related quality of life. Further trials with a longer follow-up are recommended to evaluate the impact of intervention.

Trial registration Clinicaltrials.gov, NCT02792894. Registered April 4, 2016, https://clinicaltrials.gov/ct2/show/NCT02792894

Background

Developmental disorders are lifelong conditions characterized by early childhood onset and a delay in central nervous system development and maturation. They include conditions such as Autism Spectrum Disorder (ASD) and Intellectual Disabilities (ID) [1]. Developmental disorders cause substantial economic and social burden on families and societies globally [2, 3]; therefore, addressing developmental disorders is a priority for the global health agenda [4]. The World Health Organization (WHO) has developed evidence-based guidelines, published in the Mental Health Gap Intervention Guide (mhGAP-IG) for the management of priority mental health conditions in low resource settings globally [5]. The WHO mhGAP-IG recommends caregivers’ skills training for the management of children with developmental disorders in low-resource settings. The WHO mhGAP guidelines take a trans-diagnostic approach (a diagnosis is not required for participation in the program) and are designed to be delivered by non-specialists (health workers, primary health care physicians, nurses). These guidelines are recommended to be integrated into existing community services [6].

In Pakistan, over 6% of children suffer from a developmental disorder (ID or ASD) and like other low resource settings, most children and families receive no intervention or care. Specialist services are rare, concentrated in urban areas and inaccessible to the majority. There is considerable stigma and discrimination affecting children with developmental disorders and their families. Thus, the treatment gap for developmental disorders in rural Pakistan is almost 100% [7, 8]. The Ministry of Health in Pakistan is implementing the WHO mhGAP in primary health care settings to bridge the treatment gap for priority mental health conditions including childhood developmental disorders in Pakistan. Like many other low resource settings that have neither the trained human resource nor the mechanism to ensure program fidelity at-scale in real world settings, there are many contextual challenges to mhGAP implementation in Pakistan [9].

In recent years, use of mobile and internet technology has been recommended to address the barriers to access and improve quality of mental health care in low resource settings [10]. As a part of mhGAP implementation in a pilot sub-district of Rawalpindi, Pakistan, we converted the WHO mhGAP guidelines into training videos for caregivers of children with developmental disorders and hosted them on a tablet device. Family Volunteers (FVs) were trained to deliver this training to the caregivers of children with developmental disorders [7]. The training videos were interactive, allowing family volunteers and members to discuss each scenario in the context of their own lives and develop individualised management plans for their children. To pilot test the intervention, we identified and trained 10 family volunteers in implementing technology assisted, evidence-based, WHO mhGAP guidelines with 70 families and children with developmental disorders. The program was found to be feasible, acceptable and resulted in change in child’s outcomes [7].

The aim of present study was to evaluate the effectiveness of a scaled-up model of technology assisted, family volunteers delivered, brief, multicomponent parents’ skills training intervention for the management of developmental disorders in a low resource setting of rural Pakistan [11].

Methods

Study design

The effectiveness of intervention was evaluated in a two arm, single-blinded cluster randomized controlled trial (cRCT). As the intervention was delivered by ‘Family Volunteers’ in village-based groups, cluster randomized controlled design was considered appropriate to avoid contamination between the intervention and control arms. Primary outcome (child functioning) was evaluated at 6-months post-intervention. Implementation effectiveness was evaluated using mixed-methods research which has been described elsewhere (forthcoming publication).

Study settings and participants

The study was conducted in a rural sub-district of Gujar Khan in Rawalpindi district, Pakistan. Gujar Khan sub-district is a typical rural setting in northern Punjab and Pothohar region, situated about 35 km south east of the Rawalpindi city and has a population of about 1 million. The sub-district is divided into 30 rural Union Councils (UCs). Each UC is the smallest administrative unit within a district and it formed our unit for cluster randomisation. The trial participants were children (a) aged between 2 and 12 years, residing in the study sub-district for the duration of the study. A two-stage screening process included (a) positive score on any of the Ten Questions Screen questionnaire items # 1, 4, 5, 7, 8, 9, 10 for neurodevelopmental delay [12]—a cross culturally valid instrument to screen children with developmental difficulties [13]; and (b) clinical assessment of screened-positive children with developmental delays and disorder(s) according to the WHO mhGAP developmental disorders guidelines for clinical assessment in primary healthcare settings by a trained clinical psychologist. The ethics approval for this study was obtained from the Institutional Review Board and Ethics Board of the Rawalpindi Medical University and Allied Hospitals Rawalpindi (ethical approval certificate number ERC/RMU/29/01/2017) and Human Development Research Foundation, Islamabad (IRB/002/2016), Pakistan. All participants provided written informed consent before participating in the study. The trial protocol has been published [11].

Randomization and blinding

The unit of randomization was a Union Council (UC—the smallest administrative unit in rural sub-district). Thirty UCs were randomized to intervention and control arms on a 1:1 allocation ratio using a permuted-block randomization method with the block size of 6. Allocation of clusters was carried out by an independent researcher not involved in the conduct of the trial before the recruitment of participants in the study. The outcome assessment team, trial statistician and principal investigator were blind to the allocation status of trial participants. The fidelity of the masking was assessed by asking the assessors to guess the allocation status of each trial participants after post-assessment.

Intervention

We developed the intervention based on the guidelines of WHO mhGAP-IG module on developmental disorders. The adapted intervention consists of nine sessions delivered in group format to caregivers of children with developmental disorders. The programme aims to provide evidence-based strategies to caregivers of children with developmental disorders that can be implemented in low resource settings. The strategies target to promote child’s communication, socioemotional development and adaptive behaviours; manage co-morbid conditions in children; provide practical guidance on managing motor difficulties in children and coping skills to improve psychological well-being of caregivers. The intervention was delivered to caregivers of children with developmental disorders in 9 sessions. The nine intervention sessions are briefly described in Table 1 (Intervention manual and online training resources are freely available and can be accessed here https://fansforkids.org/).

Table 1 Outline of intervention sessions and content

In the adaptation of the intervention from the WHO mhGAP-IG, we employed several strategies to aid scale-up of intervention in under-resourced settings; firstly, based on the formative research [7] and in consultation with mental health experts and program trainers, the content of the intervention modules was simplified and contextualised to make the program content relatable for the parents with limited literacy skills. Secondly, an android application consisting of simple training videos, hosted on a tablet device was used to train parents, taking out the need for specialist to deliver the training. The intervention guidelines were broken down into training scenarios which were converted into narrative scripts by a panel of experts. The training scenarios incorporated all core techniques and principles of intervention. The key psycho-educational contents (‘key messages’ and strategies) of caregivers’ skills training were incorporated into ‘real-life’ narratives of the lives of three children with developmental disorders, their family members, and other supporting characters. Culturally appropriate real-life characters for the Family Volunteers (FVs) were developed. An artist converted the characters into ‘Avatars’. The training scenarios were shared with the group of parents and community health workers (not involved in the study). Their feedback was incorporated to refine the narratives. The narratives were interactive, with pause buttons and instructions; allowing family members to discuss each scenario in the context of their own lives; develop individualized management plans for their child based on the information provided; practice skills through role plays; discuss ways of increasing participation in communal life; and share problem-solving strategies. Thirdly, we used cascade model for the training and supervision of FVs and parents [14] (Fig. 1). First, the master trainer trained 10 trainers. The training of trainers was conducted using the android application hosted on a tablet device. The training consisted of 10-days class-room training followed by case studies under the supervision of master trainer. The master trainer performed live competency rating of the trainers on the case studies using an adapted version of ENhancing Assessment of Common Therapeutic factors (ENACT) for caregiver skills training for developmental disorders [15]. The trainers had completed at-least a Masters in Clinical Psychology and had at-least 1 year of experience in working with children and families with developmental disorders. Only competent trainers (mean score above 2.5 on all domains of adapted version of ENACT) were allowed to train and supervise the Family Volunteers (FVs). Each trainer trained FVs in 9 weekly group sessions followed by competency rating using adapted version of ENACT. The trainers cascaded down the training to 62 FVs using tablet-based tool, who, then, delivered the programme to the 4–5 families in their villages. Each trainer was assigned a case load of 4–6 FVs for training and supervision. These FVs were either the parents or were related to the children with developmental disorders, had at-least eight grades of formal education, and volunteered to be trained and supervised by the trainers for at-least 6-months duration of the programme.

Fig. 1
figure 1

(Adapted from Murray et al. [14])

Master trainer (UH); trainers (had at-least 16 years of education and 1 year of experience in working with children and families with developmental disorders; Family Volunteers (FVs) (parents or caregivers of children with developmental disorders, had at least eight grades of formal education, are voluntarily willing to be trained and supervised by the trainers for at-least 6-months duration of the programme and cascade the training to 4–5 families in their villages)

The FVs were fortnightly supervised by the trainers during the program delivery; similarly, trainers were supervised fortnightly by the master trainer. The fidelity of program delivery by the FVs was assessed by the trainers. To assess the fidelity, the trainers randomly selected and rated 20% of the sessions delivered by the FVs using adapted ENACT.

The intervention was delivered to caregivers of children with developmental disorders by the FVs using the tablet-based android application in weekly group sessions, for 9-weeks. To deliver intervention sessions, a tablet device (an intervention delivery aid) was provided to each FV for the duration of the program. The participation of caregivers in trainings sessions was tailored to the individual needs of their child. After 9-weeks of program implementation, FVs provided supervision to the caregivers in implementing the intervention strategies with their children in fortnightly group sessions with caregivers, delivered over a period of 4-months. All group sessions were organized at the local primary healthcare facility. No financial remuneration was provided to FVs for the program delivery.

Enhanced Treatment As Usual (ETAU)

Evidence-based mental health care is currently not available in primary healthcare centres. Treatment as usual for childhood developmental disorders in primary healthcare centres of Rawalpindi consists of a range of complementary/alternative treatment regimes, such as multi-vitamin syrups and tablets, prescribed by the primary health care physicians. For this study, the treatment as usual was enhanced in two ways: (a) Community Health Workers (CHWs), in the ETAU arm received training in recognising signs and symptoms of developmental disorders and making referrals to their primary care physicians for treatment; and (b) the primary care physicians received a half day orientation session on identification, management and referral guidelines of WHO mhGAP on developmental disorders by the specialists at Institute of Psychiatry, WHO Collaborating Centre for mental health in Pakistan. Data on health services accessed by trial participants in both arms is presented in Table 2.

Table 2 Health services utilization across two arms at baseline and during past 6-months (N = 540)

Outcomes

Baseline and end point assessments (6 months’ post-intervention) on the sample of 540 caregiver–child dyads were conducted by the trained research assessment team blind to the allocation status of the trial participants.

Primary outcome

Developmental Disorders-Children Disability Assessment Schedule (DD-CDAS) [16]: was adapted from the WHODAS-Child [17]. The DD-CDAS is a 36-item questionnaire measuring functioning and disability. The 36 items are rated on a five-point Likert scale (1 = none to 5 = extreme/cannot do). The items represent cognition, mobility, self-care, getting along with others, life activities, and participation in the society. The raw scores are sum across all the items of each domain and all 36 items for a tool. Domain and total raw scores are transformed into a range from 0 to 100. A global disability score is computed from all 36 items, where higher score indicates greater disability or difficulty in functioning. The interviewer-administered proxy version (caregiver report) of the tool because children with developmental disorders were not expected to be able to self-report. The tool has been validated for children with developmental disorders in Pakistan (DD-CDAS) by our group [16].

Secondary outcomes

Parental health related quality of life was measured by Paediatric Quality of Life (Peds-QL) [18] family impact module. The Peds-QL is a 36-item scale comprising 8 dimensions (physical functioning, emotional functioning, social functioning, cognitive functioning, communication, worry, daily activities and family relationships) measuring parent self-reported functioning. Items are rated on a 5-point Likert scale (0 = never to 4 = almost always). Peds-QL has shown sound psychometric properties in different cultures [19, 20].

Caregiver–child interaction [21]: we proposed to video tape a 15-min caregiver–child interaction at baseline and at-endpoint for families in both arms of the study. Caregivers were asked to try home routines involving the child (e.g. feeding the child, performing domestic chores) or play based routines (e.g. playing with toys or reading a book) with their child. Caregiver’s facilitators and interrupters (including child’s engagement and distress during social communication) and joint engagement was rated. The CCI videos were singly coded by trained assessors.

Socio-emotional well-being of children was measured using Strengths and Difficulties Questionnaire (SDQ) [22]. SDQ is a parent-rated, 25 item scale distributed over five domains: emotional symptoms; conduct problems; hyperactivity/inattention; peer relationship problems, and prosocial behaviour. Each item is rated on a 3-point Likert scale (0 = not true, 1 = somewhat true, 2 = certainly true). A total difficulty score is calculated by adding the scores of all domain except prosocial behaviour items [22]. SDQ has been validated in Pakistani and has shown good psychometric properties [23, 24].

Family empowerment was measured by Family Empowerment Scale (FES) [25]. FES is a parent-rated, 34 items scale consisting of three subscales (family subscale [12 items], service system subscale [12 items] and community subscale [10 items]). Each item is rated on a 5-point Likert scale (1 = not true at all to 5 = very true). Scores are summed across all items for each subscale with higher scores indicating relatively more empowerment. FES has shown good internal consistency, test–retest reliability and factor structure.

Caregivers’ stigmatizing experiences were measured using Inventory of Stigmatizing Experiences (ISE) [26]—family version. ISE is a 7 items interview based measure of the extent of stigma faced by family. Each item is rated on a 5-point liker scale (1 = never to 5 = always). The responses are recoded into a binary variable with 1 reflecting presence of stigma and 0 reflecting absence of stigma. Scores are summed across all items with a maximum score of 7, with lower scores indicating relatively less stigma. The scale indicated good internal consistency.

Health services utilisation by the trial participants was measured using the Client Service Receipt Inventory [27], that has been adapted for use in children and families with developmental disorders.

The data on severe adverse events, including death of the participant due to any cause, suicide attempt and hospital admission was collected from all study participants at 6-months post-intervention follow-up.

Statistical analysis

The data was analysed using SAS 9.3 on intention-to-treat basis. The previous studies of non-specialist delivered psychosocial interventions for children with intellectual disability and autism spectrum disorders used the effect sizes between 0.1 and 1 for the intervention outcome [6]. We aimed for a conservative effect-size estimate of 0.35 for the primary outcome measure. We proposed to recruit a sample of 540 parent–child dyads in 30 clusters (an average of 18 parent–child dyads per cluster), equally distributed between the intervention and control arms. This gave 93% power at 5% two-sided significance level with an intra-cluster correlation coefficient (ICC) of 0.01, after accounting for 15% attrition rate. To estimate the treatment effect, a linear mixed model was employed for the primary endpoint analysis, which had treatment as fixed effect, and baseline measurement of primary endpoint as covariate, and cluster as random effect. The mean difference between two treatment arms at 6-months together with its 95% confidence interval was derived from the mixed model. Covariate-adjusted mixed model of primary endpoint was also performed by adding pre-specified covariates (age, gender and baseline severity) at baseline into the above model. Subgroup analysis was also performed for the pre-specified covariates (age, gender and baseline severity), used in the covariate adjusted analysis. Adjusted and subgroup analysis were based on covariates at baseline without missing values. Sensitivity analysis was performed on the covariates with missing values imputed [28]. Missing data was treated as missing at random in the mixed model analysis and no imputation of primary and secondary endpoints was made. All trial analyses were described in detail in the finalised and signed statistical analysis plan before unmasking the data and have been described in the published trial protocol.

Procedures

The current trial to evaluate the effectiveness of mhGAP-IG based caregivers’ skills training was embedded within the implementation of WHO mhGAP program in Pakistan. 540 parent–child dyads, who fulfilled the eligibility criteria for participation in the trial, from 30 UCs (on an average 18 parent–child dyad in each UC) were enrolled in the study between February and April, 2017. All primary caregivers of the children provided written informed consent for participation in the study. The details of recruitment and trial procedures can be accessed from the registered and published trial protocols [11].

Results

The findings of the trial are reported following the recommendations of the Consolidated Standards of Reporting Trials (CONSORT) 2010 statement: extension to cluster randomized trials [29]. Figure 2 depicts participant flow through the trial. In 30 eligible UC clusters, 653 parent-child dyads were assessed for eligibility and 540 parent–child dyads who met the eligibility criteria were enrolled in the trial (average cluster size 18 participants). We were able to collect primary endpoint data at 6 months’ post-intervention from 460/540 (85.18%) trial participants.

Fig. 2
figure 2

Flow of participants through trial

The mean (SD) age of children was 6.72 (± 2.76) years and 60% of the children were males (320/540). Based upon the clinical assessment by psychologists 44% (239/540) of the children had cognitive difficulties, 40% (216/540) of children had cognitive difficulties with motor difficulties, and 5.9% (32/540), 2.6% (14/540) and 7.2% (39/540) had motor difficulties, communication difficulties and Down Syndrome, respectively. Only 27.4% (148/540) of children were attending school. Mothers were primary caregivers in 96% (520/540) of cases. Regarding mothers’ literacy, 33% (177/540) of mothers had no formal education; whereas, 56% (303/540) of mothers had completed some schooling (7 [± 1.5] years of schooling). In 74% (399/540) of families, caregivers had consanguineous marriages and 35% (187/540) of the children had positive family history for developmental disorders. There was no significant difference between the intervention and control arms in demographic characteristics (Table 3).

Table 3 Demographic characteristics (N = 540)

At baseline, the DD-CDAS total score in the intervention and control arms were (mean [SD] 56.13 [22.56] vs. 53.65 [23.08]). At 6-months post-intervention, although, the intervention arm did show more improvement in disability scores on DD-CDAS from baseline as compared to control arm, the difference on DD-CDAS total score between intervention and control arm at endpoint was not statistically significant (mean [SD], 47.65 [26.94] vs. 48.72 [28.37]), AMD, − 2.63; 95% CI − 6.50 to 1.24) (Table 4).

Table 4 Summary of mixed model analysis of primary and secondary outcomes (N = 540)

At 6-months post-intervention, there was statistically significant improvement in parental health related quality of life (PedsQL) total score (mean [SD] 65.56 [23.25] vs. 62.17 [22.63], AMD 5.28; 95% CI 0.44 to 10.11) and individual domain scores on; emotional wellbeing, (mean [SD] 61.76 [26.12] vs. 56.08 [28.03]), AMD 6.23; 95% CI 0.52 to 11.94) and worry domain (mean [SD] 57.58 [28.66] vs. 52.85 [30.09], AMD 6.66; 95% CI 0.00 to 13.33). The results of covariate adjusted analysis show that baseline severity, age and gender of the child did not influence the intervention’s effects on caregiver quality of life (Table 5). Since, the study was conducted in a conservative rural community settings of Pakistan, only 10% of the study sample consented to be video recorded for caregiver–child interaction. The intervention did not result in improving caregiver-child interaction, socio-emotional difficulties and family empowerment. Tables 4 and 6 present the findings of the primary and secondary outcomes at the primary end point (6-months post-intervention).

Table 5 Summary of mixed model analysis of primary and secondary outcomes (changes from baseline): covariate adjusted analysis
Table 6 Summary of mixed model analysis of caregivers’ child interaction change from baseline

All Family Volunteers (FVs) were females (95% mothers and 5% paternal aunts) with the mean age of 39 years (± 4.38). Out of 62 potential FVs trained by the trainers, 36 delivered the program to caregivers in local villages. Remaining 26 FVs were not able to deliver the program; due to health problems (n = 7); competing family commitments (n = 7); they were working mothers (n = 6) and did not achieve competency (n = 6). A total of 504 group sessions were delivered by 36 FVs in 79 village-based groups. The average group size was 6 (range 5 to 7). Out of 270, 230 (85%) of the trial participants attended 6 sessions (± 1). Average duration of a group session was 1 h 42 min. FVs organized group supervision sessions with 178 caregivers after 9-training sessions. The attendance in these sessions was 73%.

We assessed 20% (103/504) of sessions delivered by the 36 FVs using ENACT to evaluate program fidelity. The intervention sessions were delivered with good fidelity as all FVs scored 2.5 or more (mean [SD], 2.97 ± 0.21) on all items of adapted ENACT. Over the 6-months duration of program delivery, FVs were supervised in 30 group supervision meetings by the trainers. The attendance in the group supervision sessions was 75%.

All caregivers were provided feedback about the assessment result of their child and informed about the options for seeking appropriate care. During the 6-month follow-up period, 80.5% (178/270) participants in intervention arm and 78% (187/237) of caregivers in the ETAU arm contacted a primary health care physician for their child’s health related issues. Medicines including vitamins, calcium and iron supplements were prescribed to 88.2% (195/270) participants in intervention arm and 83.3% (199/270) participants in control arm. The details on health services utilization are mentioned in Table 2.

The allocation status of only 1 cluster (13%) in the intervention arm and 2 clusters (20%) in ETAU arm was correctly guessed by outcome assessors after the primary outcome assessment at post-intervention, indicating that blinding was successful.

Discussion

The results of our study show that a technology-assisted, family-volunteer delivered, brief, multicomponent, parents’ skills training did not improve child functioning beyond those in the ETAU arm. Our sample consisted of heterogeneous group of children with a range of developmental conditions such as intellectual disability, motor difficulties, speech and communication difficulties and Down syndrome. Although in statistical analysis, child’s age, gender and baseline severity did not impact the effect of intervention, the heterogeneity of the study sample might have led to inadequate power to evaluate a meaningful difference in each sub-group of the current study sample. Another possible explanation of lack of improvement in child’s functioning could be a relatively short intervention period that was inadequate to bring a clinically meaningful change in child’s functional disability and other socioemotional outcomes. Finally, we used a cluster randomised trial design to minimise the risk of contamination; however, given that the intervention delivery agents in the study were family volunteers working in closely knit rural community settings of Pakistan, the risk of contamination between the study arms cannot be ruled-out. The intervention led to significant improvement in caregivers’ quality of life. These results are consistent with other studies reported in the literature, where, family focused, parent-mediated interventions improved parental and family functioning [7, 30]. These findings become more significant in the context of South Asia, where mostly the mothers carry the main burden of caring for children with developmental disorders and while doing so they experience high emotional burden and stress [31,32,33,34,35]. Our village based ‘family networks’ intervention model provides an opportunity to the caregivers to discuss their challenges in taking care of a child with developmental disorder with their peers/family volunteers in a non-stigmatizing and supportive environment. This may have resulted in improved emotional wellbeing and reduced worries of caregivers associated with taking care of a child with developmental disorder. Parental health related quality of life is an important proximal outcome of a parent mediated intervention and it may be related to positive developmental outcomes in children with developmental delays in later years.

In the present study, we used technology to enhance our previous work on parent-mediated interventions, implemented in two of the most populous South Asian countries [36]. We enhanced our intervention delivery by developing android application hosted on a tablet device to train caregivers and taking task-shifting to its proximal level by training Family Volunteers (FVs) to deliver intervention to caregivers of children with developmental in a rural Pakistan. The results of the program fidelity demonstrated the use of technology as an effective innovation to train caregivers in evidence-based psychosocial interventions in low resource settings. Digital technology in any form (web based platforms, discussion forums, mobile devices) has a potential to deliver parent-mediated interventions [37], especially to scale-up interventions in low resource settings [38] and minimize the risk of reduction in program fidelity and dosage of intervention delivery by non-specialists, which are the frequent concerns associated with the task-shifting in global mental health [39].

Existing child mental health approaches rely on weak and fragmented health or social care systems that are incapable of providing evidence-based services to children with developmental disorders at-scale and sustainably in low resource settings. Our model of service delivery provides its own motivated human-resource and culturally adapted technology-assisted training platform. These technological and social innovations can work in synergy with the existing health care systems to provide an integrated and innovative [40] system of care that can be sustained with minimal support from local governmental and non-governmental agencies. Such innovative, community-based models of service delivery can serve as a starting point of a cost-effective and potentially sustainable stepped-care model of service delivery for childhood developmental disorders in low resource settings globally [41, 42].

Ever since its launch, the WHO mhGAP-IG has created a huge impact globally. It is being implemented in more than 90 countries of the world to bridge the service gap, with the ultimate aim to achieve the Universal Health Coverage for mental health [43]. Despite its huge uptake, globally, the impact evaluation of WHO mhGAP-IG has only been restricted to small studies, with less information on real-world contextual challenges and scientific learnings [44,45,46]. Our study is the first substantive randomised controlled trial of a non-specialists’ delivered WHO mhGAP-IG based caregivers’ skills training intervention for management of children with developmental disorders in low resource community settings. Although, our study did not result in improving child outcomes at 6-months post-intervention, the lessons learned from the present study have methodological implications on scaling-up care for children with developmental disorders in low resource settings globally. We recruited participants following the trans-diagnostic approach of WHO mhGAP program, which resulted in a heterogeneous group of children with a wide age range and a range of developmental conditions such as intellectual disability, motor difficulties, speech and communication difficulties and Down syndrome. Future studies may benefit from using adaptive interventions designs [47, 48] to cater the specific developmental needs of diverse group of children with developmental disorders.

There are several limitations in our study. Although, the caregivers’ skills training resulted in improved parental health related quality of life, the results of evaluation did not demonstrate improvement in child outcomes and we are unable to comment if improved parental health related quality of life translated in enhancing caregivers’ competency to interact and engage with the child due to high refusal rate from the community to video record mother–child interaction. Another limitation was brief duration of intervention delivery (6 months), given the diversity of conditions included in the category of developmental disorders; different degree of severity of symptoms of developmental disorders and delays in the target group, and wide age range of the study sample. These limitations call for pragmatic outcome measures [49], adaptive interventions [47, 48] and Sequential Multiple Assignment Randomized Trial (SMART) trial designs [50] to evaluate the impact of a caregivers skills training intervention for children with developmental disorders in real-world settings.

Conclusions

The treatment gap for community-based interventions for children with developmental disorders in low resource settings globally remains nearly 100% and research to address barriers to scaling-up care for childhood developmental disorders remain a neglected area. Innovations such as training caregivers and lay health workers using technology may address such bottlenecks to bridge the treatment gap for developmental disorders in low resource settings. WHO mhGAP-IG based caregivers’ skills training is a potentially scalable intervention; however, methodological innovations such as pragmatic outcome measures and SMART trials are needed to evaluate the impact in real-world settings.

Availability of data and materials

The dataset generated and analysed during the current study are available from the corresponding author on a reasonable request.

Abbreviations

WHO mhGAP-IG:

World Health Organization’s mental health Gap-Intervention (mhGAP-IG)

ETAU:

Enhanced treatment-as-usual

DD-CDAS:

Childhood Disability Assessment Schedule for Developmental Disorders

AMD:

Adjusted Mean Difference

ASD:

Autism spectrum disorder

ID:

Intellectual disabilities

FVs:

Family volunteers

cRCT:

Cluster Randomized Controlled Trial

UCs:

Union Councils

ADHD:

Attention Deficit Hyperactivity Disorder

ENACT:

ENhancing Assessment of Common Therapeutic factors

LHWs:

Lady Health Workers

WHODAS:

WHO Disability Assessment Schedule

PedsQL:

Paediatric Quality of Life

CCI:

Caregiver–child interaction

SDQ:

Strengths and Difficulties Questionnaire

FES:

Family Empowerment Scale

ISE:

Inventory of Stigmatizing Experiences

ICC:

Intra-cluster correlation coefficient

TQS:

Ten Questions Screening

CONSORT:

Consolidated Standards of Reporting Trials

ICF-CY:

International Classification of Functioning, Disability and Health-Child and Youth

References

  1. World Health Organisation. Multiaxial classification of child and adolescent psychiatric disorders: the ICD-10 classification of mental and behavioural disorders in children and adolescents. Cambridge: Cambridge University Press; 1996.

    Book  Google Scholar 

  2. Buescher AV, Cidav Z, Knapp M, Mandell DS. Costs of autism spectrum disorders in the United Kingdom and the United States. JAMA Pediatr. 2014;168(8):721–8.

    Article  PubMed  Google Scholar 

  3. Howlin P. Social disadvantage and exclusion: adults with autism lag far behind in employment prospects. J Am Acad Child Adolesc Psychiatry. 2013;52(9):897–9.

    Article  PubMed  Google Scholar 

  4. Tomlinson M, Yasamy MT, Emerson E, Officer A, Richler D, Saxena S. Setting global research priorities for developmental disabilities, including intellectual disabilities and autism. J Intellect Disabil Res. 2014;58(12):1121–30.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. WHO. mhGAP training manuals for the mhGAP intervention guide for mental, neurological and substance use disorders in non-specialized health settings-version 2.0 (for field testing). 2017.

  6. Reichow B, Servili C, Yasamy MT, Barbui C, Saxena S. Non-specialist psychosocial interventions for children and adolescents with intellectual disability or lower-functioning autism spectrum disorders: a systematic review. PLoS Med. 2013;10(12):e1001572.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Hamdani S, Minhas FA, Iqbal Z, Rahman A. Model for service delivery for developmental disorders in low-income countries. Pediatrics. 2015;136(6):1166–72.

    Article  PubMed  Google Scholar 

  8. Hamdani S, Atif N, Tariq M, Minhas FA, Iqbal Z, Rahman A. Family networks to improve outcomes in children with intellectual and developmental disorders: a qualitative study. Int J Ment Health Syst. 2014;8(1):7.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Ahrens J, Kokota D, Mafuta C, Konyani M, Chasweka D, Mwale O, et al. Implementing an mhGAP-based training and supervision package to improve healthcare workers’ competencies and access to mental health care in Malawi. Int J Ment Health Syst. 2020;14(1):11.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Patel V, Saxena S, Lund C, Thornicroft G, Baingana F, Bolton P, et al. The Lancet Commission on global mental health and sustainable development. Lancet. 2018;392(10157):1553–98.

    Article  PubMed  Google Scholar 

  11. Hamdani S, Akhtar P, Huma Z-e, Nazir H, Minhas F, Sikander S, et al. WHO parents skills training (PST) programme for children with developmental disorders and delays delivered by family volunteers in rural Pakistan: study protocol for effectiveness implementation hybrid cluster randomized controlled trial. Glob Ment Health. 2017;4:e11.

    Article  CAS  Google Scholar 

  12. Durkin M, Wang W, Shrout PE, Zaman SS, Hasan Z, Desai P, et al. Evaluating a ten questions screen for childhood disability: reliability and internal structure in different cultures. J Clin Epidemiol. 1995;48(5):657–66.

    Article  CAS  PubMed  Google Scholar 

  13. Mirza I, Mehmood T, Tareen A, Davidson L, Rahman A. Feasibility study on the use of the ten questions screen by lady health workers to detect developmental disabilities in Pakistan. JPPS. 2008;5(2):97–100.

    Google Scholar 

  14. Murray LK, Dorsey S, Bolton P, Jordans MJ, Rahman A, Bass J, et al. Building capacity in mental health interventions in low resource countries: an apprenticeship model for training local providers. Int J Ment Health Syst. 2011;5(1):30.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Kohrt BA, Jordans MJ, Rai S, Shrestha P, Luitel NP, Ramaiya MK, et al. Therapist competence in global mental health: development of the ENhancing Assessment of Common Therapeutic factors (ENACT) rating scale. Behav Res Ther. 2015;69:11–21.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Hamdani S, Huma Z-e, Wissow L, Rahman A, Gladstone M. Measuring functional disability in children with developmental disorders in low-resource settings: validation of developmental disorders-children disability assessment schedule (DD-CDAS) in rural Pakistan. Glob Ment Health. 2020;7:e17.

    Article  Google Scholar 

  17. Scorza P, Stevenson A, Canino G, Mushashi C, Kanyanganzi F, Munyanah M, et al. Validation of the “World Health Organization disability assessment schedule for children, WHODAS-Child” in Rwanda. PLoS ONE. 2013;8(3):e57725.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Varni JW, Seid M, Rode CA. The PedsQLTM: measurement model for the pediatric quality of life inventory. Med Care. 1999;37:126–39.

    Article  CAS  PubMed  Google Scholar 

  19. Scarpelli AC, Paiva SM, Pordeus IA, Varni JW, Viegas CM, Allison PJ. The Pediatric Quality of Life Inventory™(PedsQL™) family impact module: reliability and validity of the Brazilian version. Health Qual Life Outcomes. 2008;6(1):35.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Chen R, Hao Y, Feng L, Zhang Y, Huang Z. The Chinese version of the Pediatric Quality of Life Inventory™(PedsQL™) family impact module: cross-cultural adaptation and psychometric evaluation. Health Qual Life Outcomes. 2011;9(1):16.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Baggett KM, Carta JJ, Horn EM. Indicator of parent-child interaction (IPCI) user’s manual. Kansas: Department of Special Education, University of Kansas; 2009.

    Google Scholar 

  22. Goodman R. the strengths and difficulties questionnaire: a research note. J Child Psychol Psychiatry. 1997;38(5):581–6.

    Article  CAS  PubMed  Google Scholar 

  23. Samad L, Hollis C, Prince M, Goodman R. Child and adolescent psychopathology in a developing country: testing the validity of the strengths and difficulties questionnaire (Urdu version). Int J Methods Psychiatr Res. 2005;14(3):158–66.

    Article  PubMed  Google Scholar 

  24. Syed EU, Hussein SA, Mahmud S. Screening for emotional and behavioural problems amongst 5–11-year-old school children in Karachi. Pakistan Soc Psychiatry Psychiatr Epidemiol. 2007;42(5):421–7.

    Article  PubMed  Google Scholar 

  25. Koren PE, DeChillo N, Friesen BJ. Measuring empowerment in families whose children have emotional disabilities: a brief questionnaire. Rehabil Psychol. 1992;37(4):305.

    Article  Google Scholar 

  26. Stuart H, Milev R, Koller M. The inventory of stigmatizing experiences: its development and reliability. World Psychiatry. 2005;4(Suppl 1):35–9.

    Google Scholar 

  27. Chisholm D, Knapp MRJ, Knudsen HC, Amaddeo F, Gaite L, Van Wijngaarden B, et al. Client socio-demographic and service receipt inventory—European version: development of an instrument for international research: EPSILON study 5. Br J Psychiatry. 2000;177(S39):s28–33.

    Article  Google Scholar 

  28. Enders CK. Applied missing data analysis. Guilford press; 2010.

    Google Scholar 

  29. Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMC Med. 2010;8(1):18.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Divan G, Vajaratkar V, Cardozo P, Huzurbazar S, Verma M, Howarth E, et al. The feasibility and effectiveness of PASS plus, a lay health worker delivered comprehensive intervention for autism spectrum disorders: pilot RCT in a rural low and middle income country setting. Autism Res. 2019;12(2):328–39.

    Article  PubMed  Google Scholar 

  31. Rahman A, Hamdani SU. Supporting intervention providers and families in South Asia. In: Siller M, Morgan L, editors. Handbook of parent-implemented interventions for very young children with autism. Cham: Springer International Publishing; 2018. p. 393–402.

    Chapter  Google Scholar 

  32. Desai MU, Divan G, Wertz FJ, Patel V. The discovery of autism: Indian parents’ experiences of caring for their child with an autism spectrum disorder. Transcult Psychiatry. 2012;49(3–4):613–37.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Divan G, Vajaratkar V, Desai MU, Strik-Lievers L, Patel V. Challenges, coping strategies, and unmet needs of families with a child with autism spectrum disorder in Goa, India. Autism Res. 2012;5(3):190–200.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Krishnamurthy V. A clinical experience of autism in India. J Dev Behav Pediatr. 2008;29(4):331–3.

    Article  PubMed  Google Scholar 

  35. Vaidya S, Ignou M, editors. A sociological study of families of children with autism in Delhi: issues and challenges. In: Asian Pacific autism conference. http://www.autism-india.org/india_research.html; 2009.

  36. Rahman A, Divan G, Hamdani S, Vajaratkar V, Taylor C, Leadbitter K, et al. Effectiveness of the parent-mediated intervention for children with autism spectrum disorder in south Asia in India and Pakistan (PASS): a randomised controlled trial. Lancet Psychiatry. 2016;3(2):128–36.

    Article  PubMed  Google Scholar 

  37. Hall CM, Bierman KL. Technology-assisted interventions for parents of young children: emerging practices, current research, and future directions. Early Child Res Q. 2015;33:21–32.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Rahman A, Akhtar P, Hamdani SU, Atif N, Nazir H, Uddin I, et al. Using technology to scale-up training and supervision of community health workers in the psychosocial management of perinatal depression: a non-inferiority, randomized controlled trial. Glob Ment Health. 2019;6:e8.

    Article  Google Scholar 

  39. Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013;8(1):117.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Grand Challenges Canada/Grand Défis Canada. Integrated innovation. Grand Challenges Canada at the Sandra Rotman Centre; 2020.

  41. Carlson GA, Elvins R. Editorial: do we need inpatient units? Child Adolesc Ment Health. 2021;26(2):97–8.

    Article  PubMed  Google Scholar 

  42. Hamdani SU, Huma ZE, Tamizuddin-Nizami A. Debate: child and adolescent mental health services in Pakistan; do we need in-patient mental health facilities for children and young people? Child Adolesc Ment Health. 2021;26(2):182–3.

    Article  PubMed  Google Scholar 

  43. Keynejad RC, Dua T, Barbui C, Thornicroft G. WHO Mental Health Gap Action Programme (mhGAP) intervention guide: a systematic review of evidence from low and middle-income countries. Evid Based Ment Health. 2018;21(1):30–4.

    Article  PubMed  Google Scholar 

  44. Adebowale TU, Umukoro OL, Gater R, Akinhanmi A, Ogunlesi A. Evaluation of a mental health training course for primary health care workers in Ogun State, South West, Nigeria. J Psychiatry. 2014;17:5. https://doi.org/10.4172/Psychiatry.1000141.

    Article  Google Scholar 

  45. Bruni A. Assessing the efficacy of the Mental Health Gap Action Programme (mhGAP) training for non-specialized health workers in Ethiopia; 2014.

  46. Siriwardhana C, Adikari A, Jayaweera K, Abeyrathna B, Sumathipala A. Integrating mental health into primary care for post-conflict populations: a pilot study. Int J Ment Health Syst. 2016;10:12.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Kidwell KM, Hyde LW. Adaptive interventions and SMART designs: application to child behavior research in a community setting. Am J Eval. 2015;37(3):344–63.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Kasari C, Sturm A, Shih W. SMARTer approach to personalizing intervention for children with autism spectrum disorder. J Speech Lang Hear Res. 2018;61(11):2629–40.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Glasgow RE, Riley WT. Pragmatic measures what they are and why we need them. Am J Prev Med. 2013;45(2):237–43.

    Article  PubMed  Google Scholar 

  50. Murphy SA. An experimental design for the development of adaptive treatment strategies. Stat Med. 2005;24(10):1455–81.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

We thank the project staff at the Human Development Research Foundation, Islamabad, Pakistan, namely Mr. Muhammad Aslam, Ms. Azza Warraitch, Ms. Midhat Farzeen, Ms. Hadia Maryam, Ms. Sidra Mumtaz, Ms. Naila Muzzaffar, Ms. Gulshan Huma, Ms. Anila Qureshi, Ms. Maria Kanwal, Ms. Alina Rasheed, Ms. Tahira Jabeen, and Ms. Nawal Nasir, for their contributions in data collection and research activities. Finally, we thank the participants and their families for their voluntary participation in the program.

Funding

The study was financially supported by Grand Challenges, Canada and the Government of Canada (Grant number 0746-05-GMH). Matched funding was provided by Autism Speaks (Grant number 10377), USA and Human Development Research Foundation, Islamabad, Pakistan. The study proposal went through a peer review process before award funding. The study sponsor and funders have no role in the study design; collection, management, analysis, and interpretation of data; writing of the report; and the decision to submit the report for publication.

Author information

Authors and Affiliations

Authors

Contributions

SUH, ZeH, DW had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. SUH, AR, FAM conceived the study. SUH, ZeH, DW were involved in acquisition, analysis, or interpretation of data. SUH, ZeH, FAM and AR, FAM drafted the 1st draft of the manuscript. All authors were involved in drafting and commenting on the manuscript. All authors read and approved the final manuscript.

Authors’ information

The authors alone are responsible for the views expressed in this article, which do not necessarily represent the views, decisions or policies of the institutions with which they are affiliated. CS is a staff member of the World Health Organization. Authors alone are responsible for the views expressed in this Article and they do not necessarily represent the views, decisions, or policies of the institutions with which they are affiliated.

Corresponding author

Correspondence to Syed Usman Hamdani.

Ethics declarations

Ethics approval and consent to participate

The ethical approval for the present study was obtained by Research and Ethical Committee, Rawalpindi Medical College and Allied Hospitals, Rawalpindi and Human Development Research Foundation, Islamabad Pakistan. Approval obtained on 29 Dec, 2016 and 29 Jan, 2017, respectively.

Consent for publication

The consent for publication was obtained from all study participants at the time of enrolment.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hamdani, S.U., Huma, Ze., Suleman, N. et al. Effectiveness of a technology-assisted, family volunteers delivered, brief, multicomponent parents’ skills training intervention for children with developmental disorders in rural Pakistan: a cluster randomized controlled trial. Int J Ment Health Syst 15, 53 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s13033-021-00476-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s13033-021-00476-w

Keywords