Study design
The effectiveness of the pilot intervention was tested in a longitudinal one-group study with a pretest at the start of the program, a post-test immediately after the program, and follow-up test three months after the end of the program. The study was conducted in Motherwell, a township in the city of Port Elizabeth in the Eastern Cape province of South Africa. Preliminary data analyses showed that not all caregivers from Motherwell completed all modules. We therefore decided to base the evaluation of the intervention not only on an analysis of baseline vs. post-test differences but also included a comparison between older caregivers in Motherwell who completed the full intervention by participating in all four sessions (N = 141) and those who did not or only partly (N = 61) in what can be called a quasi-experimental design.Footnote 1
Study setting
The participants in this study were isiXhosa speaking people of 60 years and older who were responsible for the care for their sick children and/or (orphaned) grandchildren as a result of HIV and AIDS. Historically the Eastern Cape is home to a predominantly isiXhosa population and portrays rich cultural traditions. Motherwell consists of informal settlements and is part of the Nelson Mandela Metropolitan Municipality (NMMM). The majority of the population in the metropolitan is African, younger than 30 years old and does not have a secondary school qualification (Nelson Mandela Bay Municipality 2008).
As other informal settlements in the Eastern Cape, Motherwell is faced with high rates of unemployment, poverty and service delivery backlogs (Department of Provincial and Local Government South Africa 2005; Eastern Cape Department of Social Development 2008; Eastern Cape Provincial Government 2007). According to the latest statistics of the Department of Health in South Africa (2007), HIV-infection and AIDS are very prevalent in the Eastern Cape as 28.6% of the antenatal clinic attendees in the Eastern Cape were found to be infected with HIV in 2006. No other specific information about the HIV prevalence in Motherwell was found.
Participants
In total 209 older persons participated in the baseline interview. Five participants were excluded from the data analyses as they did not fulfill the inclusion criteria, which were: participants had to speak isiXhosa, be over the age of 60, and look after sick or orphaned children or grandchildren. Two participants were excluded as no consent forms were found for them. This resulted in a final sample of 202 participants.
Recruitment and research procedures
As no detailed populations statistics were available in the testing area from which a probability sample could be extracted, six community health workers and three community members were approached to provide access to caregivers with whom they had worked with extensively. The community health workers and community members were employed by Age-in-Action, a local non-governmental organization and partner in this project. The recruiters were carefully selected and intensively trained and were responsible for recruiting participants, collecting baseline data, and conducting the workshops. In total six new community members were employed and trained for collecting posttest and follow-up data. All recruiters and interviewers were female, spoke isiXhosa as their first language and lived in the same community as the older caregivers. Through their extensive knowledge of the area and experience of working with older people through Age-in-Action, the health workers were able to access older caregivers in the community.
The recruiters approached isiXhosa speaking older caregivers of 60 years and older at their Age-in-Action club activities; they explained the aims and objectives of the study and invited them to participate. Through a snow-ball effect, other older community members became aware of the study and showed interest to participate. They were also approached by community health workers and were invited to participate if they matched the inclusion criteria.
Community health workers and members received a four-day interactive training about the implementation of the intervention. They were taught in a participatory manner how to facilitate the workshops with the older people and make a record of the sessions. Four teams were set up comprising each of one facilitator and one co-facilitator. The training sessions as well as the actual modules were conducted in isiXhosa, the first language of both the health workers and the participants. Quality control was observed by an external professional who supported the health workers on-site and was able to immediately remedy situations that arose, especially by providing on-going motivation for the health workers to maintain the desired standard of training. Besides, the external professional person was also valuable in providing emotional support and counseling for participants who were in need of sharing their experiences.
One-on-one interviews were used for data collection at all three time intervals. Questions and possible responses were read out loud to the participants and paper questionnaires were used to register responses. The interviews were conducted in isiXhosa and took place at the homes of the participants. Each interview took about one hour and twenty minutes. Detailed information about the content, procedures and confidentiality of the study was provided to the participants both verbally and in writing before consent was obtained. Ethical approval for the study was granted by the South African Medical Association Ethics Committee.
The intervention
Based on information collected in previous formative research (Boon et al. under review; Reddy 2005), a quantitative survey (Boon et al. 2009a), a focus group discussion with community health workers of Age-in-Action and interviews with senior staff of Age-in-Action, possible topics for the workshops were decided upon. Also relevant parts of existing manuals and interventions that were conducted in similar settings were adjusted, and contributed to the development of the intervention (Nurses Association of Botswana 2004; Saleh-Onoya et al. 2008; Save the Children 2003; Sifunda et al. 2008; Vlok 1977; Willis et al. 2005). The workshops were based on interactive, participatory discussions and practical exercises. Factual knowledge was provided through talks and handouts. The groups consisted of 10 to 12 older participants each. The intervention consisted of four weekly workshop-sessions, each of about three hours containing a range of topics. Module 1 provided accurate information about HIV and AIDS and explored the behavior and understanding of young people of today. Module 2 addressed skills to bridge the generational communication gap between caregivers and their children and grandchildren and included topics such as how to talk about sensitive matters. Module 3 focused on skills to provide basic home-based nursing care to sick children and aimed at improving knowledge to maintain medication compliance. Module 4 explored the topic of social assistance and provided up-to date information on accessing the available support services. Besides, each workshop included a component in which practical relaxation techniques and basic exercises were trained. Please contact the first author for a detailed overview of the content of the modules. Each intervention objective was addressed by specific psychosocial change targets and intervention techniques (Abraham and Michie 2008), Table 1 provides an overview.
Table 1 Psychosocial Intervention Objectives, Change Targets and Techniques
Workshop participation
Caregivers were invited to participate in all four workshops. Of the 202 participants, 141 older people completed all four workshop sessions, 13 participants did not attend all four workshops and 48 participants did not attend any workshop session at all. Reasons for non-attendance were mostly related to health problems (N = 22), being out of town (N = 9) or work responsibilities (N = 3). Two participants were not able to attend due to death in their families, one participant was not fully aware of the transport arrangements for attending the workshops and one participant was unable to leave her sick child alone. Two participants passed away during the course of the study and one participant was not interested in attending the workshops. For seven participants the reasons for non-attendance were unknown. All participants were provided daily with transport, tea and lunch and on completion of the training they received a gift as a token of appreciation. After completion of the workshops, an immediate post-test interview was conducted among 177 participants (response rate = 88%), followed by a follow-up interview after three months among 182 participants (response rate = 90%).
Measures
The measurement instruments were based on findings from previous qualitative and quantitative studies (Boon et al. 2009a, b, under review; Reddy 2005), existing literature about older people as providers of care, and general predictors of human behavior derived from social cognition models (Connor and Norman 2005). Demographic details included age, gender, marital status, schooling, income and number of dependents.
An overview of the measurements at baseline, immediate post-test and follow-up, including scales, sample items and Cronbach’s alpha can be found in Table 2. All measurements were based on Likert-type items with three, four or five response options. Validated instruments were used to measure depression (i.e., Hopkins Symptom Checklist-25; Derogatis et al. 1974; Hesbacher et al. 1980) and ways of coping (i.e., Ways of Coping Checklist; Folkman and Lazarus 1985). Factor analysis was used to confirm the structures of existing scales and subscales. For the depression scale, all items, except two which were culturally inappropriate, were included into one scale after inspection of the scree-plot, which showed one factor. The original Ways of Coping Checklist (Folkman and Lazarus 1985) defined six subscales. In this study, factor analysis did not find the expected six subscales. After thorough inspection of the individual items and the scree-plot, the scale was divided into two subscales: proactive and passive coping (see Table 2). One item was removed from the passive coping scale as it was not appropriate in the cultural context of the sample.
Table 2 Overview of Scale Measures at Baseline, Post-test and Follow-upa
For each measure, scores on items that showed sufficient internal consistency (Cronbach’s alpha [α] > .60) were averaged into a single index. Higher scores reflected a stronger presence of the concerning variable.
Data analyses
SPSS v15.0 (SPSS, Chicago, IL) was used to analyze the data. The analysis was stratified by baseline, post-test and follow-up. Frequency analyses were conducted to describe the demographic characteristics of the study sample at baseline and Pearson’s Chi Square (χ2) and t tests to determine possible statistically significant differences between the participating and non-participating groups. Separate univariate analyses of covariance (ANCOVA) were conducted to explore the effects of the intervention at immediate post-test and 3-month follow-up respectively for those with complete participation (N = 141) vs. those with incomplete or no participation (N = 61), while controlling for baseline measures. A 5% significance level was observed throughout. However, given the quasi-experimental design and the relative high number of outcome variables, the Bonferroni correction was used to control for multiple comparisons in the ANCOVAs resulting in an observed significance level of <0.003 (0.05 divided by N = 19 outcome variables).