Research priority-setting: reproductive health in the occupied Palestinian territory
Occupied Palestinian territory (oPt) is an authority with limited resources. Therefore, research conducted in such a setting should be prioritized and coordinated to follow a national research agenda. This study aims to produce a research agenda for reproductive health in the oPt that can be utilized by reproductive health stakeholders and contribute to the development of policy-based evidence to guide health practice.
In the current study, we followed research prioritization methods developed by the World Health Organization-Child Health and Nutrition Research Initiative. Research questions were obtained from reproductive health experts in the oPt. The questions were then grouped into thematic areas which were prioritized by the reproductive health experts. Scores were calculated and sorted to define the top priority research areas.
A total of 232 research questions were prioritized by 30 reproductive health experts. Health system issues were the most addressed in the top 50 research questions. They included questions on the quality of services and health professionals’ knowledge and continuous professional training. Adolescents’ sexual and reproductive health and gender-based violence were rarely mentioned in the top 50 questions. The number of questions related to safe motherhood was around 50% followed by questions related to health system. Questions related to elderly women and menopause as well as reproductive system cancers were also within the top 50 ranked questions.
Priority research areas in reproductive health were identified for the oPt, which should be utilized by researchers with a focus on the high priority areas. Policy makers and funders should coordinate their efforts to ensure the production of research with value to the Palestinian context, in the most efficient way possible.
Reproductive health experts in the occupied Palestinian territory were able to identify previously unaddressed priority research areas related to reproductive health
Future research needs to be guided by the research priority list to maximize efficient utilization of resources
The quality of services within the health system were among the top priority research areas identified, whereas questions related to adolescents sexual and reproductive health were least prevalent
Plain English summary
Policy makers today are more reliant upon evidence-based policy planning than ever before, which increases the demand for research production. To keep up with this increasing demand, it is especially important for countries with limited resources, such as the occupied Palestinian territory (oPt), to identify priority research areas in order to focus their resources on the needed evidence and reduce duplication of existing studies. This study aims to identify a list of the most important reproductive health research questions proposed by Palestinian health providers and experts. The participants included most of the stakeholders and experts in reproductive health service provision and research in the oPt. These experts identified research questions which were grouped by the researchers into common themes. These themes were further prioritized by the experts based on standardized methods. A list of 50 research questions were identified. Several questions related to the health system, including quality of care, health professionals’ knowledge and preparedness, access to and availability of services, were among the most important questions. Questions related to high-risk pregnancies and maternal mortality were also within the 50 top research questions. Few questions on adolescents’ sexual and reproductive health and gender-based violence were within the top 50 research questions. Future research should focus on the identified high priority areas. Policy makers and funders should work in coordination to ensure the production of research with value to the Palestinian context.
Around 85% of research investment worldwide is wasted as reported by Chalmers et al. A waste in research was considered, “when the need of potential user of research evidence was ignored or when available evidence was overlooked” . The reasons for waste included choosing the wrong research question, conducting studies that are poorly designed, and failing to publish unusable sections of research . It thus becomes imperative to set research priorities to help maximize evidence utilization and reduce research waste, especially in low-income countries with limited research resources .
In the occupied Palestinian territory (oPt), research is mainly conducted by academic institutions, occasionally in collaboration with health providers. Research conducted is mainly selected based on consultation with health providers, observation, and experience of the researcher in a specific field or in response to a funder and/or health provider request . The number of published papers focusing on health in Palestine/oPt has increased since 2010 compared to previous years. However, only 29% of these papers were cited more than 5 times , which might indicate local rather than international importance. In addition, it might indicate that these studies are not addressing the right questions.
In relation to reproductive health (RH) research, a comprehensive review on maternal and child health in the oPt described the situation with respect to the fourth and fifth Millennium Development Goals on reducing child mortality and improving maternal health, respectively. The review also identified several research areas as well as reported the type of research conducted and the quality of available data .
Several research priority exercises were conducted to address the global, and more specifically, low and middle-income countries needs [6, 7, 8, 9]. However, a country-specific research priority list is imperative to help provide the needed evidence for program and intervention planning at the national level. Therefore, this study aims to build a research agenda for RH in the oPt that can be utilized by RH stakeholders and contribute to the development of policy-based evidence to guide health practice.
We used the reproductive health definition adopted by the International Conference on Population Development (ICPD) Program of Action held in Cairo in 1994. In the current study, we followed research prioritization methods developed by the World Health Organization’s (WHO) Child Health and Nutrition Research Initiative (CHNRI) . The prioritization exercise was implemented in three phases: (1) the generation and collection of research questions, (2) consolidation of research questions and thematic analysis, and (3) the prioritization exercise of the research questions using pre-defined scoring criteria.
The main stakeholders in RH in the West Bank and Gaza Strip were identified in part by consulting the stakeholders who participated in the Palestinian National Reproductive Health Strategy and Action Plan 2014–2016. These stakeholders mainly included the Palestinian Ministry of Health and other governmental ministries, the United Nations Relief and Works Agency for Palestine Refugees (UNRWA) and national non-governmental organizations as well as a number of private physicians. In addition, researchers representing Palestinian academic institutions were included, thus tapping into the clinical aspect of reproductive health alongside the academia aspect. Invitations were sent to the identified participants of 45 individuals from 21 national organizations, through email, fax, and phone. Out of those who were approached, 34 individuals from 19 organizations responded positively to the invitation (individual response rate of 75.6%). Participants were asked to propose six research questions in the field of reproductive health; each based on his/her expertise, knowledge and experience. Phase 1 was completed between December 2015 and January 2016.
The list of proposed research questions was independently reviewed by two researchers. A third reviewer evaluated the list of questions from the two reviewers and resolved discrepancies. A reduced and refined list of research questions was prepared for thematic analysis. Phase 2 was completed between January 28th – February 18th, 2016.
A total of 32 individuals from 19 organizations were invited to participate in the research priority scoring exercise, through email, phone, and fax (where appropriate). Of the total invited participants (who also participated in phase 1), 30 individuals from 16 organizations responded positively to the invitation (individual response rate of 93.8%) and four responses were received by email because of mobility issues. Phase 3 was completed between February 28th – April 1st, 2016.
Scoring criteria for the research priority-setting exercise in reproductive health
Score and explanation
The research question can be ethically answered
0- Cannot be answered
5- Can be fully answered
The new knowledge is likely to result in an effective intervention or program in the reproductive health field
0- Not effective
5- Very effective
The research is likely to generate new knowledge that can help in improving reproductive health in an acceptable and affordable manner
0- Cannot be delivered
5- Can be fully delivered
4. Potential impact
The results of this research will have a public health impact (improve the reproductive health from the public health perspective)
0- No Public health impact
5- High public health impact
The research will include and target the most vulnerable sectors of society
0- Not equitable
An excel spreadsheet with the research questions was shared with the participants. They were then instructed to score each research question against the five criteria, where each criterion had a score range of 0–5. In addition, in the case that participants were not able to make a judgment on a research question, they had the option of indicating ‘I don’t know’ and ‘not applicable’ on the spreadsheet.
The metrics-based approach (pooling individual rankings), as employed by the WHO-CHNRI, was used for data analysis. For each research question, an unweighted mean score was calculated by summing up the individual scores of each criterion. No special weighting was applied to the criteria. ‘I don’t know’ and ‘not applicable’ was treated as missing and was not included in the calculation of the average. The resulting score of each research question was obtained and the research questions were ranked and prioritized according to their score. The top 50-research questions with a total score of 85+ were reported in the results section.
Reproductive health topics
Priorities by respondents
Top (highest scoring) research priority questions by reproductive health experts
Assess community preparedness and acceptability regarding reproductive system cancers
Evaluate the level of community knowledge, attitudes, and perceptions towards prenatal, antenatal, and postnatal services; RTI/STIs; abortion and miscarriage services; family planning and contraception; and the role of men in family planning
Evaluate the level of community knowledge, attitudes, and perceptions towards reproductive system cancers including screening and detection
Assess and evaluate the support system for women with reproductive system cancers during labor and the postnatal period
Assess and evaluate the methods adopted by health professionals in spreading awareness and education on reproductive health among adolescents
Understand the Epidemiology (prevalence/ distribution/ determinants/ associated factors) of high risk pregnancies
Evaluate the effectiveness of existing reproductive health services to prevent post-partum hemorrhage
Assess the availability of the types of services provided for family planning, postnatal care, labor, and delivery
Assess the availability of the types of services provided for antenatal care, reproductive system cancers, nutrition, and infertility
Assess the protocols and guidelines implementation cycle (availability, comprehensiveness, knowledge, training, and application) regarding early marriage and teenage pregnancy
Assess the affordability and access to Antenatal care, postnatal care, labor, abortion, and miscarriage services
Assess the availability of the types of services provided for antenatal care; reproductive system cancers; RTIs/STIs; menopause; infertility; GBV; early marriage and teenage pregnancies
Understand the Epidemiology (prevalence/ distribution/ determinants/ associated factors) for post-partum hemorrhage
The current study identified the national research priority areas within reproductive health in the oPt. The list is comparable to the one identified for low and middle income countries by de Francisco et al. . A wide range of questions were raised, including simple epidemiology questions, health system, and social and behavioral questions. However, the list lacked specific clinical, operational, or intervention questions. As for reproductive health topics, questions related to safe motherhood were more than 50% of the questions followed by health system related questions. Adolescents health and gender-based violence questions were least mentioned. Interestingly, a greater emphasis was given to questions related to elderly women in their menopausal phase. Usually, this group is categorized within the marginalized or vulnerable groups. It is also worth mentioning that topics such as abortion and sexually transmitted infections (STI) were neither in the top 20 nor 50 priority areas. Although they were mentioned by different local experts, they did not reach enough consensuses to be ranked highly.
The process of setting research priorities in low and middle-income countries is challenging since it requires the involvement of all stakeholders to come to a national consensus. In our study, Palestinian experts and stakeholders working in reproductive health at the governmental and non-governmental sectors, universities, gynecologists, and statistical offices participated in this exercise. The challenge we faced was at the beginning of this exercise because some stakeholders did not understand the process and aim of the research priority setting and they thought it is funding priorities for reproductive health services. However, once they understood the aim and importance of the exercise, they became motivated and had almost a hundred percent response rate. This is in line with Rudan’s et al. main recommendation to improve the process of prioritization in health research by increasing the acceptability and popularity of such process with local policy makers .
The results of this study provide local and context-specific questions which cannot be compared to other countries specifically; nevertheless, they are in line with what has been reported by de Francisco et al. . The results were general and not specific as reported in other studies since our study asked for general research questions while the other studies focused on interventions [7, 14] or specific governmental services . In fact, research priority setting is an iterative process, and this is only the first step in a much longer process of refining the research priority areas into more specific questions. Hence this list should be reviewed and updated regularly. Based on the presented RPS findings, area specific research priority setting should be conducted for some topics, such as family planning and adolescents health, where validated methods were developed and used previously [6, 7, 16]. These areas were mentioned by different experts but did not reach consensus on specific questions.
The priorities were not similar across different respondents, perhaps because each was gearing the question toward their interest and experience. For example, the gynecologists were asking about unwanted pregnancies and abortion, health providers were interested in how to address cultural and norms barriers to family planning services, and other ministries were inquiring on how to improve family planning awareness and education, etc. Service providers in general were interested in understanding factors that are beyond their control, including cultural norms and beliefs, to improve their services. As for academics, in addition to understanding the quality of available health services, they were also interested in understanding the burden of selected topics locally that is of international importance. Although variation exists, the overall responses were complementary, and a comprehensive list of research priority was produced and agreed upon by all respondents.
Strengths and limitations
This study provides the first evidence-based research priority setting in reproductive health in the oPt. The output is a list that highlights the main areas that need to be researched to inform health policy. A slight modification to priority setting process was applied in the last phase where we invited the different stakeholders to participate in a workshop for the final scoring exercise rather than continue the communication through e-mail. This step was taken to ensure a high response rate and to receive the responses in a timely fashion. We had a high response rate at the different data collection levels which emphasizes the agreement of all experts in the reproductive health field on having national research priorities for reproductive health. We acknowledge the limitation that the study excluded neonatal health from the priority setting as these topics were not mentioned by the experts in phase 1.
Given that priority setting in health research is not a theoretical exercise with a single possible correct outcome and final decisions depend on the context , various approaches exist to guide the process of research priority setting [17, 18, 19, 20]. In this study, we tried to maintain a high quality prioritization process following the CHNRI method which is a standardized method that has been used internationally and in different countries at the national level .
Priority research areas in reproductive health were identified. The research priority list should be utilized by researchers, policy makers and funders to ensure that the results of the conducted research are of value to the Palestinian population and context.
We would like to thank the Ministry of Education, the Ministry of Women Affairs, the Palestinian Central Bureau of Statistics, the Palestinian National Institute of Public Health, Health Work Committee, Juzoor for Health and Social Development, the Palestinian Medical Relief Society, An-Najah National University, Birzeit University, Al-Quds University, Bethlehem University, Ibn Sena National College, Al-Azhar University, Al-Islamic University, University College of Applied Sciences, Palestine College of Nursing, private consultants in reproductive health, and a number of health practitioners and gynecologists from Al-Makassed Charitable Hospital, the Palestine Medical Complex and the Arab Care Hospital for their participation in the research priority-setting exercise.
This work was funded by the UNDP-UNFPA-UNICEF-WHO-World Bank Special Programme of Research, Development and Research Training in Human Reproduction (HRP), a cosponsored program executed by the World Health Organization (WHO).
Availability of data and materials
The data used during the current study are available from the corresponding author upon reasonable request.
NMEAR conceptualized the research idea. NMEAR, MT and RG developed the study design and methods. MT, RG and MO were responsible for data collection. NMEAR, MT and RG analyzed the data. NMEAR wrote the manuscript and all authors read and approved the final draft of this manuscript.
Ethics approval and consent to participate
The research proposal was approved by the Institute of Community and Public Health Research Ethic Review Committee, which included Ms. Suzan Mitwali, MPH and Ms. Laura Wick, MSc.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
- 4.Albarqouni L, Abu-Rmeileh NM, Elessi K, Obeidallah M, Bjertness E, Chalmers I. The quality of reports of medical and public health research from Palestinian institutions: a systematic review. BMJ Open. 2017;7(6)Google Scholar
- 5.Rahim HFA, Wick L, Halileh S, Hassan-Bitar S, Chekir H, Watt G, Khawaja M. Maternal and child health in the occupied Palestinian territory. Lancet, 373. (9667):967–77.Google Scholar
- 7.Souza JP, Widmer M, Gülmezoglu AM, Lawrie TA, Adejuyigbe EA, Carroli G, Crowther C, Currie SM, Dowswell T, Hofmeyr J, et al. Maternal and perinatal health research priorities beyond 2015: an international survey and prioritization exercise. Reprod Health. 2014;11(1):61.CrossRefPubMedPubMedCentralGoogle Scholar
- 8.Dean S, Rudan I, Althabe F, Webb Girard A, Howson C, Langer A, Lawn J, Reeve ME, Teela KC, Toledano M, et al. Setting research priorities for preconception care in low- and middle-income countries: aiming to reduce maternal and child mortality and morbidity. PLoS Med. 2013;10Google Scholar
- 9.Tomlinson M, Rudan I, Saxena S, Swartz L, Tsai AC, Patel V. Setting priorities for global mental health research. Bull World Health Organ. 2009;87Google Scholar
- 10.Rudan I, Gibson JL, Ameratunga S, El Arifeen S, Bhutta ZA, Black M, Black RE, Brown KH, Campbell H, Carneiro I, et al. Setting priorities in global child Health Research investments: guidelines for implementation of the CHNRI method. Croatian Medical Journal. 2008;49(6):720–33.CrossRefPubMedPubMedCentralGoogle Scholar
- 11.Mendis SAA, editor. Prioritized research agenda for prevention and control of noncommunicable diseases. Geneva: World Health Organization.Google Scholar
- 12.de Francisco A dAC, Ringheim K, Liwander A, Peregoudov A, Faich HS, et al. Perceived research priorities in sexual and reproductive health for low-and middle-income countries: results from a survey. Geneva: Global Forum for Health Research; 2009.Google Scholar
- 13.Rudan I, Kapiriri L, Tomlinson M, Balliet M, Cohen B, Chopra M. Evidence-based priority setting for health care and research: tools to support policy in maternal, neonatal, and child health in Africa. PLoS Med. 2010;7Google Scholar
- 14.Dean S, Rudan I, Althabe F, Webb Girard A, Howson C, Langer A, Lawn J, Reeve M-E, Teela KC, Toledano M, et al. Setting research priorities for preconception Care in low- and Middle-Income Countries: aiming to reduce maternal and child mortality and morbidity. PLoS Med. 2013;10(9):e1001508.CrossRefPubMedPubMedCentralGoogle Scholar
- 16.Ali M, Seuc A, Rahimi A, Festin M, Temmerman M. A global research agenda for family planning: results of an exercise for setting research priorities. Глобальный план исследований в области…. 2014;92(2):93–8.Google Scholar
- 17.Angulo A, Freij L, De Haan S, de los Rios R, Ghaffar A, Ijsselmuiden C, Janssens M, Jeenah M, Masood A, Montorzi G, et al. COHRED working paper 1. Priority setting for Health Research: toward a management process for low and middle income countries. Geneva: Council on Health Research for Development; 2006.Google Scholar
- 18.Ghaffar A, de Francisco A, Matlin S. The combined approach matrix: a priority-setting tool for health research. Geneva: Global Forum for Health Research; 2004.Google Scholar
- 19.Kaplan WA, Laing R. Priority medicines for europe and the world. Geneva: World Health Organization; 2004.Google Scholar
- 20.Rudan I, Chopra M, Kapiriri L, Gibson J, Ann LM, Carneiro I, Ameratunga S, Tsai AC, Chan KY, Tomlinson M, et al. Setting priorities in global child health research investments: universal challenges and conceptual framework. Croat Med J. 2008;49Google Scholar
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.