Skip to main content

Mixed research methods in political science and governance: approaches and applications

Abstract

It is widely accepted that an appropriate combination of quantitative and qualitative methods provides a better understanding of research problems as opposed to using them separately. This mixed approach is trying to cover any gaps and weaknesses between the quantitative and qualitative research. Furthermore, triangulation is a common way to combine quantitative and qualitative approaches, which has been used in numerous studies in order to detect different aspects of the research question as well as because the deficiencies of one method are often the forces of the other. The use of multiple methods reflects an attempt to understand and study the phenomenon under in depth investigation, while triangulation is not as much a results-validation strategy, but more of an alternative proposal for validation, through which the breadth, depth and consistency of the methodological processes is increased. There are different types of triangulation, but a mainstream process may include but is not limited at: (a) data triangulation, (b) investigator triangulation, and (c) methodological triangulation, in the version of triangulation of methods belonging to different paradigms. This paper will study and analyze the importance of mixed methods in political science and especially in governance and public policy research by focusing on specific examples of related research and outcomes. The main reason is to assess the importance of mixed methods in achieving better understanding of the social problems and transitions in the post-covid-19 era and thus shed light in contemporary issues related to governance and public policies.

Introduction

Several researchers claim that an appropriate combination of quantitative and qualitative methods provides a better understanding of research problems as opposed to using them separately (Creswell & Plano Clark 2007). As Johnson & Onwuegbuzie (2004) typically point out, this is about forming a third research model, which seeks to bridge the gap between the two dominant models of quantitative and qualitative research. At the same time, scholars studying issues related to public policy and governance with comparative perspectives tend to increasingly use mixed methods and triangulation strategies (Wolf 2010).

Hence, a proper way for combining qualitative and quantitative methods could be triangulation. This method could also be used in public policy and governance research and through this way researchers could on the one hand, create a comprehensive depiction of the current situation of problems and processes while on the other, enable a multidimensional comparative analysis of the resulting data, which is crucial as it allows in depth analysis and comprehensive understanding. This approach has been used in several studies in the fields of services, human resources management and development (Papadakis et al. 2020; Papadakis et al. 2018) as well as human rights issues or migration (Kotroyannos et al. 2019) and generally in social sciences and in comparative public policy research (Wolf 2010). Furthermore, this mixed method approach is appropriate for studying the different aspects of third sector activities and role, namely social enterprises, civil society activities or non-profit organizations, as long as their importance has been increased recently (Macmillan 2020).

By triangulating different methodological approaches, tracing is easier on different aspects of the research question about the role, impact and decision making processes, while the logic of this strategy is that the deficiencies of one method are often the forces of the other. Through this combination, researchers can make the best use of each by overcoming the shortcomings of their individual use and therefore, unveil the functional characteristics of the related public policies and patterns of governance. Accordingly, in the available literature and in the field research there are several examples of the implementation of this approach. In this paper we will focus on three categories of field research that has used mixed methods in the broader area of public policy and governance. There is a focus on analyzing the role and the importance of mixed methods and triangulation in specific cases of research in the field of local governance, public policies for social integration and governance patterns in the non-governmental sector. The selected focus is justified as long as, while there are always some limitations, there is an increasing use of mixed methods in the field of public-local administration and public policies (Hendren et al. 2018) as well as in the non-governmental sector (Paull & Girardi 2017).

The third research model: the triangulation method of approach

According to the third research model, namely the triangulation strategy, researchers can bring out more dimensions of the researched subject both in depth and in total, minimize the inherent bias in each individual source, method and research approach, as well as achieve greater credibility with regard to the resulting data. The use of the term “triangulation” is connected to the approach of gathering data with multiple ways from multiple sources in a research process. Thus, researchers can measure a certain concept or assess a particular hypothesis (Kapiszewski D. et al. 2015).

Four types of triangulation have been developed by Denzin in his comprehensive and well documented analysis. These types have been adopted by a large number of scholars. According to Denzin’s categorizations of 1978 and 2006 as well as according to Carter et al. (2014) these types are the followingFootnote 1:

  1. a.

    data triangulation,

  2. b.

    investigator triangulation,

  3. c.

    theory of triangulation,

and (d) methodological triangulation, in the version of triangulation of methods belonging to different paradigms. As for the triangulation of data, information should derive from different sources.

Fig. 1
figure 1

Types of Triangulation

Furthermore, according to Denzin (1978), in order to understand a social phenomenon, it is required to be examined under a variety of conditions. Regarding the second type of triangulation, data collecting and analyzing processes will work with different researchers, each with a different area of specialization, in order to prevent one-dimensional approaches to the phenomenon under investigation, to balance subjective perspectives and to strengthen the research process. This is very important in the analysis of public policies or governance issues as long as there is a vast number of interrelated parameters with the social, political and economic context.

The qualitative research can be based on the grounded theory, as it constitutes a set of data collection and analysis procedures, on the basis of which useful conclusions could be drawn on the research issues and the relevant theoretical approaches could be formulated comprehensively. In this way, researchers develop an inductive method. Thus, while the research begin with the focus on the individual characteristics of the interviewees, it is followed by a gradual process of conceptual categorization, with the aim of synthesizing, explaining, and analyzing from the extracted data (Lacey 2001: 380). Simultaneously, the main purpose of quantitative research is to discover the causes of the changes on social phenomena through objective measurement and numerical analysis (Kontogiannatou 2018) while trying to remain “objective” (Lee 1992).

Benefits of this mixed method

An appropriate combination of quantitative and qualitative methods provides better understanding of research problems as opposed to using them separately (Creswell & Plano Clark 2007). Thus, it is widely supported that mixed-methods research approach provides a more comprehensive understanding of the phenomena being studied (Beck 2014; Challiol & Mignonac 2005; Collins et al. 2006; Creswell 2014; Newman et al. 2006; Scott et al. 2007; Youngs & Piggot-Irvin 2012). Specifically, according to the seminal analysis of Greene et al. (1989), the use of multiple methods that we apply in the design and implementation of research has five purposes:

1) Triangulation: the deliberate use of different methods of data collection and analysis when studying a social phenomenon, with a view to convergence and confirmation of the results obtained;

2) Complementarity: the interpretation of different aspects of social phenomena through the synthesis of the results of each method;

3) Development: the results of one method are used to help enrich and develop the other;

4) Initiation: the discovery of any contradictions and paradoxes, which induce the researcher, in the light of the data obtained from one method, to initiate a process of critical treatment and redefinition of those arising from the other;

5) Extending: expanding and deepening a research by using different methods to examine different elements or manifestations of the researched topic.

Triangulating different methodological approaches allows the tracing of different aspects of the research question (Flick 2004) and the logic behind this strategy is that the deficiencies of one method are often the forces of the other. Through their combination, researchers can make the best use of each by overcoming the shortcomings of their individual use. As objective reality cannot be fully captured and understood only through its representations, the use of multiple methods reflects an attempt to understand the phenomenon under in depth investigation (Denzin 2012). Triangulation is not as much a result-validation strategy, but more of an alternative proposal for validation, through which the breadth, depth and consistency of the methodological processes is increased (Flick 2002). Thus, qualitative data could be used in order to develop the questionnaire of the quantitative research and in this way, provide a follow up and well validated study (Cho & Park 2013). Thus, the use of mixed methods in public policy and governance issues could provide multiple benefits concerning the sphere of concepts, the sphere of concrete processes and the sphere of inferences and explanations as we can observe from the following Fig. 2, combined with their different approaches as well as reclaiming the benefits of each approach and overcoming the individual obstacles.

Fig. 2
figure 2

Quantitative and Qualitative Sphere of Concepts, Concrete Processes and Inferences and Explanations. Source: Teddie C.—Tashakkori A. (2009: 88)

A suggestive and indicative mode of the triangulation method: Using the Quantitative and Qualitative Research Mix.

Regarding the triangulation of methods belonging to different models (between-method triangulation), a combination of quantitative and qualitative methods can be used following a discipline about the research process. Specifically, a safe and usual path to the process could be made up by the following steps:

  1. 1.

    Literature review correlated with secondary quantitative research, by collecting, processing and analyzing secondary quantitative data from valid and up-to-date sources, to demonstrate the state-of-play;

  2. 2.

    Primary quantitative research using appropriately designed questionnaires.

  3. 3.

    Primary qualitative research through the conduction of semi-structured interviews and narrative interviews.

  4. 4.

    Analysis of the new primary data, comparison both with the literature, the secondary quantitative data and correlation of primary qualitative and primary quantitative data in order to extract conclusions (Fig. 3).

Fig. 3
figure 3

A suggestive and indicative mode of the triangulation method. Source: Alassafi et al. (2017)

Source: Alassafi et al. (2017)

Primary quantitative research could attempt to detect more general trends and regularities of the phenomenon under analysis which concerns one or more fields of public policy and governance, by investigating in a multitude of cases, specific parameters that could be examined in relation to each other, in order to verify or disprove specific research hypotheses based on the secondary quantitative research that is followed. Special attention should be paid to the respect of the criteria of validity, reliability, representativeness of the sample and as much objectivity as possible by researchers so that the results obtained can be generalized to the wider population. A questionnaire with closed-format questions could be used as a research data collection tool (face to face or online) in order to allow the results to be standardized in the form of measurable variables in order to identify the correlations through their statistical analysis. A pilot check of the questionnaire could be carried out prior to the main phase of the primary quantitative research to make the necessary modifications.

Primary qualitative research could also be implemented in the investigation of the cause of a social problem as well as of the impact or lack of intervention in terms of public policy and governance. In studies aimed at deepening the personal perspective of individuals, gathering details and highlighting multiple facets of the cases under investigation, qualitative research - often in combination with quantitative data - is the most appropriate and effective method. Qualitative research is considered as the most appropriate method for in-depth examination of this topic, as it aims at an immediate approach to the subjective experience of the research participants, in order to demonstrate aspects of the phenomenon under consideration that are difficult to detect and interpret (Mason 2003; Robson 2010; Tashakkori & Teddle 2003). Semi-structured and narrative interviews are mainly chosen as tools for collecting qualitative research data in such cases as they could add more depth to the analysis of a public policy and governance issue.

A semi-structured interview enables the researcher to study an issue in depth and to identify dimensions that other tools are difficult to reach. It can be used as the primary means of gathering information related to research objects, to test hypotheses or to suggest new ones, or as an interpretive tool to help identify relationships between them (Cohen & Manion 1994). The semi-structured interviews do not use a standard questionnaire, but a pre-defined flexible framework that will define (but not severely limit) the interview topics. The forms of the possible questions are the following:

  • • Open questions, which enable the respondent to develop his/her response with a great deal of freedom without any particular restrictions by the researcher,

  • • Opinion questions, designed to explore the attitudes and opinions of research participants on the issues under consideration; and.

  • • Elaboration probes, as they encourage the respondent to refer more in depth to issues that arise during the interview.

A narrative interview is a type of open, unstructured interview, in which the respondent is asked to recall personal experiences and utilize the unstructured narrative to present his/her biographical path or a specific period of his/her life related to the social-political-economical issue under investigation. In this case, respondents will be asked to relate their personal experiences in light of the institutional changes that have occurred and the wider socio-economic context. Through this tool they are given the opportunity to formulate their narrative spontaneously and freely express their comments and opinions. The questions aim at prompting the interview to begin and evolve smoothly (Mason 2003; Robson 2010; Tashakkori & Teddle 2003). Except the abovementioned tools, focus groups, panels, field observations, intervention actions etc. can also be used based on the research question and in relation with the specific field of the research but in this paper we will mainly focus on the semi-structured and narrative interviews because the primary qualitative research using these tools could be applied on research subjects who are involved in different levels and ways on the field which is under investigation.

Using triangulation and mixed methods in public policy and governance studies: divergent cases, similar strategies, different tools.

As objective reality cannot be fully captured and understood only through its representations, the use of multiple methods reflects an attempt to understand the impact or the necessity of specific public policies as well as to test the performance and the function in terms of governance. Hence, triangulation is not as much a results-validation strategy, but more of an alternative proposal for validation, through which the breadth, depth and consistency of the methodological processes is increased through (a) data triangulation, (b) investigator triangulation, and (c) methodological triangulation, in the version of triangulation of methods belonging to different paradigms. The literature supports our point of view about the use and the importance of the triangulation research method in in public policy and governance as several scholars in this field have used it successfully, of course investigating different issues. It should be noted that the field of public policy and governance is relatively vast and in order to be more specific we focus on public policies which aim at the social integration of specific social groups as well as in governance performance and function measure in local administration and in the non-governmental sector. Thus, specific cases from the available literature were chosen in order to emphasize both at the importance of triangulation and mixed methods in addressing issues of governance and public policy responses. We have categorized the cases in those concerning local-regional governance, those studying public policy necessities for social integration and those focusing on aspects of governance in non-typical organizational contexts.

Cases studying local-regional governance

Based on the above considerations, the first paradigm is derived from the research in order to analyze aspects of regional governance and sustainability in the Region of Crete, Greece (Papadakis et al. 2018). The research focuses mainly on the three dimensions of sustainability, namely the environmental, the economic and the societal, and its interconnections with regional governance. The methodology included large scale qualitative and quantitative research in the Region of Crete, Greece. Triangulation was also used through the conduction of structured quantitative questionnaires to citizens in the respective region, semi-structured interviews with institutional heads and narrative interviews with critical cases in the regional governance. The results of the different research methods were separately analyzed in order to reveal the main outcomes and finally a synthetic analysis was conducted which categorized them and showed similarities or differences. Using this methodology, the research has categorized the problems, challenges, opportunities and drawbacks in terms both of social, economic, political and environmental nature while analyzed the main policy making context and the ways that addresses the problems, evaluating though its effectiveness through citizens’ opinions. The added value of the mixed methods used was the identification of problems in regional governance that were analytically presented by the institutional heads as well as by critical cases which were interviewed. If just a quantitative questionnaire was distributed all this information, which is derived through the description of their experiences in the interviews, would not have been revealed in the fields of regional governance decision making, policy implementation, bureaucracy, priorities set process, skills and needs-in-skills as well as capabilities in problem solving. The strength of the mixed methods used was mainly the ability to identify the key problems of regional governance in the Region of Crete, Greece as perceived by citizens, local policymakers and local government officials. This feature made it possible to distinguish between the perceptions of individual research subjects, as well as the ability to identify the sources of problems by verifying or not the different approaches or identify the reasons of different perceptions on these issues. Finally, the research offers new scientific knowledge on the abovementioned issues while it comes to empirically grounded policy proposals on different areas of public policy (regional economy, social policy, environmental policy, infrastructure), which are extremely important for regional policy makers as long as they are directly derived from local citizens and institutional stakeholders.

In a similar path, Olivier (2017) uses mixed methods in order to evaluate the performance of local governance in South Africa. The study aims also to test the usefulness of mixed methods on the evaluation of institutional performance. The author uses the Burke-Litwin (1992) model of organizational performance which includes the external environment, mission and strategy, leadership and culture, as transformational factors affecting organizational performance, as well as, structure, management practices, systems, work-group climate, skills or job match, individual needs and motivation, as transactional factors affecting organizational performance. These factors were used in the quantitative and qualitative part of the research through a structured questionnaire (Organizational Performance Questionnaire) and semi-structured interviews respectively. The qualitative data was analyzed using two ways; the responses were measured in terms of response rates (Vitale, Armenakis & Field 2008) and a thematic analysis was conducted in relation to a research question, following Braun and Clarke (2013) identification. By using mixed methods Olivier (2017) has depicted the institutional performance, validated through different methodological means, and thus offered a lucrative ground for reforms towards the improvement of local governance performance in South Africa. Instead of using a single method, the mixed methodology allowed the authors to come to an holistic understanding of all aspects of local government function in South Africa, validated the questionnaire by comparing the interview data to the questionnaire data and used a validated organizational performance model in the data gathering process in order to address all elements of this organizational functioning while provide the appropriate information for the design of improvement interventions. The basic strength of the method used is the fact that on the one hand the quantitative and qualitative data have been validated with each other and on the other hand, a method has been used that leads to the understanding of local government function and the creation of empirically grounded policy proposals-interventions.

The study of Ghinoi et al. (2021) uses mixed methods in order to analyze the use of smart specialization strategy (RIS3) in Lapland region, Finland and propose alternatives for its effective implementation. The study uses triangulation of quantitative and qualitative data aiming to reduce limitations and enforce verification. Quantitative data about RIS3 from the Regional Council of Lapland and online data from regional stakeholders were used along with qualitative in-depth interviews with representative stakeholders who were active participants in the development of the smart specialization strategy. The analysis show major implications in the implementation of smart specialization strategy leading to empirically grounded policy proposals for adapting the strategy to the stakeholders’ views, necessities while improving informal coordination. The added value in comparison with a single usage of a method, is that mixed methods allowed the verification for potential source biases. An examination of RIS3 in the Regional Council of Lapland was implemented followed by interviews with representative stakeholders, active in the development of the RIS3 and online quantitative survey with regional stakeholders. Validation and verification of the research data is the basic strength of this mixed methodology.

Cases studying public policy necessities for social integration

Mixed methods have been also widely used in order to study social phenomena-problems and draw conclusions about the necessities for interventions-policy responses in terms of public policies that should foster social integration. Accordingly, the study of Kotroyannos et al. (2019) on the implications for social integration of refugees in Greece, has followed the analysis of both qualitative and quantitative data. The data was collected for two Greek regions (Lesvos and Crete). The qualitative research included semi-structured interviews with labor market stakeholders and narrative interviews with integrated immigrants while the quantitative research was conducted face to face with refugees recently arrived in Greece. Triangulation was used both on data, investigator, and methodology as well as it includes the responses of different but interconnected groups, using different investigators and different methodological tools for each group. The data was analyzed, categorized and compared. The outcomes of this research offered empirically grounded policy proposals for policy interventions towards refugees’ social integration which also will benefit the respective local communities. The added value of this method is the in-depth investigation of refugees’ narrations in order to identify the problems as well as the chances for their social integration. At the same time, semi-structured interviews were important in order to identify labor market stakeholders’ perceptions and stances towards refugees’ socio-economic integration. The quantitative research on refugees identified their human capital, which was compared with the needs of the labor market stakeholders as it was identified in the semi-structured interviews. This research methodology allows greater validation of the research outcomes and identify the differences in perceptions towards refugees which may affect their integration in the labor market. At the same time, a comparison between the refugees’ human capital and the skills needed by the labor market was made possible as well as any negative perceptions (and their provenience) towards refugees on the part of labor market stakeholders was revealed as well as its relation with refugees’ integration.

Another social vulnerability problem (young people Not in Education, Employment or Training-NEETs) and its relevant empirically grounded policy proposals, is studied by the seminal research project ‘Absents’ barometer’ which is the first nationwide (Greece) primary research on the social problem of NEETs in the European Union, using mixed methods (Kotroyannos et al. 2015; Papadakis, Kyridis, Papargyris 2015). This research included a quantitative part using a structured questionnaire to this category of young people as well as a qualitative part, using semi-structured and narrative interviews to the same people. It is based on triangulation but, contrary to the previous research case, the sample consists only the group of NEETs. The outcomes are crucial as long as they show the social vulnerability problems of this group of young people and the policy proposals offer important alternatives in addressing the problem. The research is innovative and offers to policy-makers new scientific data and empirically grounded policy alternatives that could be used by the welfare state institutions in order to increase the possibilities for social integration of these young people. As in the previous cases, validation and verification of the outcomes is the main strength of this methodology along with the focus on respondents’ narrations which reveal life-course details, which are difficult to be depicted on the quantitative outcomes.

Cases studying governance in non-typical organizational contexts

Governance patterns and issues are also crucial in the non-typical contexts, such as Non-Governmental Organizations (NGOs) and community cooperatives. The way they are governed and formulate their policies within the greater concept they function is also crucial as long as the third sector (non-governmental) is gaining an increasing part of the social-public intervention during the recent decade and due to the retrenchment of the typical social policies offered by the welfare state institutions (Wollman 2018).

Therefore, specific cases were chosen in order to emphasize both at the importance of triangulation and mixed methods in order to develop capacity building for people involved in an organization of the third sector, as a means for functional effectiveness and good governance. It should be pointed out that triangulation and mixed methods have generally been used in order to develop capacity building in NGOs and are considered as crucial strategies in order to provide better services. Several organizations and scholars indicate that the mixture of qualitative and quantitative methods and triangulation offer the depth that is necessary in order to assess and further develop capacity building in NGO members. The narration that qualitative research includes, in combination with the quantitative data, is necessary in order to facilitate organizational learning and governance. According to CDRA (2001) and Taylor (2003), it assists staff as well as volunteers with the engagement of new ideas as well as new and innovative practices. Accordingly, Fowler (1997), Roche (1999) and Taylor (2003) indicate that mixed methods using triangulation could better evaluate capacity building in NGOs and assess impact. A distinctive example of using triangulation in practice from an NGO is ActionAid Uganda (Wallace & Kaplan 2003), which included narrative interviews with its officials, along with the quantitative questionnaires, in order to explore their feelings about the change they have been part of (Hailey & James 2003). This method allowed the verification between the qualitative and quantitative data. At the same time, a strength of using narrations along with quantitative questionnaires, created the opportunity to better describe the feelings towards the change they have been part of. This is extremely important as long as the quantitative questionnaires are not able to “catch” all the possible feelings that an individual has while narrations gave the opportunity for detailed explanation, description and justification from the part of individuals.

In a similar context, Lang and Roessl (2011) in their study on the conceptualization of governance in Community Co-operatives in Austria and Germany, used mixed methods and triangulation in order to acquire an in-depth understanding of the intrinsic characteristic of governance mechanisms in such organizations of the third sector. Their tools are different than that of the previous paradigm in order to better adapt to their research question. They have chosen two cases of neighborhood organizations (co-operatives) from Austria and Germany and they applied different qualitative tools as long as they offer a better understanding on the social process in the context of different perspectives and specific time (Yin 2009; Sayer 1984). For this purpose they used semi-structured single and group interviews, field observations, and archival data, in order to perform triangulation and achieve the better validity and reliability of the outcomes. Instead of conducting a research with a single tool, the authors have chosen to use archival data, field observations and interviews as means of validation, which is actually the strength of the used methodology.

The third characteristic research case that uses mixed methods and triangulation is a study about social enterprises in Austria (Lehner 2011) with social entrepreneurs. This research uses the theoretical framework of social enterprises in Austria in order to theoretically justify the concept of the study. The research approach uses triangulation as well as mixed methods as its basic strategy. The research tools include an online-based survey, semi-structured interviews and two panel discussions. The online questionnaires included both qualitative and quantitative questions and the author conducted semi-structured interviews with relative practitioners and experts. The third tool that was used included two moderated panel discussions about social entrepreneurship in Austria. It should be pointed out that literature review, which was carried out at the first steps of the study, led to the determination of the framework for the combined results. This methodological approach led to the conduction of a holistic analysis-view of the conceptual underpinnings about social enterprises in Austria. Validation of the outcomes is the main strength of the followed methodology. The synthesis of qualitative and quantitative data covered any data gaps and aspects about their experience in social entrepreneurship governance and functional characteristics.

Conclusions

It has been well shown by the analysis of the above research cases that mixed methods can provide useful tools about the study of social problems which need specific attention by policy makers in terms of public policy planning and implementation as well as of local-regional governance issues in terms of effectiveness and performance increase. Similarly, mixed methods may be well used on measuring governance effectiveness in non-governmental contexts. Triangulation is often used but not with a linear approach in order to identify the intrinsic characteristics of governance and public policy patterns. It turns out that different tools may be used which are in each occasion considered as best suited in order to address the research question. The combination of different tools under the methodological strategy of mixed methods and triangulation, is definitely considered crucial in order to unveil the underlying characteristics that exist in the respective institutions and socio-economic contexts.

The specific examples analyzed above, highlight the key elements needed to answer the research questions by focusing on speech, style and points of interest (Mason 2003; Robson 2010). This method is used in these cases, where there was insufficient theory or data on the subject under consideration. In such cases, “the researcher approaches the subject with an open mind, aiming to start formulating a theory” (Punch 1998: 168) and “attempting to produce knowledge on how people interpret reality” (Suddaby 2006: 634). In the specific examples, the multidimensional character of the governance in local-regional level, public policy towards social integration and governance of third sector organizations or community cooperatives, triangulation and mixed methods strategy provide new knowledge through multiple research tool combination. In this way, the research classify the problems, needs and existing conditions, create sub-categorizations as well as may offer the necessary basis for the implementation of comprehensive intervention plans-reforms, changes and policy proposals that would be useful for increasing local-regional and non-governmental organizations governance effectiveness as well as public policy effectiveness towards social integration, while develop interactions, interventions, practices, impact and incentives based on empirical justification. The benefits of the researcher when using mixed methods are clear; they enhance the ability to check the reliability of the data as well as to cover possible gaps that one method alone is not able to fill. For instance, issues related to emotions or experiences cannot be fully addressed through the use of a research method, especially if it is only quantitative. Therefore, the combination of qualitative and quantitative tools offers the chance to fill any data gaps, compared to using a single research method.

We should also mention that using mixed methods is not always a totally perfect methodological strategy as long as this is not possible in any methodology especially in social sciences. In order to reduce the limitations there should be given specific focus on case selection of the qualitative research, which is related to the aimed conclusions but specific explanation-justification is necessary to be given. The above cases tried to integrate quantitative and qualitative methods in the research design from the beginning in order to meet researchers’ needs (Creswell & Plano Clark, 2011). What is necessary and it is not discussed thoroughly in the above research cases, is that there is a lack of discussion on the multidimensional limitations (whether methodological, philosophical or other) in order to enforce the debate on their use and lead to improved implementation. While these cases have offered crucial policy proposals in these three directions (local-regional governance, public policy towards social integration and non-governmental organizations governance), deeper methodological discussions on the limitations or better application of mixed methods are deemed crucial and will definitely lead to better research outcomes. The cases in focus also show that the use of mixed methods in different fields of political science has been increased and has offered empirically based policy proposals which could lead to solutions in social problems, local-regional administration effectiveness and non-governmental sector effectiveness, thus declaring that their use could be further expanded and improved.

The findings of our analysis reveal that mixed methods could be very useful when analyzing phenomena in political science and governance. In all the examples analyzed, the main advantage of mixed methods is the increase of the reliability of the outcomes. Using different methods, even in different populations, it is possible to control and identify points of difference and agreement, which is not possible through the usage of a single method. At the same time, the enrichment of quantitative tools with qualitative offers the opportunity to emerge details about subjects’ experiences, a fact that is not possible to be revealed only through quantitative research tools. These are particularly important in research related to social problems and governance issues, both at the local government and at the non-governmental organizations. These areas are not unrelated but contribute significantly to the contemporary mix of state services and civil society, and the deepening of the individual characteristics that distinguish social problems and governance contributes to the formulation of targeted and empirically grounded policy proposals in order to improve the level of governance and functioning (of local government and non-governmental organizations) and to the optimal treatment of modern social problems by the local and the central state.

Notes

  1. For the analysis of these types see Fig. 1.

References

  • Alassafi, M.O., Alharthi, A., Walters, R.J., Wills, G.B.: A framework for critical security factors that influence the decision of cloud adoption by Saudi government agencies. Telematics and Informatics. 34(7), 996–1010 (2017). https://doi.org/10.1016/j.tele.2017.04.010

    Article  Google Scholar 

  • Beck, C.D.: Antecedents of servant leadership: A mixed methods study. Leadersh. Organizational Stud. 21(3), 299–314 (2014). https://doi.org/10.1177/1548051814529993

    Article  Google Scholar 

  • Braun, V., Clarke, V.: Successful qualitative research: A practical guide for beginners. Sage, Thousand Oaks (2013)

    Google Scholar 

  • Burke, W.W., Litwin, G.H.: A causal model of organisational performance and change. J. Manag. 8(3), 523–546 (1992). https://doi.org/10.1177/014920639201800306

    Article  Google Scholar 

  • Carter, N., Bryant-Lukosius, D., DiCenso, A., Blythe, J., Neville, A.: The Use of Triangulation in Qualitative Research. ONF. 41(5), 545–547 (2014)

    Article  Google Scholar 

  • Challiol, H., Mignonac, K.: Relocation decision-making and couple relationships: A quantitative and qualitative study of dual-earner couples. J. Organizational Behav. 26(3), 247–274 (2005). https://doi.org/10.1002/job.311

    Article  Google Scholar 

  • Cho, S.E., Park, H.W.: A qualitative analysis of cross-cultural new media research: SNS use in Asia and the West. Qual. Quant. 47, 2319–2330 (2013)

    Article  Google Scholar 

  • Cohen, L., Manion, L.: Research Methods in Education. Routledge, London (1994)

    Google Scholar 

  • Collins, K.M.T., Onwuegbuzie, A.J., Sutton, I.L.: A model incorporating the rationale and purpose for conducting mixed methods research in special education and beyond. Learn. Disabilities: Contemp. J. 4, 67–100 (2006)

    Google Scholar 

  • Community Development Resource Association: Measuring Development – Holding Infinity, Annual Report, CDRA, Cape Town: (2001)

  • Creswell, J.W., Plano Clark, V.L.: Designing and conducting mixed method research. Sage, Thousand Oaks (2007)

    Google Scholar 

  • Creswell, J.W.: Research design: Qualitative, quantitative and mixed methods approaches, 4th edn. Sage, Thousand Oaks (2014)

    Google Scholar 

  • Denzin, N.K.: The research act: A theoretical introduction to sociological methods. McGraw-Hill, New York (1978)

    Google Scholar 

  • Denzin, N.K.: Sociological Methods: A Sourcebook. Aldine Transaction, Piscataway (2006)

    Google Scholar 

  • Denzin, N.K.: ‘Triangulation 2.0’. J. Mixed Methods Res. 6(2), 80–88 (2012)

    Article  Google Scholar 

  • Flick, U.: An introduction to qualitative research. Sage, London (2002)

    Google Scholar 

  • Flick, U.: Design and process in qualitative research. In: Flick, U., Kardoff, E.v., Steinke, I. (eds.) A companion to qualitative research, pp. 146–152. Sage Publications, London (2004)

    Google Scholar 

  • Fowler, A.: Striking a Balance: A Guide to Enhancing the Effectiveness of NGOs in International Development. Earthscan, London (1997)

    Google Scholar 

  • Ghinoi, S., Steiner, B., Makkonen, T., Hassink, R.: Smart Specialisation strategies on the periphery: a data-triangulation approach to governance issues and practices. Reg. Stud. 55(3), 402–413 (2021). https://doi.org/10.1080/00343404.2020.1791321

    Article  Google Scholar 

  • Greene, J.C., Caracelli, V.J., Graham, W.F.: Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis. 11, 255–274 (1989). https://doi.org/10.3102/01623737011003255

    Article  Google Scholar 

  • Hailey, J., James, R.: NGO Capacity Building: The Challenge of Impact Assessment. Paper presented to the New Directions in Impact Assessment for Development Methods & Practice Conference. November 2003, IDPM University of Manchester: (2003)

  • Hendren, K., Luo, Q.E., Pandey, S.K.: The state of mixed methods research in public administration and public policy. Public Adm. Rev. 78(6), 904–916 (2018). https://doi.org/10.1111/puar.12981

    Article  Google Scholar 

  • Lee, J.: S. K.: Quantitative versus qualitative research methods—two approaches to organisation studies. Asia Pac. J. Manage. 9(1), 87–94 (1992). https://doi.org/10.1007/BF01732039

    Article  Google Scholar 

  • Johnson, R.B., Onwuegbuzie, A.J.: Mixed methods research: A research paradigm whose time has come. Educational Researcher. 33, 14–26 (2004). https://doi.org/10.3102/0013189X033007014

    Article  Google Scholar 

  • Kapiszewski, D., Maclean, M.L., Read, B.L.: Field Research in Political Science: Practices and Principles. Cambridge University Press, Cambridge (2015)

    Book  Google Scholar 

  • Kontogiannatou, G.: Mixed Methods Researches: The logic of their development and the prerequisites of their usage. Academia. 12, 1–26 (2018) (in Greek)

    Google Scholar 

  • Kotroyannos, D., Lavdas, K.A., Papadakis, N., Kyridis, A., Theodirikakos, P., Tzagkarakis, S.I., Drakaki, M.: An Individuality in Parenthesis? Social Vulnerability, Youth and the Welfare State in Crisis: On the Case of Neets, In Greece, Within the European Context. Studies in Social Sciences and Humanities. 3(5), 268–279 (2015)

  • Kotroyannos, D., Tzagkarakis, S.I., Kamekis, A., Dimari, G., Mavrozacharakis, E.: Identification and categorization of Refugees’ Integration Prospects in the Greek Socio-Economic System: Case Study in Mytilene and Crete Islands. Eur. Q. Political Attitudes Mentalities 8(3), 1–14 (2019)

    Google Scholar 

  • Lang, R., Roessl, D.: Contextualizing the Governance of Community Co-operatives: Evidence from Austria and Germany. Voluntas. 22, 706–730 (2011). https://doi.org/10.1007/s11266-011-9210-8

    Article  Google Scholar 

  • Lehner, O.M.: The Phenomenon of Social Enterprise in Austria: A Triangulated Descriptive Study. J. Social Entrepreneurship. 2(1), 53–78 (2011). https://doi.org/10.1080/19420676.2011.555775

    Article  Google Scholar 

  • Macmillan, R.: Somewhere over the rainbow-third sector research in and beyond coronavirus. Voluntary Sect. Rev. 11(2), 129–136 (2020). https://doi.org/10.1332/204080520X15898833964384

    Article  Google Scholar 

  • Mason, J.: The conduction of qualitative research. Ellinika Grammata, Athens (2003) (in Greek)

    Google Scholar 

  • Newman, I., Shell, D.F., Ming, Q., Jianping, X., Maas, M.R.: Adolescent alcohol use: Mixed methods research approach. Educational Psychology Papers and Publications. Paper 92 (2006)

  • Olivier, B.H.: The use of mixed-methods research to diagnose the organisational performance of a local government. SA J. Industrial Psychol. 43(1), 1–14 (2017). https://doi.org/10.4102/sajip.v43i0.1453

    Article  Google Scholar 

  • Papadakis, N., Drakaki, M., Tzagkarakis, S.I., Kamekis, A., Kotroyannos, D., Calogiannakis, P., Lavdas, K.: Governance, Sustainability and HRD at the Regional Level: The Case of the University Training Programme for Local Government Executives in the Region of Crete. Academia. 18, 167–198 (2020)

    Google Scholar 

  • Papadakis, N., Kyridis, A., Papargyris, A.: Searching for absents: The State of things for the Neets (young people Not in Education, Employment or Training) in Greece. An overview. J. Sociol. Res. 6(1), 44–75 (2015)

    Google Scholar 

  • Papadakis, N., Lavdas, K.A., Kotroyannos, D., Tzagkarakis, S.I., Kamekis, A., Drakaki, M.: Regional Governance and Sustainability: Research towards evidence - based policy making, at the Region of Crete. Adv. Social Sci. Res. J. 5(8), 280–293 (2018)

    Google Scholar 

  • Paull, M., Girardi, A.: Mixed methods research in investigations of volunteering. Third Sect. Rev. 23(1), 183–207 (2017)

    Google Scholar 

  • Punch, K.: Introduction to Social Research: Quantitative and Qualitative Approaches. Sage, London (1998)

    Google Scholar 

  • Robson, C.: The real world research. Gutenberg, Athens (2010) (in Greek)

    Google Scholar 

  • Roche, C.: Impact Assessment for Development Agencies: Learning to Value Change. Oxfam, Oxford (1999)

    Book  Google Scholar 

  • Sayer, A.: Method in social science: A realist approach. Hutchinson, London (1984)

    Book  Google Scholar 

  • Scott, S.B., Bergeman, C.S., Verney, A., Longenbaker, S., Markey, M.A., Bisconti, T.L.: Social support in widowhood: A mixed methods study. J. Mixed Methods Res. 1(3), 242–266 (2007). https://doi.org/10.1177/1558689807302453

    Article  Google Scholar 

  • Suddaby, R.: From the Editors: What Grounded Theory is Not. Acad. Manage. J. 49(4), 633–642 (2006)

    Article  Google Scholar 

  • Tashakkori, A., Teddle, C.: Mixed Methods in Social & Behavioral Research. Sage, London (2003)

    Google Scholar 

  • Taylor, J.: Using Measurement Developmentally. CDRA, Cape Town (2003)

    Google Scholar 

  • Teddie, C., Tashakkori, A.: Foundations of Mixed Methods Research. Integrating Quatitative and Qualitative Approaches in the Social and Behavioral Sciences. Sage, California – London – New Delhi – Singapore (2009)

  • Vitale, D.C., Armenakis, A.A., Field, H.S.: Integrating qualitative and quantitative methods for organizational diagnosis: Possible priming effects? J. Mixed Methods Res. 2(1), 87–105 (2008). https://doi.org/10.1177/1558689807309968

    Article  Google Scholar 

  • Wallace, T., Kaplan, A.: The Taking of the Horizon: Lessons from ActionAid Uganda’s Experience of Change in Development Practice, ActionAid Working Paper 4, August: 2003

  • Wolf, F.: Enlightened Eclecticism or Hazardous Hotchpotch? Mixed Methods and Triangulation Strategies in Comparative Public Policy Research. J. Mixed Methods Res. 4(2), 144–167 (2010). https://doi.org/10.1177/1558689810364987

    Article  Google Scholar 

  • Yin, R.K.: Case study research: Design and methods, 4th edn. Sage, Thousand Oaks (2009)

    Google Scholar 

  • Youngs, H., Piggot-Irvine, E.: The application of a multiphase triangulation approach to mixed methods: The research of an aspiring school principal development program. J. Mixed Methods Res. 6(3), 184–198 (2012). https://doi.org/10.1177/1558689811420696

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Stylianos Ioannis Tzagkarakis.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Tzagkarakis, S.I., Kritas, D. Mixed research methods in political science and governance: approaches and applications. Qual Quant (2022). https://doi.org/10.1007/s11135-022-01384-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11135-022-01384-y

Keywords

  • Quantitative research
  • Qualitative research
  • Triangulation
  • Public policy
  • Governance
  • Mixed methods