Abstract
Participatory research can improve the efficiency, effectiveness, and scope of research processes, and foster social inclusion, empowerment, and sustainability. Yet despite four decades of agricultural research institutions exploring and developing methods for participatory research, it has never become mainstream in the agricultural technology development cycle. Citizen science promises an innovative approach to participation in research, using the unique facilities of new digital technologies, but its potential in agricultural research participation has not been systematically probed. To this end, we conducted a critical literature review. We found that citizen science opens up four opportunities for creatively reshaping research: (i) new possibilities for interdisciplinary collaboration, (ii) rethinking configurations of socio-computational systems, (iii) research on democratization of science more broadly, and (iv) new accountabilities. Citizen science also brings a fresh perspective on the barriers to institutionalizing participation in the agricultural sciences. Specifically, we show how citizen science can reconfigure cost-motivation-accountability combinations using digital tools, open up a larger conceptual space of experimentation, and stimulate new collaborations. With appropriate and persistent institutional support and investment, citizen science can therefore have a lasting impact on how agricultural science engages with farming communities and wider society, and more fully realize the promises of participation.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Avoid common mistakes on your manuscript.
Contents
2.2 Empowerment
2.3 Sustainability
5. Conclusions
1 Introduction
Participatory research describes research that is done not only for or on but also with people. What sets it apart from conventional research is a deliberate, focused interaction between researchers and participants leading to changes in research design, technology development, and/or research evaluation (Ashby 1996; Lilja and Bellon 2008). While farmers have historically participated in all manner of agricultural research, farmer-participatory research became a specific focus in the agricultural sciences in the early 1980s. This stemmed from the recognition that farmers in marginal areas generally did not benefit from technological advances and thus that more effort should be invested into more inclusive approaches (Chambers 1994; Sumberg and Okali 1997; Johnson et al. 2003; Biggs 2008; Scoones et al. 2008). In farmer-participatory research, farmers would be involved directly in setting research goals, selecting seeds, observing pests and crop diseases, or evaluating research products. The expectation was that such participation would help to tailor research to the needs and criteria of participants, which would lead to new insights, products, and services that were more useful for their prospective target audience and would empower participants in the process (see Section 2 below).
Farmer participation offers legitimacy to agricultural research and has shifted its paradigm from a linear transfer of technology approach toward more people-centered approaches revolving around innovation and learning. However, in reality, participatory research in agriculture did not live up to its promise, due to institutional and epistemic difficulties in its implementation. For example, in plant breeding, participatory styles of research are still evolving but have never become mainstream (Ceccarelli 2015). Even in institutional contexts in which participatory exercises have gained legitimacy, their findings are not fully used (Sumberg et al. 2013). While participatory research attracts attention, it is not fully integrated into biophysical or experimental agricultural research focused on technology development (Figure 1).
Despite this general disappointment with participatory research, it is currently receiving renewed interest with approaches that make more intensive use of new digital technologies, generally denominated as “citizen science.” Citizen science has in common with “traditional” participatory research that it aims to produce new scientific knowledge while increasing public understanding of science and democratizing the scientific process (Cooper et al. 2015). Several initiatives have engaged in “crowdsourced” citizen science, engaging farmers and other actors involved with food systems in scientific experimentation and observation at scale, making use of digital media (for an overview of citizen science initiatives in agriculture; see Minet et al. 2017 and Ryan et al. 2018). In the context of citizen science in agriculture, the term “citizen” refers to farmers and members of the general public involved with agriculture “who actively contribute to science with their intellectual effort or surrounding knowledge or with their tools and resources. Participants provide experimental data and facilities for researchers, raise new questions and co-create a new scientific culture” (Green paper on Citizen Science 2013).
An obvious question is if citizen science can address the challenges that prevented participatory research in agriculture from becoming mainstream. Current enthusiasm over new digital technologies and research formats can easily overshadow concerns well-founded in decades of trial-and-error experience. In the worst case, ignoring the past can lead us to repeat its mistakes and failures. Only if citizen science can overcome existing barriers of participatory research will it meaningfully contribute to agricultural sustainability. Figure 1
To address the question if citizen science can realize the promises of participatory research in agriculture, we take a step-by-step approach. First, we review the relevant research literature to chart the promises of participatory research, and the different expectations on what participation in research should contribute (Section 2). The possible contribution of citizen science needs to be measured against these expectations (or these expectations need to be adjusted). Then, we explore the question why participatory styles of research have not become mainstream in agriculture (Section 3). Citizen science will eventually have to face the same barriers as other participatory research, especially when the initial enthusiasm will have waned off and long-term sustainability becomes a main concern. Finally, we assess recent research that explores the fresh perspectives that citizen science brings to participatory research (Section 4). We conclude by discussing whether and how citizen science can fulfill the promises of participatory research and address the extant barriers that have prevented participatory research from becoming mainstream (Section 5).
2 The promises of participatory research in agriculture
The existing discourse on participatory research in agriculture highlights three major potential positive impacts: increased effectiveness and efficiency of the research process, empowering marginalized social groups, and improved environmental sustainability of developed solutions.
2.1 Increased effectiveness and efficiency
According to Johnson et al. (2004), participatory research can strengthen feedback links between researchers and participants, which lead to a better understanding of the problems, more appropriate solutions, and faster adoption. It takes into account farmers’ constraints and contextual factors from the outset, rather than designing optimal technologies on research stations and then undertaking a process of adaptive research (Collinson 2000). More generally, combining formal research and informal farmer knowledge practices can increase effectiveness by offering more appropriate solutions at local level (Sumberg et al. 2003; Hoffmann et al. 2007). More efficiency can be achieved by outsourcing certain tasks to participants, and by avoiding separate research and adaptation phases.
A concrete example is the plant breeding work of Ceccarelli (2015) and others, who pioneered participatory approaches in the early 1990s by bringing formal breeding techniques to local communities. Conventional plant breeding tended to favor resourceful farmers who are able to modify their environments to accommodate the requirements of new crop varieties. Poor farmers operating in marginal areas often do not have the resources to apply fertilizers and other inputs and are risk-averse when it comes to testing out new and unknown varieties (Ceccarelli and Grando 2007). By decentralizing plant breeding to on-farm selection, farmers can select and help to breed varieties that suit their specific environmental and social conditions. Experience has proved that involving farmers at the design stage leads to a faster and less expensive breeding process and higher adoption of new varieties (Ceccarelli 2015). Conventional breeding processes involve several years of breeding varieties, followed by on-farm testing of these varieties. Participatory plant breeding moves selection to farms in earlier stages of the process, significantly reducing its duration (Johnson et al. 2004; Ceccarelli 2015).
Johnson et al. (2003) state that the initial costs for participatory research might be higher as they require to establish links with local communities and community meetings, but these additional costs are not significant. Thus, Neef (2008) looked at the costs of adding participatory approaches to conventional research processes, and found that the costs for hiring local staff and compensating farmers’ time and travel costs made up only a fraction of the total. Additionally, the costs for compensating farmers can be offset by a decrease in costs for research when certain tasks are taken up by farmers. Working in remote locations increases logistics, mobilization, and communication costs (Chambers and Jiggins 1987; Bentley 1994). But scaling conventional research to multi-location trials and research efforts would incur similar increases without the benefits of participatory approaches (Morris and Bellon 2004).
More farmer participation moves costs from researchers to involved farmers, requiring farmers’ time, intellectual capacity, and sometimes also inputs such as land, labor, or assets (Morris and Bellon 2004). Some participatory approaches require considerable amounts of time away from the farm, for example, participatory rural appraisal exercises where entire villages are required to participate in meetings over multiple days (Hoffmann et al. 2007) or participatory plant breeding processes that require farmers’ commitment at peak harvest times and usually cover multiple seasons (Collinson 2000). However, there are only few studies offering cost analyses from the farmer side. Farmers often calculate their opportunity costs to determine what they could earn if they used their time doing something else or continued participation at busy times in the farming cycle. Hence, their participation in participatory research can be read as an indicator that to them, participatory research is an effective and efficient use of their time.
One more general problem with cost-benefit analyses is that the gains of research are measured through a narrow focus on outputs, for example, the number of varieties released (Spielman and Kennedy 2016). Impacts like increased farm income, technology adoption, or improved livelihoods are less often measured in cost-effectiveness studies. As Lilja and Bellon (2008) point out, the benefits of participatory research for farmers extend to even more distal, indirect forms, for example, increased knowledge, changes in agricultural practices, or obtaining enhanced skills, as well as facilitating mutual learning between researchers, farmers, and other actors. These benefits are not easy to measure using standard impact assessments, and their value is often not considered. Emerging approaches attempt to document this wider range of benefits, using a mix of different methods, including participatory ones (Faure et al. 2020).
2.2 Empowerment
A main motivation to engage participants in agricultural research is empowerment (Sumberg et al. 2003). Some authors state that participatory research can enable marginalized groups in society to make their own decisions by equipping them with basic research skills or by giving them a voice in decision-making processes (Bunch 1982; Chambers 1994; Cornwall and Jewkes 1995). Several authors frame empowerment in terms of redressing some existing inequality, be it between different social groups, between researcher and farmer, or between different groups among farmer participants. For Bunch (1982), any intervention needs to consider the different socio-political rights of different groups within society; otherwise, interventions might reinforce existing inequalities and increase the power of the elite. For Chambers (1994), empowerment requires a change of role for the researchers to equip farmers with the tools to do their own appraisals and needs assessments. He states that researchers should develop methods that allow farmers to participate in a non-extractive way. Another theme that is often mentioned is cognitive justice. Cornwall and Jewkes (1995) state that “ultimately, participatory research is about respecting and understanding the people with and for whom researchers work. It is about developing a realization that local people are knowledgeable and that they, together with researchers, can work towards analyses and solutions” (p. 1674). While participation can empower farmers and other participants, it can empower researchers as well. Farmers’ voluntary participation and their sense of ownership in research processes can be a form of legitimization for research and its institutions (Ashby 1996; Lilja and Bellon 2008; Johnson et al. 2004).
Empowerment depends on the ability of participatory activities to be inclusive in terms of recruitment and creating space for people to express themselves. Inclusion spanned across socioeconomic status, location, gender, cultural norms, or poverty (Johnson et al. 2003; Cornwall 2008; Waddington et al. 2014). Participation of women in agricultural research tends to be lower than that of men (Cornwall 2008; Pope 2013). This can be related to male-dominated mixed meetings in which women’s voices remain limited (Joseph and Andrew 2008), explicit targeting of organized or literate farmers (Phillips et al. 2014), or cultural sensitivity, for instance targeting married women only (Najjar et al. 2013). Larger-scale or more innovative farmers are more likely to enter participatory research due to selection criteria of extension agents or farmers’ self-selection (Anderson and Feder 2004), as well as confidence levels from previous experience in participatory research (Johnson et al. 2003). The design of the intervention or the composition of the research team can influence social inclusion through the quality of communication or social distance between researchers and farmers (Sumberg et al. 2013, p. 253; Trimble et al. 2014) or the timing and duration of activities, which can disproportionately affect participants who are time-poor (Hoffmann et al. 2007; Chambers 1994). Exclusion effects may be partially overcome by carefully deciding selection criteria and recruitment strategies beforehand (Friis-Hansen 2008). Also, carefully selecting formats of participation can activate mechanisms of social inclusion. Deliberate participation (“talking”) through group discussions, for example, can exclude marginal voices due to leadership effects, while performative participation (“doing”) can generate alternative spaces for expression (Richards 2007). Even though participation in agricultural research does not automatically empower farmers, there is broad agreement that appropriate participation is necessary if agricultural research is to contribute to empowerment.
2.3 Sustainability
Ashby (1996) suggests that even though participation may make technology development more efficient, a more important positive impact is improving the environmental sustainability of developed innovations. To avoid further environmental degradation, researchers should always consider the long-term effects of the technologies they develop on future generations (Collinson 2000). Researchers and farmers operate in different realities; hence, adoption of technologies without adaptive research and/or stakeholder participation can lead to unsustainable solutions (van de Fliert and Braun 2002). Furthermore, participation can help to create a sense of ownership over the technologies or the research process, which means that people will be more inclined to look after them if it serves their interests (Hickey and Mohan 2004). Involving participants in research also increases sustainability because it avoids creating dependencies on outsiders to keep offering benefits (White 1996; Cornwall 2008).
New approaches have attempted to further decentralize innovation processes and decrease the dependency on a few central actors and create broader involvement of a range of stakeholders, including public and private organizations (Klerkx et al. 2012). Farmer-led research supported by civil society organizations attempts to make research unambiguously oriented to farmers’ needs (Waters-Bayer et al. 2015). Innovation platforms have attempted to embed participatory research in broader processes of innovation to move away from technology-focused approaches to more system-focused approaches. Innovation platforms bring together individuals and public and private sector organizations and institutions for priority setting, networking, learning, negotiating, and experimenting, with the aim of building up long-term engagement between stakeholders to achieve more development impact (Schut et al. 2016). Even though these approaches have broadened the range of stakeholders beyond farmers, farmer-participatory approaches are seen as a crucial ingredient to support the sustainability of the change these approaches are expected to bring.
3 Why has participatory research not become mainstream?
Participatory research has successfully created “farmer-centric” approaches to developing agricultural technology, for example, through the development of farmer innovation networks (Waters-Bayer et al. 2007; Abrol and Gupta 2014), market-led development, participatory approaches to learning and impact assessment (Douthwaite and Hoffecker 2017; Heinemann et al. 2017), and farmer-to-farmer innovations (Van Mele 2006; Kiptot and Franzel 2014; Chowdhury et al. 2015). These approaches have responded to the changing role of farmer organizations (Hellin et al. 2009; Ton et al. 2014) and the development of more demand-driven extension services (Aker 2010; Humphries et al. 2015) and are embedded in more integrated approach toward agricultural research through multi-stakeholder innovation platforms (Schut et al. 2016; Douthwaite et al. 2017; Pigford et al. 2018). At the same time, co-design of farming system approaches has emerged (Meynard et al. 2012; Berthet et al. 2018) and participatory modeling and simulation approaches have made innovative contributions (Naivinit et al. 2010). In spite of this proliferation of approaches, we observe that they remain still unconnected to much biophysical research in agriculture in national and international research organizations.
This lack of mainstreaming needs to be explained. Two major issues emerge from the literature: the institutional and epistemic workings of agricultural research, and a lack of research and innovation around participation itself.
3.1 Entrenched scientific institutions and incentives
One well-evidenced barrier to mainstreaming participatory research has been the institutional workings of science itself. Waters-Bayer et al. (2015) describe how a lack of effective institutional learning and knowledge management processes keep formal research institutions, in particular the CGIAR, from learning from end users (see also Kristjanson and Harvey 2014). For international rice research, Sumberg et al. (2013) found that some participatory research formats, such as participatory variety selection, had found legitimacy but that there were no clear, established ways for their findings to inform research decision-making. Similarly, Becker (2000) describes a perpetuation of standard epistemological practice at strategy level where research priority setting tends to follow a natural sciences approach, “with a few ingredients of social sciences” (p. 5). The short-term nature of most participatory projects, the low number of scientists and managers that have experience in participatory research, a reward system which favors data production over impact, and the lack of exchange and learning opportunities on the topic of participatory research are further institutional barriers affecting international agricultural research centers and the national agricultural research systems in developing countries. The scientific value of participatory research is sometimes questioned because of its perceived lack of precision, control, replicability, and generalizability (van de Fliert and Braun 2002). Standard methods of collecting feedback, such as surveys, technology evaluation, and field visits, are insufficient to generate useful user feedback, and experiences, opinions, and knowledge from extension officers and farmers are rarely documented or used to validate results, underestimating their value. Further, it often takes more time to set up participatory forms of research and get participants involved, and therefore results also take longer.
These institutional and epistemological barriers are in turn perpetuated by several other systemic issues of agricultural research. First, competition between institutions and individuals for funding and academic merit prevents sharing data and learning experiences and generates a culture of knowledge hoarding (Hoffmann et al. 2007; Schot and Geels 2008; Abah et al. 2011; Pope 2013; Waters-Bayer et al. 2015). Second, high staff turnover inhibits the uptake and transfer of “new” participatory approaches (Johnson et al. 2003). Third, research incentives are not connected to accountability toward end users (Schut et al. 2016). Fourth, staff performance management lacks appropriate mechanisms to incentivize scientific workers to deliver end-user impact (Anderson and Feder 2004). Thus, as research systems move to higher accountability and client orientation, participatory research may become stronger (cf. Sumberg et al. 2013).
3.2 Lacking research and innovation around participation itself
A second barrier to mainstreaming is lacking reflexive research around participation itself. In areas of agricultural research in which participatory methods were first applied, one finds a limited and relatively static repertoire of participatory methods in use (Sumberg et al. 2013). This extends to the way participation itself is conceptualized. Many authors stay close to Arnstein’s (1969) “Ladder of Citizen Participation” (Biggs 1989; Pretty 1995; Lilja and Ashby 1999). Arnstein classified citizen participation according to the degree of power of citizens in decision-making processes, from nonparticipation through tokenism to true citizen participation. Biggs (1989) similarly describes four modes of participation in agricultural research as contractual (farmers are hired to participate in experiments or provide land), consultative (farmers’ opinions are sought to plan interventions), collaborative (researchers and farmers work together in researcher-designed projects), and collegiate (researchers and farmers work together as a team to strengthen the informal research system). Lilja and Ashby (1999) later added a fifth mode of farmer experimentation: farmers experiment independently without interference or instruction of researchers. In these categorizations, variation in participation is generally plotted along a single axis of relative power or influence of researchers versus farmers. Arnstein’s Ladder and derived categorizations imply a normative stance—more and more “genuine” participation is always better (Neef and Neubert 2011). It is telling that few have tried to develop more sophisticated perspectives on farmer participation or engage more directly in designing new participatory methods (Neef and Neubert 2011). The noncanonical status of participation and its highly normative conceptualizations seem to have led agricultural researchers to take participatory formats “as a given,” focusing on their legitimation and adoption, rather than their selective and dynamic adaptation to different contexts.
This contrasts with digital technology design, which will be discussed in relation to citizen science below. In this field, researchers critically examine participation and deliberately and playfully explore and evaluate new methods for participation. McCarthy and Wright (2017) point out that Arnstein’s Ladder is of limited value in participatory design contexts (in which participatory technology development in agriculture can be included), as it originated in public participation in a type of policy decision-making where relatively well-defined questions need to be answered. In design processes, in contrast, participation can and should take place in multi-dimensional, dynamically changing constellations of agency, control, self-determination and power, addressing, and often reframing ill-defined, significant problems. This has led them and many others to explore alternative formats for configuring participation suited to the particular needs and contexts of different projects.
In some areas of agricultural research, innovative experiments with alternative forms of participation have taken place, especially around farming systems’ research and design. Interactive models of leadership sharing between farmer researchers and scientists have become more common (Drinkwater et al. 2016). Participatory modeling techniques have been developed to include different types of knowledge and values into decision-making processes (Berthet et al. 2016). These methods involve different forms of participation, such as the co-design of simulations using role play and gamified formats to explore possible scenarios in agriculture and natural resource management (Barreteau et al. 2003; Martin et al. 2011). These new approaches have also led to more reflective ways of thinking about participation. Reflecting on a companion modeling exercise, Barnaud and van Paassen (2013) show how effective empowerment involves dealing with important dilemmas between empowering stakeholders to lead the process and strategic interventions to ensure that less influential stakeholders also have a voice. They contend that a neutral posture is impossible in this context and indicate the need for a “critical companion” posture that involves deliberate design choices in shaping participatory processes, whose objectives and assumptions are made explicit to participants. While this approach does not steer free of new dilemmas and questions, these types of reflections and approaches clearly go beyond the type of simplistic normative stance described above. In the same vein, Neef and Neubert (2011) created a framework that structures reflection and decision-making around the design of participatory processes within agricultural research in a way that is not prescriptive but that invites consideration from multiple dimensions.
This renewed innovation and reflection around participatory research have influenced some areas within agricultural sciences much more than others. The static situation observed by Sumberg et al. (2013) seems to be applicable especially to those areas that generate data through field experiments and observational studies. The explanation advanced above is that a conceptual deficit around participation persists across the agricultural sciences and has impeded a more versatile design of participatory approaches. One innovative impulse may come from participatory approaches around systems modeling. In the following, we address the question if citizen science provides another impulse to rethinking participation in agricultural research.
4 New impulses of citizen science
To assess the potential of citizen science to bring a fresh perspective to participatory agricultural research, we discuss four novel aspects around participation that have emerged as part of the new experiences with citizen science. After introducing the concept of citizen science, we firstly discuss the new attention it has brought to the study of participants’ motivations. Secondly, we explore role differentiation in citizen science. The complexity of citizen science projects has led to fresh thinking on how participants can take up different roles in projects. Thirdly, citizen science’s emphasis on education has led to different ways to design and evaluate projects. We discuss how these experiences can provide opportunities to rethink participation in agricultural research and shed new light on its “empowerment agenda.” Lastly, citizen science has made use of digital tools to support the experience of participants. We discuss how this relates to the challenge of participatory agricultural research to address social inclusion issues.
4.1 Citizen science and participatory research
The term “citizen science” has emerged in the past 15 years to describe new forms of participatory research across a wide range of disciplines, commonly enabled by new digital technologies. There is no universally agreed-upon definition. In fact, several researchers stress that the plurality of understandings is critical to the creativity and innovation found in the field (Schäfer and Kieslinger 2016; Eitzel et al. 2017; ECSA 2020). For instance, while Cooper et al. (2007) define citizen science as “a dispersed network of volunteers to assist in professional research using methodologies that have been developed by or in collaboration with professional researchers”, other authors indicate that any scientific work undertaken by members of the general public should be considered citizen science, as long as it aims to follow protocols which align with standard practices within the discipline in which the research is framed (ECSA 2020). These broad definitions do not allow us to distinguish citizen science in any clear-cut way from participatory action research and participatory monitoring which have a longer history in the agricultural sciences. Nevertheless, the efforts that are labeled “citizen science” are distinct in their genesis and form.
Rick Bonney is credited as the first to publicly use the term citizen science, and then to describe the involvement of the public in large-scale data collection initiatives (Bonney et al. 2014; Woolley et al. 2016). He uses it to describe an alternative form of public outreach or science education to both build scientific literacy and harness large publics for data collection. Thus, citizen science allows researchers to benefit from scientific work generated by the public, and members of the public to be involved in authentic scientific activities, for example, modeling, collecting research data, and experimentation. For Bonney, this sets it apart from other forms of the public engaging with science, including informal or volunteer learning (Jordan et al. 2012; Bonney et al. 2016), public engagement with science (PES) (McCallie et al. 2009), or public understanding of science (PUS) (Bonney et al. 2016).
Others, most notably Alan Irwin (1995), use the term citizen science to emphasize the social responsibility of science and a fitting democratization of science: to serve and be accountable to the public good; common people should be included in research processes or enabled and organized to conduct their own research (see also Riesch and Potter 2014; Dickel and Franzen 2016; Woolley et al. 2016). This corresponds to already-mentioned notions of empowerment in participatory research, not only through participation but also through an emancipation of science from its institutional context and as the sole responsibility of scientists (Woolley et al. 2016).
Beyond its conceptual diversity, citizen science involves distinctive new elements or styles of research and participation that were absent or weak in previous participatory research, enabled by internet platforms, mobile phones, and other information and communication tools (ICTs) fostering computer-mediated communication, networking, and collaboration (Dickinson et al. 2012; Minet et al. 2017). Specifically, it makes use of so-called social computing formats and tools, for example, prediction markets, reputation systems, crowdsourcing, collaborative editing and filtering, and distributed sensing (Knol et al. 2008). Bonney et al. (2016) show that Internet technologies have made public engagement in scientific research more accessible and widespread in its ability to recruit large numbers participants and volunteers, including marginal groups. Large and complex datasets can be made available for piecemeal processing and analysis by many separate individuals online. As a result, digital tools have changed the scope of volunteer participation, enhanced the potential spatial and temporal coverage of data collection (McCormick 2012; Solli et al. 2013; Fuccillo et al. 2015), and improved data and image analysis (Crall et al. 2011; Cooper et al. 2015).
Citizen science in agriculture is a small but growing practice (Minet et al. 2017; Ryan et al. 2018). Agricultural research occupies a small percentage of the total effort dedicated to citizen science, with less than 2% of peer-reviewed articles reported to combine the term citizen science and agriculture (Ryan et al. 2018). Citizen science has proven efficient to collect observations from farmers and other nonprofessionals through digital “crowdsourcing” approaches (Minet et al. 2017). For example, PlantVillage uses digital tools to improve smallholder farming, involving different efforts to monitor pests and diseases in agricultural crops (https://plantvillage.psu.edu/). Similarly, large-scale on-farm experimentation is being done through citizen science format focused on crop variety evaluation (van Etten et al. 2019; https://climmob.net). Table 1 provides important examples of citizen science in different fields, including agriculture.
Citizen science is considered attractive because it can lead to a “double win,” supporting more efficient and effective scientific knowledge generation for researchers while supporting learning for participants and their wider communities, accompanied by a greater social accountability of scientific research (Shirk et al. 2012; Bonney et al. 2016; Cooper et al. 2015).
As for the first win, more effective and efficient scientific knowledge generation, digital forms of data collection can yield higher-quality data (in terms of spatial and temporal coverage and immediacy) at reduced costs (Blaney et al. 2016). Data quality has been the subject of debate in much of the early literature around citizen science. Critics indicated that using data from non-scientists called for more extensive data verification. However, the possibility of generating high-quality data through citizen science is accepted in several fields (Cooper et al. 2015). Citizen data can come at a lower cost, leading to an efficiency gain. Besides the initial investments in program development, software development, advertisement, recruitment, and training, costs for citizen science projects tend to decrease over time. After a program is established, with relatively high initial costs, it is mostly the relatively low running costs for computing and networking that remain (Palmer et al. 2017). However, as for participatory agricultural research (Section 2.1), the benefits are difficult to capture in cost-benefit ratios (Bela et al. 2016; Blaney et al. 2016). Even so, cost-benefit ratios remain an important focus of attention in the discussion about citizen science
The second win emphasizes the educational value of citizen science. Learning takes different forms. Participants gain new skills or content knowledge (Brossard et al. 2005; Evans et al. 2005), improve scientific literacy or understanding (Trumbull et al. 2000; Jordan et al. 2011), connect deeper with their environment (Newman et al. 2017) or with other people (Bell et al. 2008), and enhance environmental stewardship (Evans et al. 2005; Ballard et al. 2017). Some authors emphasize learning as a more interactive process, taking on board the perspectives of participants. Citizen science engages participants in decision-making processes (Shirk et al. 2012) and addresses local community concerns (Middleton 2006; Ottinger 2010). These different benefits of citizen science closely match those of participatory agricultural research (Section 2 above)
The goals and benefits of citizen science and its diversity may create the impression that citizen science is little more than a new label for participatory research. But even though there are important areas of convergence, citizen science shows some important differences. These not only reflect new methodological possibilities afforded by digital technologies but also the origin of citizen science, which emerged predominantly from rich economies and academic natural science research. Participatory agricultural research, in contrast, originated largely in and around applied agricultural research focusing on poor rural areas. In this sense, the differences between citizen science and participatory agricultural research are arguably not only scientific but also social. These differences in origins and trajectories make it interesting to explore possible ways to cross-fertilize between the two areas. The following sections explore different aspects of innovation within citizen science that address identified challenges of participatory agricultural research
4.2 Unpacking participant motivation and engagement
One of the distinguishing features of citizen science is the active involvement of citizens in scientific research with mutual benefits for both the scientists and the citizens (Robinson et al. 2018). This has sparked new research on the motivation and level of engagement of participants. Citizen science projects have often relied on the intrinsic motivation of participants (and rarely payment) and relatively open forms of (online) recruitment (Crowston and Fagnot 2008). The volunteer nature of citizen science participants and the shift away from monetary compensation makes a more reciprocal perspective obligatory, and sharpens the question how to attract, engage, and retain participants (Cooper and Lewenstein 2016). Hence, researchers have felt a strong need to understand why participants join and keep contributing to citizen science projects, leading to findings that are inspiring for participatory agricultural research as well. Major reasons to participate in online citizen science efforts are the motivation to contribute to scientific research (Raddick et al. 2013), gaining content understanding and skills, “helping” (referring to the positive, prosocial feelings of volunteering), as well as participants’ understanding of the process as well as its usability (Reed et al. 2013). Geoghegan et al. (2016) and Frensley et al. (2017) found that a contribution to science, sharing knowledge, and an interest in conservation were the main motivational factors for environmental citizen science projects. Hobbs and White (2012) found that personal benefits such as learning, enjoyment, as well as health and well-being are driving motivations in wildlife monitoring. They report that bird tracking even alleviated symptoms of depression for some of the participants. Dehnen-Schmutz et al. (2016) asked British and French farmers about their willingness to contribute to agricultural research as citizen scientists. Relatively few farmers deemed financial compensation to be essential, but this differed between tasks related to observation and data collection (where 9–18% rated financial compensation as essential) and tasks that involve experimentation (37%). Beza et al. (2017) studied the motivations of farmers to contribute to agricultural citizen science experiments in India, Honduras, and Ethiopia. The ability to contribute to scientific research and an interest in sharing information were found to be the most important factors. When farmers were asked about what they expected in return for participation, they generally mentioned information and technical advice, and rarely mentioned monetary compensation. These findings imply that approaches that mobilize intrinsic motivations are also feasible when working with resource-poor farmers.
The literature on volunteering makes fine-grained distinctions between the different factors that influence participants’ motivation in different phases and roles and how this relates to the characteristics of participants (Clary et al. 1998; Grube and Piliavin 2000; Penner 2002; Piliavin et al. 2002; Unell and Castle 2012; van Ingen and Wilson 2017). This literature has influenced research on motivation in citizen science. Crowston and Fagnot (2008) distinguish between initial, sustained, and meta-contributors. Initial contributors are driven by curiosity, in combination with having time available to contribute and feeling confident in their expertise and self-efficacy. Sustained contributors are motivated by feelings of fulfillment or obligation to the project, in addition to an intrinsic motivation in completing the tasks or by the feedback received from the activities or from other participants. Meta-contributors go beyond what is to be expected from volunteers and can help with building up the research. They are driven by a sense of group belonging as well as responsibility toward the group to participate fully as well as by intrinsic motivation from the activities. There is empirical support for the relevance of this classification of contributors. Jennett et al. (2016) find that initial motivation to participate is driven by curiosity and an interest in or wish to contribute to science. However, sustained participation depends on continued interest, a “feeling they had aptitude for the task”, as well as establishing a “rhythm of working.” Participants develop their skills by participating on a regular basis, which makes participation also more rewarding. It also increases the opportunities for social engagement. Motivations also tend to change over the lifetime of participants.
Some authors choose to group volunteers in terms of their consistency in volunteering: constant volunteers have volunteered consistently throughout their adult lives, serial volunteers have volunteered intermittently, and trigger volunteers have only started volunteering after retirement for example (Hogg 2010). Geoghegan et al. (2016) found that sustained volunteering depended on the ability to develop skills or gain knowledge and how much project feedback and communication were appreciated. This is echoed by Rotman et al. (2012), who see egoism as the main reason for engagement in citizen science in terms of personal curiosity, previous engagement, existing hobby and affiliation with the subject, or gaining experience. Secondary to this are motivations driven by recognition or attribution, feedback, community involvement, and advocacy. Differentiated motivation factors also correlated with socioeconomic factors. Frensley et al. (2017) found that prior experience in citizen science participation and a higher gross income are drivers for sustained participation. People tend to drop out due to time constraints and a perceived lack of ability to use online tools. Eveleigh et al. (2014) argue that “super volunteers” (who contribute much time) are important, but “dabblers” (casual volunteers) also need to be engaged. Generally, there are limited numbers of super volunteers, but large number of dabblers and drop-outs who give up after their initial participation yet remain interested. They argue that citizen science projects should make space for both types of volunteers yet approach them in different ways. They indicate the need to design for multiple points of entry without “forcing individuals into a sustained commitment” (p. 2992) by encouraging them to gradually increase their contribution, emphasizing the liberty of choice of participants, designing small tasks, using feedback loops to raise interest in the project, or making former participants reconsider joining again. Nov et al. (2014) show that tapping into extrinsic forms of motivation of volunteers might be useful too, as the quality of contributions is mostly affected by collective motives or social norms and reputation.
In summary, citizen science has generated substantial insights into the reasons why people participate and how this should affect the design of research projects. Participatory agricultural research has generally focused on farmer motivation from a narrow cost-benefit focus (Section 2.1) and often relied on monetary payments or free input provision to incentivize farmers rather than taking up the question of motivation as a wider design consideration. Citizen science stimulates thinking about motivation as an integrated part of research design and as a critical area of inquiry.
4.3 Rethinking participation
Another contribution of citizen science is that it has explicitly addressed questions of differentiated participation in more nuanced ways. Riesch and Potter (2014) write that it is not realistic to expect regular attendance or continued participation over prolonged periods of time, given the voluntary nature of participation in citizen science. Participation in all stages of a project is still widely held as an ideal, but differentiated conceptualizations of participation have become prevalent (cf. Section 3.2 above). An important impulse comes from the use of digital data collection techniques for citizen science. Internet-based forms of participation using crowdsourcing formats can be relatively small scale and passive on the part of an individual volunteer, but make substantial contributions to scientific research and benefit both the user and the researcher. Haklay (2013) indicates that in citizen science projects, different levels and roles of participation are regularly being combined. For example, contributors can start with a doing small crowdsourcing tasks and as they contribute more, move up in their level of participation and in consequence acquire more and different project roles. There is evidence that the level of participation does not correlate in a straightforward way with the impact of the work. Phillips (2017); Phillips et al. 2019) and colleagues studied levels of engagement in several citizen science projects. They found that even though participants of co-created projects—which would rank higher in a “Participation Ladder”—engaged in more activities than participants in (lower ranking) contributory or collaborative projects, this did not necessarily lead to increased motivation or deeper learning. Deep learning is possible in any project, as participants learn differently and engage with the project in unplanned ways (see also Edwards et al. 2019).
From the practical perspective of designing citizen science projects, Purcell et al. (2012) indicate that projects should cater for multiple points of entry by offering experiences for different comfort zones. This is linked to insights on how motivation can dynamically change over time but also to different levels of skill or cognitive ability of participants. For example, participants in citizen science projects are not necessarily non-scientists, but can be professional scientists who contribute voluntary in their free time (ECSA 2020). Differences in experience or familiarity with research processes can be found in any sample of citizen scientists requiring strategies to ensure that learning is supported by materials catering for different groups, as their abilities to participate in terms of time, labor, or learning needs are likely to differ. Not every actor needs to be involved in scientific research at the same level or needs to attain the same learning goals. Science, according to the authors, should be one of the many resources that individuals can draw upon to make informed decisions. If scientific literacy is a collective property, then participatory projects should set learning outcomes that cater for different forms and levels of participation. This is also “more consistent with a democratic approach in which people make decisions about their own lives and interests” (ECSA 2020).
Citizen science efforts make deliberate use of role differentiation, making more differentiated normative claims about participation, moving beyond ideals of simple epistemic equivalence between scientists and participating non-scientists. Epistemic equivalence was already contested in the agricultural sciences (e.g., Bentley 1989). In participatory agricultural research, role differentiation was mainly associated with lead-farmers who had group leadership roles. Approaches did generally not assign differentiated roles and justify this differentiation in a positive way, with the exception of the work on participatory modeling and simulation with approaches designed to take diverging interests into account (Farrié et al. 2015; Berthet et al. 2018). Thinking about participation as a collective, distributed effort with differentiated roles, also in observational and experimental work, opens a new spectrum of possibilities for research design. This can be an impulse for innovation in participatory agricultural research. Here, agricultural research can again take a page from the book of fields like human-computer interaction, where Vines et al. (2012) developed and advocated a lightweight and flexible approach to participation with room for configuring multiple levels of contributing. Multiple forms of participation are likely to occur naturally within participatory processes. It is more a call for the researcher to acknowledge them and be flexible about the boundaries it sets for participation (Vines et al. 2013).
4.4 Changing accountabilities and challenging epistemologies
Citizen science can fulfill its democratizing function through mobilizing an extended peer community of stakeholders (Funtowicz et al. 1997). This can challenge but ultimately enrich mainstream science, as the success of modern science depends on epistemic pluralism (Leonelli 2007). Digital tools, such as cheap sensors and social media, can afford new ways of social mobilization around knowledge, which can then feed new epistemologies, most visible in citizen science driven by activist objectives. In a paradigmatic example, Ottinger (2010) found that citizen scientists using cheap air quality sensors successfully challenged scientific standards, measuring and establishing the scientific and practical relevance of aspects of air quality that were overlooked by scientists—thereby actively holding professional scientists accountable for their current practice and its consequences for human health. In another citizen science project around crop variety recommendations, the project results questioned current crop variety recommendations from agricultural science in overlooking important spatial aspects (van Etten et al. 2019). Frickel et al. (2010) unpack how citizen science can address “undone science,” which they define as “areas of research that are left unfunded, incomplete, or generally ignored but which social movements or civil society organizations often identify as worthy of more research”. Citizen scientists can go beyond advocacy for a shift in scientific priorities and enact this shift themselves, which empowers them to question existing epistemic biases on the basis of new data. In the case described by Ottinger (2010), the citizen science effort did not only produce new data itself but also had an impact by spurring new professional science efforts with new methods to address the questions raised by the measurements of citizen scientists.
A crucial new element in this is that cheap sensors and digital connectivity have made “big data” participatory science possible. Big data does not only imply a quantitative shift (more data) but also an epistemic shift in data interpretation, adapting the methods to take advantage of “opportunistic” data that is collected without following standardized sampling procedures, but sampled following the possibilities and interests of volunteers (Kelling et al. 2015; Ojha et al. 2015). In agriculture, it was precisely the rise of modern statistics (focused on small sample experiments) in the first half of the twentieth century that moved farmer-participatory experimental research to the background, as randomization practices were unpractical for farmer experimentation (Parolini 2015). It could therefore be argued that the citizen science provides a truly new occasion for a rethinking of the epistemology of agricultural experimentation and accountability of the agricultural sciences.
4.5 Designing participation
A characteristic feature of most citizen science projects is that they use digital technologies to facilitate data transmission, communication, and collaborations, and to enable participation at a scale that was previously unattainable. Today, hundreds if not thousands of citizen science websites and applications exist and are used by people from different age groups or backgrounds, and with different skills and motivations. The design of these digital technologies powerfully shapes the experiences and action opportunities of participants (Sharma et al. 2019). Researchers are therefore collaborating with professional digital developers and human-computer interaction (HCI) specialists, and as a result, design issues around data quality, sustained participation, and adoption of tools and technologies are now better understood (Skarlatidou et al. 2019a).
HCI builds on a long tradition in ergonomics, the design of artifacts, and systems to fit human capabilities and needs. It evolved from improving the usability of early computing devices to a multidisciplinary field which includes participatory design and community interaction to understand and improve all aspects of humans interacting with and through an increasingly ubiquitously computer-mediated world (Vines et al. 2012; Preece 2016; Caroll 2017). User-centered design lies at the heart of HCI, involving methods and principles that put the needs, abilities, and constraints of a technology’s “end user” front and center in design (Caroll 2017). Citizen science has connected with HCI from the outset, using HCI and user-centered design concepts and methods to enhance the experience of citizen scientists and configure complex constellations of participation between people and machines. Hence, there is a rich and growing literature on citizen science HCI (for reviews, see Newman et al. 2010; Kim et al. 2011; Wiggins and Crowston 2011). For example, Sturm and Tscholl (2019) indicated the importance of user feedback for participatory design approaches by distinguishing between general user feedback, contributory user feedback and co-creational user feedback to be able to cater for different types of volunteers. Spiers et al. (2019) explore user issues and volunteer behavior in 63 online citizen science projects and found that many subtle design choices influence how and how much interaction takes place and, ultimately, who participates or not. Skarlatidou et al. (2019b) present a series of highly specific design considerations based on a systematic review of the literature and conclude that user studies should be fully integrated in any citizen science project design. Sullivan et al. (2014) describe how to design citizen science projects for both data quantity and data quality. In addition, there has been substantial research on how to design effective platforms for citizen involvement in science as well as designing incentive systems aimed at motivating people to participate (cf. Cooke 2000; Kim et al. 2011; Shirk et al. 2012; West and Pateman 2016; Edelson, Kirn and Workshop Participants 2018).
While citizen science has placed participants’ motivations front and center, and opened new, differentiated forms of conceptualizing and organizing participation, thanks to its intersection with HCI, it has also paid sustained attention to the detail design and design processes of volunteer participation, embracing user-centered and participatory design methods. Deeper engagement of agricultural citizen science with the wider citizen science community and HCI research would be beneficial. For participatory agricultural research, this could lead to an acceleration of learning through exchange of insights and more systematic digital design processes, potentially leading to innovations in areas such as interaction design of data collection tools or gamification of experiences (Beza et al. 2018).
5 Conclusions
We indicated several reasons why participatory research has not become mainstream in the agricultural technology development cycle. First, there has been a lack of strategic-level investment within agricultural research institutes in the structures needed to implement effective participatory processes. Even though farmer organizations and private sector research initiatives have been involved in multi-stakeholder innovation platforms over the recent years, this did not necessarily lead to an effective inclusion of participatory approaches in agricultural research. Second, most institutions are using incentive systems that favor data production over impact. The outcomes of participatory processes are often part of wider dynamic processes and more difficult to measure than concrete research outputs. Planning, resource allocation, and evaluation of participatory research do generally not ensure that its findings will affect decisions on the design of new products or future research priorities. This has resulted in a relatively low accountability toward the end user of research outputs. Third, competition between institutions and a resulting lack of institutional learning has hindered the progress of participatory research in terms of theory building and sharing its successes and its limitations. Finally, the discourse on participatory agricultural research has been dominated by a relatively one-dimensional view of participation and the notion that “more participation is better.” All of these have affected the perceived success of participatory projects.
It could be argued that citizen science will break through many of these barriers simply because it can reduce costs per data point. But citizen science externalizes certain costs to citizen scientists and creates new ones, such as maintaining digital tools, data verification, managing online communities, and facilitating communication among large groups of stakeholders. Therefore, cost reduction per se should not be expected to be the only or even main reason for citizen science to break through previous barriers. In our view, the main difference with previous participatory research formats is that citizen science can involve more diverse ways of distributing work across stakeholders and aligning these kinds of work with different types of motivation to participate. Such alignment requires careful design of citizen science projects. Here, citizen science could make inroads by challenging some of the concepts of participation that have held sway in agricultural participatory research. Citizen science has brought attention to more diverse configurations of participation that can involve more differentiated roles of participants, both more active and more passive forms of participation, and a stronger emphasis on the design of the experience of participants. In this sense, citizen science can help participatory science to break out of a straitjacket that was highly normative, opening a wider space of experimentation to creatively conceive and test different configurations of participation. This opening up could and should go hand in hand with an opening to more scientific and epistemic accountability to stakeholders and more open forms of science. Only then are citizen science-inspired forms of participation likely to overcome the institutional and epistemological barriers that have revealed themselves over the last four decades.
Even then, extractive forms are still possible within a citizen science context. Citizen science will need to address new dimensions of social inclusion: potential citizen scientists are likely to have unequal access to digital means of communication and will have different levels of digital literacy. Citizen science, however, has renewed an interest in participant motivation and the use of digital tools to tailor and monitor participants’ experiences building on human-computer interaction research, which can support new ways to monitor and evaluate social inclusion.
Lastly, we believe that citizen science stimulates innovation in participatory agricultural research because it connects different disciplines that can learn much from each other. Much creativity can be unleashed when agricultural scientists work with digital designers, human-computer interaction researchers, and get involved in the wider community of scientists that are engaged in citizen science, such as ecologists and environmental scientists. Also, citizen science involves data science challenges that transcend disciplines, such as dealing with “opportunistic” sampling and certain biases in citizen science data. This is another area where mutual exchange between disciplines can stimulate creativity.
In summary, citizen science has the potential to provide an impulse to participatory agricultural research by providing opportunities to reconfigure cost-motivation-accountability combinations using digital tools, by opening up a larger conceptual space of experimentation to do this, and by stimulating new collaborations between disciplines. With appropriate and persistent institutional support and investment, citizen science can therefore have a lasting impact on how agricultural science engages with farming communities and wider society, and a useful approach to deliver on the promises of participation.
References
Abah OS et al (2011) How wide are the ripples? From local participation to international organisational learning. 63. London, United Kingdom
Abrol D, Gupta A (2014) Understanding the diffusion modes of grassroots innovations in India: a study of honey bee network supported innovators. African J Sci Technol Innov Dev 6(6):541–552. https://doi.org/10.1080/20421338.2014.976974
Aker JC (2010) ‘Dial a for agriculture: using information and communication Technologies for Agricultural Extension in developing countries’, in Conference Agriculture for Development-Revisited, University of California at Berkeley, October, pp. 1–2. doi: https://doi.org/10.1111/j.1574-0862.2011.00545.x
Anderson JR, Feder G (2004) Agricultural extension: good intentions and hard realities. World Bank Res Obs 19(1):41–60. https://doi.org/10.1093/wbro/lkhO13
Arnstein SR (1969) A ladder of citizen participation. Reprint from JAIP 35(4):216–224. https://doi.org/10.1080/01944366908977225
Ashby JA (1996) What do we mean by participatory research in agriculture? In: New Frontiers in Participatory Research and Gender Analysis. An International Seminar on Participatory Research and Gender Analysis for Technology Development. CIAT, Cali, Columbia, p 280 Cali, pp. 15–22
Ballard HL, Dixon CGH, Harris EM (2017) Youth-focused citizen science: examining the role of environmental science learning and agency for conservation. Biological Conservation. The Authors 208:65–75. https://doi.org/10.1016/j.biocon.2016.05.024
Barnaud C, van Paassen A (2013) Equity, power games, and legitimacy: dilemmas of participatory natural resource management. Ecol Soc 18(2). https://doi.org/10.5751/ES-05459-180221
Barreteau O et al (2003) Our companion modelling approach. J Artif Soc Soc Simul 6(2) Available at: http://jasss.soc.surrey.ac.uk/6/2/1.html
Becker T (2000) Participatory research in the CGIAR. In: Tropentag D (ed) Session: international agricultural research: methods. Strategies and Institutions, Hohenheim, pp 1–16
Bela G et al (2016) Learning and the transformative potential of citizen science. Conservation biology : the journal of the Society for Conservation Biology 30(5):990–999. https://doi.org/10.1111/cobi.12762
Bell S et al (2008) What counts? Volunteers and their organisations in the recording and monitoring of biodiversity. Biodivers Conserv 17(14):3443–3454. https://doi.org/10.1007/s10531-008-9357-9
Bentley JW (1989) ‘What farmers don’ t know can’t help them: the strengths and weaknesses of indigenous technical knowledge in Honduras’, Agriculture and human values, Summer, pp. 25–31. doi: https://doi.org/10.1007/BF02217666
Bentley JW (1994) Facts, fantasies, and failures of farmer participatory research. Agric Hum Values 11(2–3):140–150. https://doi.org/10.1007/BF01530454
Berthet ETA et al (2016) How to foster agroecological innovations? A comparison of participatory design methods. J Environ Plan Manag 59(2):280–301. https://doi.org/10.1080/09640568.2015.1009627
Berthet ET, Hickey GM, Klerkx L (2018) Opening design and innovation processes in agriculture: insights from design and management sciences and future directions. Agric Syst 165(June):111–115. https://doi.org/10.1016/j.agsy.2018.06.004
Beza E et al (2017) What are the prospects for citizen science in agriculture? Evidence from three continents on motivation and mobile telephone use of resource-poor farmers. Plos One 12(5):e0175700. https://doi.org/10.1371/journal.pone.0175700
Beza E et al (2018) Exploring farmers’ intentions to adopt mobile Short Message Service (SMS) for citizen science in agriculture. Comput Electron Agric 151(June):295–310. https://doi.org/10.1016/j.compag.2018.06.015
Biggs S (1989) ‘Resource-poor farmer participation in research: a synthesis of experiences from national agricultural research systems’, OFCOR - Comparative Study Paper No. 3, p. 37
Biggs S (2008) The lost 1990s? Personal reflections on a history of participatory technology development. Dev Pract 18(4–5):489–505. https://doi.org/10.1080/09614520802181228
Blaney R et al (2016) ‘Citizen Science and Environmental Monitoring : Towards a Methodology for Evaluating Opportunities , Costs and Benefits Final Report on behalf of UK Environmental Observation Framework by ’:, Citizen Science and Environmental Monitoring-Final Report, (Final Report), p. 77
Bonney R et al (2014) Citizen science: next steps for citizen science. Science:1436–1437. https://doi.org/10.1126/science.1251554
Bonney R et al (2016) Can citizen science enhance public understanding of science? Public Underst Sci 25(1):2–16. https://doi.org/10.1177/0963662515607406
Brossard D, Lewenstein B, Bonney R (2005) Scientific knowledge and attitude change: the impact of a citizen science project. Int J Sci Educ 27(9):1099–1121. https://doi.org/10.1080/09500690500069483
Bunch R (1982) Two ears of corn: a guide to people-Centred agricultural improvement. World Neighbours, Oklahoma City
Caroll JM (2017) Human-computer interaction - brief history. In: The Encyclopedia of Human-Computer Interaction, 3rd edn. Interaction Design Foundation, pp 21–62
Ceccarelli S (2015) Efficiency of plant breeding. Crop Science 55(1):87. https://doi.org/10.2135/cropsci2014.02.0158
Ceccarelli S, Grando S (2007) Decentralized-participatory plant breeding: an example of demand driven research. Euphytica 155(3):349–360. https://doi.org/10.1007/s10681-006-9336-8
Chambers R (1994) The origins and practice of participatory rural appraisal. World Dev 22(7):953–969. https://doi.org/10.1016/0305-750X(94)90141-4
Chambers R, Jiggins J (1987) Agricultural research for resource-poor farmers part I: transfer-of-technology and farming systems research. Agric Adm Ext 27(1):35–52. https://doi.org/10.1016/0269-7475(87)90008-0
Chowdhury, A. et al. (2015) ‘Enhancing farmers’ capacity for botanical pesticide innovation through video-mediated learning in Bangladesh’, Int J Agric Sustain. Taylor & Francis, 13(4), pp. 1–24. doi: https://doi.org/10.1080/14735903.2014.997461
Clary EG et al (1998) Understanding and assessing the motivations of volunteers: a functional approach. J Pers Soc Psychol 74(6):1516–1530
Collinson M (2000) A history of farming systems research. Edited by M Collinson, FAO and CABI
Cooke M (2000) Five arguments for deliberative democracy. Political Studies 48(5):947–969. https://doi.org/10.1111/1467-9248.00289
Cooper CB, Lewenstein BV (2016) Two meanings of citizen science. In: The Rightful Place of Science: Citizen Science, 1st edn, pp 51–62
Cooper CB et al (2007) Citizen science as a tool for conservation in residential ecosystems. Ecol Soc 12(2). https://doi.org/10.5751/ES-02197-120211
Cooper CB, Bailey RL, Leech DI (2015) The role of citizen science in studies of avian reproduction. In: Reynolds DCD, S. J (eds) Nests, Eggs, and Incubation: New ideas about avian reproduction. Oxford University Press, pp 208–220. https://doi.org/10.1093/acprof:oso/9780198718666.003.0017
Cornwall A (2008) Unpacking “participation” models, meanings and practices. Community Development Journal 43(3):269–283. https://doi.org/10.1093/cdj/bsn010
Cornwall A, Jewkes R (1995) What is participatory research? Soc sci Med 41(12):1667–1676 doi: citeulike-article-id:6707894
Crall A et al (2011) Assessing citizen science data quality: an invasive species case study. Conserv Lett 4(6):433–442. https://doi.org/10.1111/j.1755-263X.2011.00196.x
Crowston, K. and Fagnot, I. (2008) ‘The motivational arc of massive virtual collaboration’, Proceedings of the IFIP WG 9.5 Working Conference on Virtuality and Society: Massive Virtual Communities, (July), pp. 1–2. 10.1.1.193.7977
Dehnen-Schmutz K et al (2016) Exploring the role of smartphone technology for citizen science in agriculture, Agronomy for Sustainable Development. Agron Sustain Dev 36(2). https://doi.org/10.1007/s13593-016-0359-9
Dickel S, Franzen M (2016) The “problem of extension” revisited: new modes of digital participation in science. J Sci Commun 15(1):1–15
Dickinson JL et al (2012) The current state of citizen science as a tool for ecological research and public engagement. Front Ecol Environ 10(6):291–297
Douthwaite B, Hoffecker E (2017) ‘towards a complexity-aware theory of change for participatory research programs working within agricultural innovation systems’. Agric Syst 155:88–102. https://doi.org/10.1016/j.agsy.2017.04.002
Douthwaite B et al (2017) A new professionalism for agricultural research for development. https://doi.org/10.1080/14735903.2017.1314754
Drinkwater LE, Friedman D, Buck L (2016) Innovative solutions to complex challenges. This publication is distributed by SARE Outreach Available at: http://www.sare.org/Learning-Center/Books/Systems-Research-for-Agriculture
ECSA (2020) ECSA’s characteriscs of citzen science. Eur Citizen Sci Assoc:1–6. https://doi.org/10.14324/111.9781787352339
Edelson DC, Kirn SL, Workshop Participants (2018) Designing citizen science for both science and education : a workshop report. BSCS Science Learning, Colorado Springs, USA, pp 1–39
Edwards R et al (2019) Learning and developing science capital through citizen science. Citizen Sci:381–390. https://doi.org/10.2307/j.ctv550cf2.33
Eitzel MV et al (2017) Citizen Science Terminology Matters: Exploring Key Terms. Citizen Science: Theory and Practice 2(1):1. https://doi.org/10.5334/cstp.96
Evans C et al (2005) The neighborhood nestwatch program: participant outcomes of a citizen-science ecological research project. Conserv Biol 19(3):589–594. https://doi.org/10.1111/j.1523-1739.2005.00s01.x
Eveleigh, A. et al. (2014) ‘Designing for dabblers and deterring drop-outs in citizen science’, in CHI 2014, One of a CHInd, Toronto, Canada, pp. 2985–2994
Farrié B et al (2015) Rangeland rummy - a board game to support adaptive management of rangeland-based livestock systems. J Environ Manag 147:236–245. https://doi.org/10.1016/j.jenvman.2014.08.018
Faure G, Blundo-Canto G, Devaux-Spatarakis A, Le Guerroué JL, Mathé S, Temple L, Toillier A, Triomphe B, Hainzelin E (2020) A participatory method to assess the contribution of agricultural research to societal changes in developing countries. Research Evaluation, 29(2):158–170
Frensley T et al (2017) Bridging the benefits of online and community supported citizen science: a case study on motivation and retention with conservation-oriented volunteers. Citizen Sci: Theory Pract 2(1):4. https://doi.org/10.5334/cstp.84
Frickel S et al (2010) Undone science: charting social movement and civil society challenges to research agenda setting. Science Technology and Human Values 35(4):444–473. https://doi.org/10.1177/0162243909345836
Friis-Hansen E (2008) Impact assessment of farmer institutional development and agricultural change: Soroti district, Uganda. Dev Pract 18(4–5):506–523. https://doi.org/10.1080/09614520802181236
Fuccillo KK et al (2015) Assessing accuracy in citizen science-based plant phenology monitoring. Int J Biometeorol 59(7):917–926. https://doi.org/10.1007/s00484-014-0892-7
Funtowicz S et al (1997) Environmental problems, post-normal science, and extended peer communities. Études et Recherches sur les Systèmes Agraires et le Développement 30:169–175
Geoghegan H et al (2016) ‘Understanding motivations for citizen science. Final Report on behalf of the UK Environmental Observation Framework (UKEOF)’, (May), p. 124. Available at: http://www.ukeof.org.uk/resources/citizen-science-resources/MotivationsforCSREPORTFINALMay2016.pdf
Green paper on Citizen Science (2013) Citizen science for Europe: towards a society of empowered citizens and enhanced research. European Commission. Brussels. Available at: https://ec.europa.eu/newsroom/dae/document.cfm?doc_id=4122
Grube J, Piliavin J (2000) Role identity, organizational experiences, and volunteer performance. Personal Soc Psychol Bull 26(9):1108–1119. https://doi.org/10.1177/01461672002611007
Haklay M (2013) Citizen science and volunteered geographic information: overview and typology of participation. In: Sui D, Elwood S, Goodchild M (eds) Crowdsourcing geographic knowledge: volunteered geographic information (VGI) in theory and practice. Springer Netherlands, Dordrecht, pp 105–122. https://doi.org/10.1007/978-94-007-4587-2_7
Heinemann E, Van Hemelrijck A, Guijt I (2017) Getting the most out of impact evaluation for learning, reporting and influence. Insights from piloting a Participatory Impact Assessment and Learning Approach (PIALA) with IFAD. IFAD RESEARCH SERIES 16. Available at: https://www.ifad.org/documents/38714170/39317790/Res.+Series+Issue+16+Getting+the+most+out+of+impact.pdf/c76ba037-0195-420f-a290-8e8350749f0f
Hellin J, Lundy M, Meijer M (2009) Farmer organization, collective action and market access in Meso-America. Food Policy 34(1):16–22. https://doi.org/10.1016/j.foodpol.2008.10.003
Hickey S, Mohan G (2004) Participation: from tyranny to transformation. Zed Books, Exploring New Approaches to Participation in Development. First edit. London - New York
Hobbs SJ, White PCL (2012) Motivations and barriers in relation to community participation in biodiversity recording. J Nat Conserv 20(6):364–373. https://doi.org/10.1016/j.jnc.2012.08.002
Hoffmann V, Probst K, Christinck A (2007) Farmers and researchers: how can collaborative advantages be created in participatory research and technology development? Agric Hum Values 24(3):355–368. https://doi.org/10.1007/s10460-007-9072-2
Hogg E (2010) Constant, serial and trigger volunteers: volunteering across the lifecourse and into older age. Voluntary Sector Review 7(2):169–190. https://doi.org/10.7910/DVN/PZB01G
Hughes D, and Salathé M (2015) An open access repository of images on plant health to enable the development of mobile disease diagnostics. arXiv preprint arXiv:1511.08060.
Humphries S et al (2015) Synergies at the interface of farmer–scientist partnerships: agricultural innovation through participatory research and plant breeding in Honduras. Agriculture & Food Security 4(1):27. https://doi.org/10.1186/s40066-015-0046-0
Irwin A (1995) Citizen science: a study of people, expertise and sustainable development. Routledge. https://doi.org/10.1177/017084069701800109
Jennett C et al (2016) Motivations, learning and creativity in online citizen science. J Sci Commun 15(3):1–23
Johnson NL, Lilja N, Ashby JA (2003) Measuring the impact of user participation in agricultural and natural resource management research. Agric Syst 78(2):287–306. https://doi.org/10.1016/S0308-521X(03)00130-6
Johnson NL et al (2004) The practice of participatory research and gender analysis in natural resource management. Nat Res Forum 28(3):189–200. https://doi.org/10.1111/j.1477-8947.2004.00088.x
Jordan RC et al (2011) Knowledge gain and behavioral change in citizen-science programs. Conserv Biol 25(6):1148–1154. https://doi.org/10.1111/j.1523-1739.2011.01745.x
Jordan RC, Ballard HL, Phillips TB (2012) Key issues and new approaches for evaluating citizen science learning outcomes. Front Ecol Environ 10(6):307–309
Joseph MK, Andrew TN (2008) Participatory approaches for the development and use of information and communication technologies (ICTs) for rural farmers. In: 2008 IEEE International Symposium on Technology and Society, pp 1–13. https://doi.org/10.1109/ISTAS.2008.4559774
Kelling S et al (2015) Taking a “big data” approach to data quality in a citizen science project. Ambio 44(4):601–611. https://doi.org/10.1007/s13280-015-0710-4
Kim, S. et al. (2011) ‘Creek watch: pairing usefulness and usability for successful citizen science’, Conference on Human Factors in Computing Systems - Proceedings, (May 2014), pp. 2125–2134. doi: https://doi.org/10.1145/1978942.1979251
Kiptot E, Franzel S (2014) Voluntarism as an investment in human, social and financial capital: evidence from a farmer-to-farmer extension program in Kenya. Agric Hum Values 31(2):231–243. https://doi.org/10.1007/s10460-013-9463-5
Klerkx L, Van Mierlo B, Leeuwis C (2012) Evolution of systems approaches to agricultural innovation : concepts , analysis and interventions. In: Farming Systems Research into the 21st Century: The New Dynamic, pp 457–483. https://doi.org/10.1007/978-94-007-4503-2
Knol P, Spruit M, Scheper W (2008) Web 2.0 revealed: business model innovation through social computing. Proceedings of the Seventh AIS SIGeBIZ Workshop on e-business (January 2008)
Kristjanson P, Harvey B (2014) ‘Social learning and sustainable development’, Nature Climate, 4, pp. 5–7. Available at: http://www.nature.com/nclimate/journal/v4/n1/full/nclimate2080.html
Leonelli S (2007) Weed for thought. Vrije Universiteit Amsterdam, Using Arabidopsis thaliana to Understand Plant Biology
Lilja N, Ashby JA (1999) Types of participatory research based on locus of decision making. CGIAR Systemwide Program on Participatory Research and Gender Analysis Working Document No. 6 (6)
Lilja N, Bellon MR (2008) Some common questions about participatory research: a review of the literature. Dev Pract 18(4–5):479–488. https://doi.org/10.1080/09614520802181210
Martin G, Felten B, Duru M (2011) Forage rummy: a game to support the participatory design of adapted livestock systems. Environ Model Softw 26(12):1442–1453. https://doi.org/10.1016/j.envsoft.2011.08.013
McCallie E et al. (2009) ‘Many experts, many audiences: public engagement with science and informal science education’, A CAISE Inquiry, (March), pp. 1–83. Available at: http://digitalcommons.calpoly.edu/cgi/viewcontent.cgi?article=1011&context=eth_fac
McCarthy J, Wright P (2017) Taking [a]part: the politics and aesthetics of participation in experience-centered design. Routledge. https://doi.org/10.1080/17547075.2017.1280282
McCormick S (2012) After the cap: risk assessment, citizen science and disaster recovery. Ecol Soc 17(4). https://doi.org/10.5751/ES-05263-170431
Meynard J-M, Dedieu B, Bos B (2012) Re-design and co-design of farming systems. An overview of methods and practices. In: Darnhofer I, Gibbon D, Dedieu B (eds) Farming Systems Research into the 21st Century: The New Dynamic. Springer Science+Business Media, pp 405–429. https://doi.org/10.1007/978-94-007-4503-2
Middleton JV (2006) The stream doctor project: community-driven stream restoration. BioScience 51(4):293. https://doi.org/10.1641/0006-3568(2001)051[0293:tsdpcd]2.0.co;2
Minet J et al (2017) Crowdsourcing for agricultural applications: a review of uses and opportunities for a farmsourcing approach. Comput Electron Agric 142:126–138. https://doi.org/10.1016/j.compag.2017.08.026
Morris ML, Bellon MR (2004) Participatory plant breeding research: opportunities and challenges for the international crop improvement system. Euphytica 136(1):21–35. https://doi.org/10.1023/B:EUPH.0000019509.37769.b1
Muender T et al (2019) Comparison of mouse and multi-touch for protein structure manipulation in a citizen science game interface. J Sci Commun 18(01):1–16. https://doi.org/10.1017/CBO9781107415324.004
Naivinit W et al (2010) Participatory agent-based modeling and simulation of rice production and labor migrations in Northeast Thailand. Environ Model Softw 25(11):1345–1358. https://doi.org/10.1016/j.envsoft.2010.01.012
Najjar D, Spaling H, Sinclair AJ (2013) Learning about sustainability and gender through farmer field schools in the Taita Hills, Kenya. Int J Educ Dev 33(5):466–475. https://doi.org/10.1016/j.ijedudev.2012.06.004
Neef A (2008) Integrating participatory elements into conventional research projects: measuring the costs and benefits. Dev Pract 18(4–5):576–589. https://doi.org/10.1080/09614520802181632
Neef A, Neubert D (2011) Stakeholder participation in agricultural research projects: a conceptual framework for reflection and decision-making. Agric Hum Values 28(2):179–194. https://doi.org/10.1007/s10460-010-9272-z
Newman G et al (2010) User-friendly web mapping: lessons from a citizen science website. Int J Geogr Inf Sci 24(12):1851–1869. https://doi.org/10.1080/13658816.2010.490532
Newman G et al (2017) Leveraging the power of place in citizen science for effective conservation decision making. Biol Conserv 208:55–64. https://doi.org/10.1016/j.biocon.2016.07.019
Nov O, Arazy O, Anderson D (2014) Scientists@Home: what drives the quantity and quality of online citizen science participation? PLoS One 9(4):1–11. https://doi.org/10.1371/journal.pone.0090375
Ojha T, Misra S, Singh N (2015) Wireless sensor networks for agriculture : the state-of-the-art in practice and future challenges. Comput Electron Agric 118:66–84. https://doi.org/10.1016/j.compag.2015.08.011
Ottinger, G. (2010) ‘Buckets of resistance: standards and the effectiveness of citizen science’, Science, Technology & Human Values, 35(2), pp. 244–270. doi: https://doi.org/10.1177/0162243909337121
Palmer JRB et al (2017) Citizen science provides a reliable and scalable tool to track disease-carrying mosquitoes. Nat Commun 8(1):1–12. https://doi.org/10.1038/s41467-017-00914-9
Parolini G (2015) In pursuit of a science of agriculture: the role of statistics in field experiments. History and Philosophy of the Life Sciences 37(3):261–281. https://doi.org/10.1007/s40656-015-0075-9
Penner LA (2002) Dispositional and organizational influences on sustained volunteerism: an Interactionist perspective. J Soc Issues 58(3):447–467. https://doi.org/10.1111/1540-4560.00270
Phillips CB (2017) Engagement and learning in environmentally-based citizen science : a mixed methods comparative. Cornell University. Available at: https://ecommons.cornell.edu/bitstream/handle/1813/58985/Phillips_cornellgrad_0058F_10635.pdf?sequence=1&isAllowed=y
Phillips D, Waddington H, White H (2014) Better targeting of farmers as a channel for poverty reduction: a systematic review of farmer field schools targeting. Development Studies Research 1(1):113–136. https://doi.org/10.1080/21665095.2014.924841
Phillips T et al (2019) Engagement in science through citizen science: moving beyond data collection. Sci Educ 103(3):665–690. https://doi.org/10.1002/sce.21501
Pigford AAE, Hickey GM, Klerkx L (2018) Beyond agricultural innovation systems? Exploring an agricultural innovation ecosystems approach for niche design and development in sustainability transitions. Agric Syst 164:116–121. https://doi.org/10.1016/j.agsy.2018.04.007
Piliavin JA, Grube JA, Callero PL (2002) Role as resource for action in public service. J Soc Issues 58(3):469–485
Pope HAN (2013) Participatory Crop Improvement : The challenges of and opportunities for institutionalisation in the Indian public research sector. PhD thesis, University of Sussex
Preece J (2016) Citizen science: new research challenges for human–computer interaction. International Journal of Human-Computer Interaction 32(8):585–612. https://doi.org/10.1080/10447318.2016.1194153
Pretty J (1995) Participatory learning for sustainable agriculture. World Dev 23(8):1247–1263. https://doi.org/10.1016/0305-750X(95)00046-F
Purcell K, Garibay C, Dickinson J (2012) A gateway to science for all: celebrate urban birds. In: Citizen Science: Public Participation in Environmental Research. Cornell Paperbacks
Raddick MJ et al (2013) Galaxy zoo: motivations of citizen scientists. Astron Educ Rev 12(1):1–41. https://doi.org/10.3847/AER2011021
Reed J et al (2013) An exploratory factor analysis of motivations for participating in Zooniverse, a collection of virtual citizen science projects. Proceedings of the Annual Hawaii International Conference on System Sciences:610–619. https://doi.org/10.1109/HICSS.2013.85
Richards P (2007) How does participation work? Deliberation and performance in African food security. IDS Bull 38(5):21–35
Riesch H, Potter C (2014) Citizen science as seen by scientists: methodological, epistemological and ethical dimensions. Public Underst Sci 23(1):107–120. https://doi.org/10.1177/0963662513497324
Robinson LD et al (2018) Ten principles of citizen science. In: Hecker S, Haklay M, Bowser A, Makuch Z, Vogel J, A. B (eds) Citizen Science: Innovation in Open Science, Society and Policy. UCL Press, London, pp 1–23
Rotman D, et al (2012) ‘Dynamic changes in motivation in collaborative citizen-science projects’, Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work - CSCW ‘12, p. 217. doi: https://doi.org/10.1145/2145204.2145238
Ryan SF et al (2018) ‘The role of citizen science in addressing grand challenges in food and agriculture research. Proceedings of the Royal Society B: Biological Sciences 285:1–10. https://doi.org/10.1098/rspb.2018.1977
Schäfer T, Kieslinger B (2016) Supporting emerging forms of citizen science: A plea for diversity, creativity and social innovation. J Sci Commun 15(2):1–12. https://doi.org/10.22323/2.15020402
Schot J, Geels FW (2008) Strategic niche management and sustainable innovation journeys : theory , findings , research agenda , and policy. Tech Anal Strat Manag 20:37–41. https://doi.org/10.1080/09537320802292651
Schut M et al (2016) Innovation platforms: experiences with their institutional embedding in agricultural research for development. Exp Agric 52(04):537–561. https://doi.org/10.1017/S001447971500023X
Scoones I, Thompson J, Chambers R (2008) Farmer first revisited. In: Scoones I, Thompson J, Chambers R (eds) Farmer First Revisited: Innovation for Agricultural Research and Development, pp 1–22 Available at: http://www.future-agricultures.org/farmerfirst/files/Farmer_First_Revisited_Post_Workshop_Summary_Final.pdf
Sharma N et al (2019) From citizen science to citizen action: Analysing the potential for a digital platform to cultivate attachments to nature. J Sci Commun 18(1). https://doi.org/10.22323/2.18010207
Shirk J et al (2012) Public participation in scientific research: a framework for intentional design. Ecol Soc 17(2):29. https://doi.org/10.5751/ES-04705-170229
Skarlatidou A, Ponti M et al (2019a) User experience of digital technologies in citizen science. J Sci Commun:1689–1699. https://doi.org/10.1017/CBO9781107415324.004
Skarlatidou A, Hamilton A et al (2019b) What do volunteers want from citizen science technologies? A systematic literature review and best practice guidelines. J Sci Commun 18(1):1–23. https://doi.org/10.22323/2.18010202
Solli PE, Wilson Rowe E, Yennie Lindgren W (2013) Coming into the cold: Asia’s Arctic interests. Polar Geogr 36(4):253–270. https://doi.org/10.1080/1088937X.2013.825345
Spielman DJ, Kennedy A (2016) Towards better metrics and policymaking for seed system development: insights from Asia’s seed industry. Agric Syst 147:111–122. https://doi.org/10.1016/j.agsy.2016.05.015
Spiers H et al (2019) Everyone counts? Design considerations in online citizen science. J Sci Commun 18(1):1–32. https://doi.org/10.22323/2.18010204
Sturm U, Tscholl M (2019) The role of digital user feedback in a user-centred development process in citizen science. J Sci Commun 18(1):1–19. https://doi.org/10.22323/2.18010203
Sullivan BL et al (2014) The eBird enterprise: an integrated approach to development and application of citizen science. Biol Conserv 169:31–40. https://doi.org/10.1016/j.biocon.2013.11.003
Sumberg J, Okali C (1997) Farmers’ experiments: creating local knowledge. Lynne Rienner Publishers, Boulder, Colorado, USA
Sumberg J, Okali C, Reece D (2003) Agricultural research in the face of diversity, local knowledge and the participation imperative: theoretical considerations. Agric Syst 76(2):739–753. https://doi.org/10.1016/S0308-521X(02)00153-1
Sumberg J et al (2013) From agricultural research to “product development”: what role for user feedback and feedback loops? Outlook on Agriculture 42(4):233–242. https://doi.org/10.5367/oa.2013.0144
Ton G et al (2014) Empowering smallholder farmers in markets: strengthening the advocacy capacities of national farmer organisations through collaborative research. Food Security 6(2):261–273. https://doi.org/10.1007/s12571-014-0339-3
Trimble M, de Araujo LG, Seixas CS (2014) One party does not tango! Fishers’ non-participation as a barrier to co-management in Paraty, Brazil. Ocean Coast Manag 92:9–18. https://doi.org/10.1016/j.ocecoaman.2014.02.004
Trumbull DJ et al (2000) Thinking scientifically during participation in a citizen-science project. Sci Educ 84(2):265–275. https://doi.org/10.1002/(SICI)1098-237X(200003)84:2<265::AID-SCE7>3.0.CO;2-5
Unell J, Castle R (2012) ‘Developing sustainable volunteering within the natural connections demonstration project: a review of evidence’, Natural England Commissioned Report NECR096, (July), p. 36. Available at: http://publications.naturalengland.org.uk/publication/1988713
van de Fliert E, Braun AR (2002) Conceptualizing integrative , farmer participatory research for sustainable agriculture : From opportunities to impact. Agric Hum Values 19:25–38. https://doi.org/10.1023/a:1015081030682
van Etten J et al (2019) Crop variety management for climate adaptation supported by citizen science. Proc Natl Acad Sci U S A 116(10). https://doi.org/10.1073/pnas.1813720116
van Ingen E, Wilson J (2017) I volunteer, therefore I am? Factors affecting volunteer role identity. Nonprofit Volunt Sect Q 46(1):29–46. https://doi.org/10.1177/0899764016659765
Van Mele P (2006) Zooming-in zooming-out: a novel method to scale up local innovations and sustainable technologies. Int J Agric Sustain 4(2):131–142. https://doi.org/10.1080/14735903.2006.9684796
Vines J et al. (2012) ‘Participation and HCI: Why Involve People in Design?’, Proc. of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems Extended Abstracts - CHI EA ‘12, (May), pp. 1217–1220. https://doi.org/10.1145/2212776.2212427
Vines J, Clarke R, Wright P (2013) Configuring participation: on how we involve people in design. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems 20(1):429–438. https://doi.org/10.1016/S0142-694X(98)00026-X
Waddington H et al (2014) Farmer field schools for improving farming practices and farmer. A Systematic Review, Campbell Systematic Reviews, Outcomes. https://doi.org/10.4073/CSR.2014.6
Waters-Bayer A et al (2007) PROLINNOVA: building partnerships to promote local innovation processes. Farmer Participatory Research and Development Twenty Years on, Farmer First Revisited, pp 12–14 Available at: http://www.future-agricultures.org/farmerfirst/files/T3b_WatersBayer.pdf
Waters-Bayer A et al (2015) Exploring the impact of farmer-led research supported by civil society organisations. Agriculture & Food Security 4:1–7. https://doi.org/10.1186/s40066-015-0023-7
West S, Pateman R (2016) Recruiting and retaining Participants in citizen science: what can be learned from the volunteering literature? Citizen Science: Theory and Practice 1(2):1–10. https://doi.org/10.5334/cstp.8
White, S. C. (1996) ‘Depoliticising development: the uses and abuses of participation’, Dev Pract, 6(1), pp. 6–15.
Wiggins A, Crowston K (2011) ‘From conservation to crowd sourcing: a typology of citizen science’, 44th Hawaii International Conference on System Sciences, pp. 1–10
Woolley JP et al (2016) Citizen science or scientific citizenship? Disentangling the uses of public engagement rhetoric in national research initiatives. BMC Medical Ethics 17(1):1–17. https://doi.org/10.1186/s12910-016-0117-1
Funding
This study was funded by the McKnight Foundation (grant number 37511) and supported by the Digital Creativity Labs funded by EPSRC/AHRC/Innovate UK (EP/M023265/1). This research was undertaken as part of, and funded by, the CGIAR Research Program on Roots, Tubers and Bananas (RTB) and supported by the CGIAR Trust Fund contributors (https://www.cgiar.org/funders/).
Author information
Authors and Affiliations
Contributions
Conceptualization, J.v.d.G. and J.v.E.; Methodology, J.v.d.G. and J.v.E. Investigation, J.v.d.G.; Writing –Original Draft, J.v.d.G. and J.v.E..; Writing J.v.d.G., J.v.E. and S.D.; Funding Acquisition, J.v.E. and J.v.d.G.; Resources, S.D.; Supervision, J.v.E. and S.D.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
This article is published under an open access license. Please check the 'Copyright Information' section either on this page or in the PDF for details of this license and what re-use is permitted. If your intended use exceeds what is permitted by the license or if you are unable to locate the licence and re-use information, please contact the Rights and Permissions team.
About this article
Cite this article
van de Gevel, J., van Etten, J. & Deterding, S. Citizen science breathes new life into participatory agricultural research. A review. Agron. Sustain. Dev. 40, 35 (2020). https://doi.org/10.1007/s13593-020-00636-1
Accepted:
Published:
DOI: https://doi.org/10.1007/s13593-020-00636-1