Integrating team science into interdisciplinary graduate education: an exploration of the SESYNC Graduate Pursuit

Complex socio-environmental challenges require interdisciplinary, team-based research capacity. Graduate students are fundamental to building such capacity, yet formal opportunities for graduate students to develop these capacities and skills are uncommon. This paper presents an assessment of the Graduate Pursuit (GP) program, a formal interdisciplinary team science graduate research and training program administered by the National Socio-Environmental Synthesis Center (SESYNC). Quantitative and qualitative assessment of the program’s first cohort revealed that participants became significantly more comfortable with interdisciplinary research and team science approaches, increased their capacity to work across disciplines, and were enabled to produce tangible research outcomes. Qualitative analysis of four themes—(1) discipline, specialization, and shared purpose, (2) interpersonal skills and personality, (3) communication and teamwork, and (4) perceived costs and benefits—encompass participants’ positive and negative experiences and support findings from past assessments. The findings also identify challenges and benefits related to individual personality traits and team personality orientation, the importance of perceiving a sense of autonomy and independence, and the benefit of graduate training programs independent of the university and graduate program environment.


Introduction
Contemporary socio-environmental (S-E) challenges like climate change, biodiversity loss, water management, and renewable energy are multifactorial and cannot be appropriately conceptualized, defined, or examined from a single scientific disciplinary perspective. They demand the application of interdisciplinary research (IDR) and team science (TS) approaches to capitalize on diverse perspectives and knowledge domains (Palmer et al. 2016; Table 1). Several factors contribute to this demand for IDR and TS: (a) the inherent complexity and dynamism of socio-environmental interactions, (b) disciplinary perspectives that are too narrow to thoroughly address the complexity of real-world issues and questions, (c) the urgency of S-E challenges, and (d) the availability of facilitating technologies (National Research Council [NRC] 2005). Such factors also reflect an imperative to develop and evaluate organized training and research programs. Organized and structured programs can generate the IDR and TS capacity necessary to create and sustain a S-E research community capable of addressing challenges now and in the future (Clark et al. 2011). While the need for IDR and TS remains salient, the novelty of organized IDR and TS training programs requires evaluation of experiences, practices, and curriculum to assess quality and effectiveness. The imperative to evaluate IDR and TS training efficacy is particularly salient for those programs designed for graduate students, as participants are positioned to assume leadership in academic and conservation institutions in the future (Meyer et al. 2015). Here, we present a post-program assessment of a project-based TS graduate training program, separate from participants' universitybased graduate program, whose objective is to develop TS and IDR capacity: the Graduate Pursuit (GP) program administered by the National Socio-Environmental Synthesis Center (SESYNC).
To sustain a community of research and practice with the ethos and skills to produce and apply high-quality S-E science requires that graduate students acquire IDR and TS skills. Graduate students in S-E fields require opportunities to develop team-based research and collaborative problem solving skills, interpersonal and relational skills, and the skills to learn and integrate concepts from others' disciplines (Bosque-Pérez et al. 2016;Cannon et al. 1996;Graesser et al. 2018). Such opportunities facilitate the development of skills and experiences that transfer to professional practice but are uncommon in formal graduate curricula (Blickley et al. 2013;Colón-Rivera et al. 2013;Hampton et al. 2017;Tress et al. 2007). Some universitybased graduate programs provide these opportunities, and associated assessments of them are available (Graybill et al. 2006;Read and Garcia 2015). However, limitations in infrastructure, expertise, and funding constrain the prevalence and scope of university-based programs to foster and support interdisciplinary, team-based S-E research. Moreover, university-based programs tend to be developed within the existing graduate program structures, which The study of co-dependent human and natural systems, i.e., linked social and biophysical systems that mutually influence one another, including their structure, dynamics, and sustainability. Understanding these systems often involves synthesis research that is relevant across multiple spatial, temporal, and cultural contexts.

Synthesis research
Research approach that uses various sources of knowledge and expertise to accelerate knowledge production, define new approaches or directions, and integrate ideas, theories, and/or data.

Interdisciplinary research (IDR)
An interactive process that integrates knowledge from multiple scientific disciplines and non-scientific sectors to jointly address research questions/problems and synthesize knowledge. Here, we do not distinguish interdisciplinary from transdisciplinary, which some view as a higher-order process and others use to refer to the practice of including knowledge-users or stakeholders as participants in the research process. Team science (TS) Cross-disciplinary and/or cross-sector research initiatives formed by various collaborators and partners (often long-term). TS initiatives leverage the strengths and expertise of partners trained and experienced in different fields to co-develop, co-define, co-produce, and co-implement research questions that pertain to a common or overlapping subject matter with the intent to integrate knowledge. position the needs and desired outcomes of the program in competition with the IDR and TS needs of the broader S-E field. In comparison with university-based programs, the GP features a unique setting and programmatic design that would be expected to generate different benefits and challenges. Identifying these benefits and challenges and placing them within IDR and TS literature directs the purpose of this assessment and its contribution to the S-E field.
Our assessment asks what strengths, weaknesses, challenges, and benefits did GP participants experience and how do these compare with previous assessments of graduate training programs? To answer this question, we use qualitative (open-ended) and quantitative (close-ended) measures to assess participants experiences, beliefs, opinions, and perceptions related to the GP. Qualitative measures and content analysis are used to explore emergent theme-related experiences with the program, their team, and their project, as well as their perceptions of IDR/TS training and skills development. Quantitative measures are used to assess beliefs about team success, integration, and comfort with IDR and TS and to examine personality traits and their relationship to success and integration, which are linked to IDR progress and outcomes (Bennett et al. 2018;National Research Council 2015). We discuss findings relative to the previous assessments of interdisciplinary graduate training programs (e.g., Golde and Gallagher 1999;Graybill et al. 2006;Meyer et al. 2015). While our assessment is exploratory, it represents an essential step towards assessing participant experiences with and perceptions of TS/IDR training and demonstrating the GP's impact on TS/IDR capacity-building. Such information is valuable to advance conversations about interdisciplinary graduate training program effectiveness, particularly as calls for IDR/TS skills and experience in the S-E field grows. Our research questions and findings are also relevant and valuable to educators and program directors who design S-E graduate curricula, as well as graduate students and early-career researchers in the S-E field currently engaging or seeking to engage in IDR and TS.

Challenges and benefits of interdisciplinary research and team science
The increased frequency of interdisciplinary, team-based research in S-E fields and, importantly, assessments of them continually improve our understanding of the hallmarks, challenges, barriers, and conditions that facilitate effective IDR and TS (Edelenbos et al. 2017;NRC 2005;Palmer et al. 2016). The NRC identified seven parallel hallmarks of and challenges to effective IDR and TS initiatives: (1) member diversity, (2) knowledge integration, (3) team size, (4) goal alignment, (5) boundary permeability, (6) geographic dispersion, and (7) task interdependence (NRC 2015). Key elements to overcome these challenges include organized research frameworks (structures) and practices that facilitate collaborative interaction (processes) (Lindenfeld et al. 2012;McGreavy et al. 2013McGreavy et al. , 2015Wallen 2017). Awareness and application of these hallmarks and challenges are key factors that influence the success of IDR/TS initiatives and should therefore be considered and incorporated into those initiatives, yet that consideration is uncommon. Moreover, purposeful and accountable assessment of these and other factors as components of IDR and TS initiatives is a relatively recent phenomenon (Jacobs and Frickel 2009).
Past assessments show that various hallmarks and challenges listed above contribute to IDR/TS success and failure, which can be defined as the development of basic and applied research outcomes and/or increased capacity of researchers to function in IDR/TS settings. For instance, teams comprised of members with diverse disciplines, experiences, career stages, and socio-demographics are often more successful than others Nancarrow et al. 2013). As caveats, team member diversity should be weighed and balanced with the ability to develop a shared purpose, agree on similar goals or incentives, and integrate knowledge from diverse domains of expertise. Regarding knowledge integration, others emphasize the importance of processes that link individual learning to research outcomes via joint problem formulation, participatory learning, and use of shared conceptual models (Heemskerk et al. 2003;Pennington 2016). Assessments also reveal interpersonal and communication skills, and the research processes that facilitate their development, contribute to positively to outcomes and experiences (McGreavey et al. 2013(McGreavey et al. , 2015. Communication competencies and patterns also influence how knowledge is mutually understood, codeveloped, and synthesized, which can afford or constrain inclusivity, teamwork, and progress towards shared goals Thompson 2009). Others emphasize the importance of managing interpersonal relationships and interacting personalities within teams (Bennett et al. 2018;LePine et al. 2011;Molleman 2005;Peeters et al. 2006). In practice, however, such elements and skills are often not recognized as prerequisites, and the skills to engage in or cope with them must be developed. Collectively, past assessments emphasize attention to developing and facilitating research processes that expand researchers' skills to manage individual and shared goals, interpersonal interactions, and two-way communications.
Graduate students face similar challenges with established researchers and practitioners who engage in IDR and TS. These include the following: (a) team selection and diversity (Morse et al. 2007;Newswander and Borrego 2009), (b) problem formulation and knowledge integration (Tress et al. 2009), (c) communication and interpersonal skills development (Read et al. 2016;Record et al. 2016;Tress et al. 2007), and (d) cost-benefit balance (Read and Garcia 2015).
Graduate students also face unique challenges (Demharter et al. 2017;Rhoten and Parker 2004). These relate to their status as students and the structure of graduate programs, which prioritize disciplinary-focused research activities (Tress et al. 2009). Other scholars identify challenges related to (a) a lack of exposure to and engagement with students of other disciplines or (b) an appropriate supervision, mentoring, and pedagogical approach (Bosque-Pérez et al. 2016;Record et al. 2016). Consequently, graduate students who engage in S-E research are often challenged to balance the disciplinary depth required by their graduate program while simultaneously broadening their interdisciplinary breadth to address complex S-E issues. Though myriad challenges exist, graduate students are well-positioned to receive substantial and enduring benefits from IDR and TS experiences as they are at a formative stage of their career (Graybill et al. 2006;Moslemi et al. 2009). Moreover, IDR and TS supplement traditional graduate training by facilitating active collaborations, professional interactions, and essential skills development. As such, providing opportunities to address S-E issues via IDR and TS approaches while simultaneously lessening challenges and enabling skills development is imperative.
Assessments of interdisciplinary graduate training in a university setting suggest various best practices to lessen challenges and enable skills development. At a program-level these include the following: (a) developing a core curriculum or competencies, (b) clarifying expectations for both depth and breadth, (c) providing mentoring and mentor training, (d) ensuring (in)formal, theoretical, and experiential educational opportunities, and (e) clear communication of expectations (Meyer et al. 2015). At the individual-level, activities that facilitate the development of IDR/TS capacity include (a) facilitating interactions with external graduate faculty and students, (b) joining projects that are related to ones' dissertation subject, (c) identifying the practical relevance of a project, and (d) establishing a sense of project ownership (Tress et al. 2009;Graybill et al. 2006;Ryser et al. 2009). Numerous programs and trainings have been developed, implemented, and evaluated within existing graduate program or university structures to offer and facilitate IDR and TS. Examples of these include the National Science Foundation's (NSF) Integrative Graduate Education and Research Traineeship (IGERT), Research Traineeship (NRT) programs and derivatives such as the Applied Biodiversity Science (ABS) program (Landon et al. 2015) and the Employing Model-Based Reasoning in Socio-Environmental Synthesis (EMBeRS) workshop (Killion et al. 2018). However, few initiatives have attempted to meet IDR and TS capacity-building needs via programs independent of a university setting. In this context, the learning environment, constraints and affordances, and expectations may be distinct and manifest differently. Moreover, existing outside the university, such programs better reflect what is required and expected of S-E professionals, and to our knowledge, no assessment of such an IDR/TS graduate training program has been conducted.

SESYNC Graduate Pursuit
The National Socio-Environmental Synthesis Center (SESYNC) was established in 2011 through a US National Science Foundation award to the University of Maryland (Palmer et al. 2016). SESYNC operates as a boundary organization (Guston 2001). Its mission is Bto foster synthetic, actionable science related to the structure, functioning, and sustainability of socio-environmental systems,^which is achieved through several programs (workshops, training, postdoctoral fellowships). Their core program, Pursuits, facilitate the creation of S-E research teams via an in-kind support (Baron et al. 2017;Biancani et al. 2018). That is, unlike a traditional research grant, Pursuits support teams with logistic support funds-travel, accommodations, meeting facilities, collaboration space, and computational support and cyberinfrastructure-and staff that provide technical consulting and professional facilitation; Pursuits do not fund primary data collection that requires offsite fieldwork, surveys, or assessments.
The goal of a Pursuit is the creation of a highly interdisciplinary team, with members in and out of academia, which codevelops and undertakes research to synthesize diverse data and knowledge and results in findings or products that are applicable or actionable across multiple scales and sectors, with the potential to inform decision-makers. Teams range from 10 to 25 members and are supported for a duration of 18-24 months. SESYNC designed and implements a framework with several reflexive and iterative practices to foster interdisciplinary skills training and research progress over the life of a Pursuit (Fig. 1). The recursive nature of the framework allows teams to iteratively implement, practice, learn, and reexamine various stages and elements of a project (e.g., project planning, meeting agenda setting, communication strategies, or database management). While ultimately a linear process from research proposal to research product(s), the framework allows teams and individuals to revisit many aspects of the research process to increase a team's potential for success and an individual's capacity to succeed within the IDR/TS setting.
In 2014, SESYNC used this framework to initiate the Graduate Pursuit program (https://www.sesync.org/for-you/ educator/programs/graduate-programs), an experiential, IDR/ TS training program that engages doctoral students in the same manner as Pursuits. Several aspects reflect what would be required and expected of any other grant application process, i.e., developing a competitive proposal and forming a team reflective of accomplishing the proposed research. To those ends, the GP requires self-formation of teams (5-7 members) with diverse backgrounds and disciplines to propose, conduct, and disseminate S-E research in a TS setting. The central and distinguishing feature of the GP, in comparison with other graduate training programs, is that students independently form and lead teams and projects as principal investigators from proposal to publication. The GP is designed as a long-term (12-18 months) training program, independent of students' graduate program, wherein doctoral students conduct research while simultaneously developing and using skills necessary to navigate and excel in a TS setting. The program comprises a series of multi-day team meetings at SESYNC, long-term and structured engagement with staff, tailored cyberinfrastructure and computational support, and leadership training in the management and organization of teams for designated team leaders (two per team). The present study represents an exploratory effort to assess the GP's outcomes via a survey of its first cohort.

Methods
Study participants (n = 39) comprised six teams who began their program in January 2015. All respondents were a doctoral student or candidate at the start of the GP. Geographically, most GP participants attended universities in the USA: Northeast (6), South Atlantic region (7), South (3), Midwest (5), Mountain West (3), and West (6). Globally, universities from Australia (1), Canada (6), Germany (1), and the UK (1) were represented. The first cohort's program formally ended in April 2016. In August 2016, an online, anonymous questionnaire of closed-and open-ended questions was sent to the cohort via Qualtrics online survey platform (KEW, KFD, JBP, and SMP were cohort members and developed the questionnaire but did not respond; all other authors were cohort members and did respond). The study was approved by the Texas A&M University Institutional Review Board (IRB2016-0466) and informed consent was obtained prior to participation.
The questionnaire assessed participants' experiences with the program, team, and project (Online Resource 1). Questions were developed using past assessments and key themes from the literature to explore participants' experiences and perceptions of success, integration, challenges, benefits, training, and skills development Nancarrow et al. 2013;Record et al. 2016). Success was measured as Bhow would you rate your team's overall success?^; integration as Bhow would you rate the level of integration (between disciplines) your team achieved?^; pre-and postparticipation comfort with IDR and TS as Bhow would rate your comfort level working in a team on an interdisciplinary project?^; and intention to continue IDR and TS as Bwill you pursue interdisciplinary collaborations and/or team science research during the next stage of your career?^. All closeended questions were measured using a 5-point Likert scale. In addition to these close-ended questions, we administered the Ten-Item Personality Inventory (TIPI) (Gosling et al. 2003) to assess variation among participants and profile teams across five personality dimensions. These dimensions are as follows: extraversion (outgoingreserved), neuroticism (calm-anxious), agreeableness (sympathetic-critical), conscientiousness (dependable-disorganized), and openness to experience (open-conventional) (McCrae and Costa Jr 2010). We also compare integration and self-reported success across teams' TIPI profiles. Personality items were measured on a 7-point Likert scale (strongly disagree-strongly agree).
To measure participants' experiences with the GP, we asked, as an open-ended prompt: Bwhat do you consider the lowlight(s) or negative takeaway(s) from your Graduate Pursuit experience?^and Bwhat do you consider the highlight(s) or positive takeaway(s) of your Graduate Pursuit experience?^. Challenges and barriers were measured with an open-ended prompt, Bwhat challenges did your team face during the Graduate Pursuit?^; Bhow did your team overcome these challenges?^; Bdid you perceive any barriers or challenges while participating in the Graduate Pursuit?^; Bhow did you overcome these challenges?^. Success was also measured with an openended prompt: Bwhat factors were most important to your team's success?^and Bwhat was missing but would have been helpful or facilitated team success?^. Other openended prompts that inform our assessment were as follows: Bhow has the Graduate Pursuit differed from other interdisciplinary experiences or projects you have been part of?^; Bwhat opportunities did participating in the Graduate Pursuit facilitate?^; Bbased on your experiences, what do you think are important principles for interdisciplinary research opportunities for graduate students and early career researchers?; and Bwhat skills/knowledge gained from your experience will you take forward to new projects or do you think are transferable to the next step(s) of your career?Ŝ tandard descriptive statistics and mean comparison were used to analyze and summarize quantitative items in R (v.3.2.1). Qualitative data were coded for emergent themes using content analysis and analyzed using NVivo qualitative data analysis software (Krippendorff 2004). Two researchers independently read and coded qualitative data and compared their coding processes to minimize bias in accordance with standard research practices (Patton 2002). Open-and close-ended measures allowed us to triangulate across different forms of data to infer how participants viewed and experienced the GP. As such, we integrate our presentation of these data in a combined results and discussion section.

Results and discussion
In total, 26 individuals of the eligible 35 responded, with at least 3 respondents per team (74% response rate). Selfidentified demographics and disciplines of respondents are provided in Table 2. The following subsections reflect four emergent themes derived from content analysis, and we present an integration of qualitative and quantitative within these: (1) integration, disciplinary specialization, and shared purpose; (2) communication and teamwork; (3) personality, interpersonal skills, and conflict management; and (4) perceived costs and benefits.
Integration, disciplinary specialization, and shared purpose For some GP team members, it was challenging to balance disciplinary concepts and methods and find common ground (Table 3). Despite this initial challenge, teams identified specific mechanisms and conditions that aided this necessary objective for effective cross-disciplinary research. For example, a team overcame disciplinary jargon by employing an overarching framework as a Bboundary object^to better define disciplinary language and facilitate discussions (S1). Interestingly, the use of boundary objects or concepts is becoming a more common aspect of IDR and TS, but references to its use in graduate contexts is limited (McGreavy et al. 2013;Mattor et al. 2014;Pittman et al. 2016). For another team, shared knowledge of the system being investigated helped establish common ground (S2). Other teams used more traditional methods like delegating disciplinary specific work to subgroups or sub-projects (S3, S4), but not all viewed this as positive (S5).
Others identified lack of methodological integration or expertise as a significant challenge (Table 3, S6). For some teams, this manifested as research activities becoming specialized due to member's methodological or computational expertise (e.g., coding, programming) (S7). This challenge is also identified by past assessments (e.g., Ryser et al. 2009;Pennington 2016). Participants also viewed meaningful integration of concepts and data as a challenge, but the underlying reasons varied (Table 3, S8, S9). For some, the challenge was related to differences in theoretical perspectives while others attributed this challenge to the use of different methods or analytical frameworks.
Despite these challenges, respondents reported increased comfort with IDR and TS from pre-to postparticipation (pre M = 3.62, SD = 1.02; post M = 4.73, SD = 0.45; t(25) = 5.51, p < .001, d = 1.41). For instance, participants stated: BI think I'm much more open minded and able to see limitations of disciplinary thought much more easily^(S10a); Bworking across disciplines exposes some of the siloed thinking that goes on within each of our own fields^(S10b). This suggests the research structures and process implemented by the GP were by and

Boundary objects
BThere were moments where we had to work through discipline-specific jargon. We addressed this through patience with each other and the socio-ecological system framework. The SESF served as a boundary object and an exercise in selecting and defining the variables of interest helped to work through the differences.^S1 BOur shared knowledge of the system was so key to smooth interaction. One person might do qualitative interviews, and the other spatial ecology, but given that everyone knew the social and ecological elements in a robust, but general way, we could communicate the purpose of analyses, statistical tests, policy implications etc.^S2

Subgroups
BThe subgroup structure within our group was such that you were working in different groups for different parts of the project. This ensured that ideas were flowing better all members of the group, and we were kept up-to-date instead of breaking into small groups that did not get to talk very often.^S3 BIdentifying key sub projects and structuring them to ensure engagement of all members, and synthesis across sub projects. It really seemed to be about building the right framework through leadership, and then using a more hands-off approach.^S4 BI rated the team somewhat unintegrated because we are still basically functioning as two separate groups.^S5

Conceptual and methodological integration
BOne of our case studies mixes qualitative analysis of media history with quantitative analysis of agricultural response to drought. Both techniques yield interesting results, but not necessarily results that make sense to intertwine into one story.^S6 BInterestingly one of the biggest challenges I found was that some of our team members were very efficient in R while others were not. This gave some members a certain degree of authority over the questions being asked, because they were the only ones analyzing the data. Sometimes we would spend whole meetings with some people trying to explain how the data was being operationalized in R (example: how they were assigning different people to different groups). This sometimes made it difficult for people to propose theories, because they were not 100% clear on how certain variables were being produced.^S7 BOur team took quite a bit of time to figure out the best way to link our individual disciplines and skill sets. I would say our level of integration would be very high going forward, if we were to continue with the project for another term.^S8 BSome members held on to their disciplinary ideas, and the context surrounding these ideas very strongly, making creative integration a challenge sometimes.^S9 Expanded epistemology BI think I am much more open minded and able to see limitations of disciplinary thought much more easily.^S10a BWorking across disciplines exposes some of the siloed thinking that goes on within each of our own fields.^S10b large successful at facilitating teams' ability to find common ground or meaningful points of integration. Increases in disciplinary and methodological specialization will continue to create challenges for integrating and developing shared purpose in IDR and TS (National Research Council 2005;Lindenfeld et al. 2012). Yet, successful collaboration relies on finding common ground and meaningful integration. Figure 2 demonstrates this tenet as, in general, teams self-reporting high team integration report high team success. This is further demonstrated by a significant positive correlation observed between team success and integration (r = 0.58, p < 0.01).
Integration of diverse and specialized knowledge for a shared purpose is fundamental to IDR and TS (Stokols et al. 2008). As such, interdisciplinary doctoral training must develop frameworks that support collaborative activities and disciplinary interaction to increase capacity for integrating concepts and methods and learning from other disciplines (Frodeman et al. 2017). Ultimately, building awareness of other scientific perspectives to create a shared purpose better enables students to participate in future interdisciplinary team research projects . Graduate students also identified issues pertaining to methods, analytical frameworks, and data analyses as barriers to integration and shared purpose. Team members with certain skills were perceived as excluding others from participating in analyses and decision-making (S7, S9). The manifestation of this issue in graduate teams is interesting considering sophisticated statistical analyses and big-data approaches are becoming more common in cross-disciplinary synthesis . The implications of this perceived barrier and related issues, such as interactions between theorybased methods and data-driven analyses, is an important issue to address for the future of S-E science.

Communication and teamwork
Participants described the not only the important role of communication, but also the tension between managing communication and project momentum and workflow (Table 4). Respondents indicated several themes that facilitated effective communication: listening, respecting and incorporating diverse viewpoints, learning from other team members, and informal socialization. These contributed to a shared understanding of research activities, team goals, and individual responsibilities. Effective communication helped build clearly defined roles, trust, and effective working relationships among team members. Subsequently, this enabled teams to work through challenges and coordinate, collaboratively and iteratively, towards the completion of project tasks. In-person meetings were referenced as crucial elements of facilitating communication, social integration, and teamwork, which aligns with SESYNC's broader framework for collaboration (S17-S19). Teams that focused on continual and scheduled types of communication (either in-person or web-based) identified these regular interactions as fundamental to their success. Respondents acknowledged the value of these firsthand exchanges and the importance of them in developing communication skills, adjusting communication strategies and managing project momentum (S20, S21).
Communication is a central part to any team effort Thompson 2009). Effective communication enables information exchange and development of relationships among team members but is rarely the focus of graduate education and training (Read et al. 2016). While several past assessments note the importance of communication, others situate communication as the central and focal element of interdisciplinary research and practice (Lindenfeld et al. 2012;McGreavy et al. 2013). Our assessment reinforces the paramount importance of communication  Stokols et al. 2008). Interdisciplinary doctoral training programs can meet this need by providing explicit communication training and support for teams. Communication is highlighted in many proposed doctoral training best practices and teamwork principles (Nancarrow et al. 2013).
Our results were similar to other assessments, which suggest that the settings, structures, and processes that support and facilitate effective communication can be as, if not more, important to the success of projects as expertise, technical skills, organization, or leadership (Bennett et al. 2018). As with most TS projects, GP team leaders served as the nexus for communication and teamwork and the GP program BBeing able to meet in-person was crucial. The support provided by SESYNC during meetings made a big difference; having logistics taken care of allowed us to get the most out of meeting time by focusing on the work and getting to know each other in a relaxed atmosphere. The face time with SESYNC staff was also a big part of that support.^S17 BLong face-to-face meetings allowed us to move past the 'frustration' stage and into the 'fine, we are frustrated, but we [should] try to figure out a solution' stage^S18 BWe struggled with our paper topics/formats at the beginning but after lots of sitting in a room together and talking things out, we found a focus that worked for us^S19 Momentum BIt was sometime difficult for us to keep our momentum going post-meetings when we got overwhelmed with our own work, but we tried to keep bi-weekly or monthly meetings to keep us on track.^S20 BOther challenges were keeping momentum; we tried to remedy this via more frequent Skype meetings and having a 'lead' on each paper who kept people moving.^S21 Meeting design and project workflow BI think structured and planned group discussion, quite-moment for people to reflect, and small group discussions are all very useful, especially when the discussion seems to come to an end.^S22 BIt was longer [previous program was much shorter, 2 weeks in person followed by a few months of follow-up], which allowed us to do higher quality work and deeper thinking about learning take-homes.^S23

Informal socialization
BDrinks and dinner together are very good way to bond us, and this bond is the key for us to work together eventually^S24 BWe were all on the same page with regard to working hard during the day and enjoying a beverage together in the evenings. In other words, the informal social times in the evenings were [really] important. But a key piece to that is that all of us enjoyed it!^S25 director met with team leaders before and after each on-site team meeting to discuss communication and teamwork challenges and potential strategies to move the project forward. These conversations were intended to heighten awareness of potential communication gaps and to develop plans to improve teamwork, if needed. The structure and process of these scheduled and regular meetings ensured that the team leaders would continuously communicate with SESYNC and discuss among themselves the status of the project and team dynamics. SESYNC also provided team leaders with feedback on meeting agendas to ensure the effective use of time, that meeting objectives were clearly articulated, and the meeting structure and activities were designed to achieve project objectives. From our assessment, data suggest that the support offered to team leaders by SESYNC transferred to the teams, as many of the principles and activities present are mentioned by respondents. For example, respondents stated, B...it is important that these goals and expectations are discussed regularly^(S12), Bwe had regularly scheduled deadlines and phone calls and I think what has made the group successful is the open and good communication and understanding.^(S14), Bsupport provided by SESYNC during meetings made a big difference; having logistics taken care of allowed us to get the most out of meeting time by focusing on the work and getting to know each other in a relaxed atmosphere.^(S17), and Bstructured and planned group discussion...are [all] very useful.^(S22). Collectively, our findings provide evidence that strategies like those offered by SESYNC and developed by GP teams, which facilitate or focus on interpersonal communication and communication tools and techniques and create a supportive communication environment, contribute to successful IDR and TS.

Personality, interpersonal skills, and conflict management
Interpersonal dynamics related to personality are a common and ubiquitous challenge of IDR and TS (Bennett et al. 2018;Molleman 2005). In general, team members who perceived others as having positive personality traits cited this as a strength and a reason for a success. For example, openness was often referenced as contributing positively to team progress and success: Bopenness and interest by all team members to work across boundaries( S26), Ball of us were very open to hearing each other's ideas and willing to learn from and about other disciplines( S28), and BAny challenges our team faced we overcame by being completely open and honest^(S29). This theme was also reflected in teams' ability to manage conflict (S32-S35).
Results from the TIPI corroborate these findings as moderate to high ratings of extraversion Fig. 3 Radial plot distribution of mean self-reported personality trait score per team for all personality traits. All plots scaled 1 (disagree strongly) to 7 (agree strongly). Colors correspond to each team and are consistent throughout. Teams 3, 5, and 6 self-reported high ratings of team integration and success, whereas teams 1 and 4 self-reported the lowest of both measures. Team 2 self-reported high success but moderate to low integration (see Fig. 2) SD = 1.30), and openness (M = 4.77, SD = 0.76) were reported across participants and within teams (Fig. 3). Openness was significantly correlated with extraversion (r = 0.48) and conscientiousness (r = 0.46), which are further evidenced in the qualitative data as contributing to a team's ability to manage and overcome challenges (Table 5, S26-S31). Teams with members sharing similar personality traits rated the overall success of their project higher compared with teams with more disparate personality traits (Figs. 2 and 3). For example, team 1 ranked lowest in terms of integration and success (Fig. 2) and contained the most diverse personality traits (round shape versus star shaped in Fig. 3).
In terms of personality traits, assessments of later-career collaborations find that team performance, conflict resolution, and decision-making are affected by dominant personalities, egocentrism, and associated power dynamics (National Research Council 2015; Mattor et al. 2014). However, GP participants did not mention these negative factors. For example, two respondents noted, Bwe didn't end up having any abrasive personalities and everybody pulled their weight^( S27) and Black of ego and willingness to cooperate were extremely helpful in making our team successful^(S28). That is, in general, teams reported amiable interactions and positive progress towards conflict resolution. The contrast between later-career and GP experiences is an important finding. At the graduate stage, overt power dynamics and egoism seem to be less of an issue or challenge. It is possible to infer that by providing training and experience with IDR/TS at the graduate career stage, positive team dynamics, relationship building, and conflict resolution skills could be ingrained and persist to later-career collaborations. That is, by training graduate students at a formative time in their career, it is possible that, apart from enabling IDR/TS capacity-building, programs like the SESYNC GP limit the potential for negative dimensions of personality traits to stagnate or impair collaborative S-E research.

Perceived costs and benefits
Respondents viewed the benefit/cost ratio of GP participation favorably. When asked if they would pursue future

Openness and conscientiousness
BOpenness and interest by all team members to work across boundaries and to be respectful/ acknowledge different types of research^S26 BAlso, generally being a good-natured team of overachievers. I am sure most teams are like this, but we did not end up having any abrasive personalities and everybody pulled their weight -we do not have to nag or wait up for anyone.^S27 BAll of us were very open to hearing each other's ideas and willing to learn from and about other disciplines. I think the lack of ego and willingness to cooperate were extremely helpful in making our team successful.^S28 BAny challenges our team faced we overcame by being completely open and honest.
I have never been on any team before where everyone was so upfront about their abilities and shortcomings.^S29 BAttitudes. We have a very friendly and fun group. We were all respectful of each other's ideas and time.^S30 BGood personalities on the team who became friends.^S31

Task conflict
BWe do not have to nag or wait up for anyone; all of us were very open to hearing each other's ideas and willing to learn from and about other disciplines. I think the lack of ego and willingness to cooperate was extremely helpful in making our team successful.^S32 BWe often got stuck rehashing the same point over and over. I think this was largely because one or two team members were hesitant to move forward for various reasons. This often kept us at a standstill. We worked through it by giving those team members the space to air their concerns and offer alternative paths forward. Even if the team disagreed, the concerned team member usually felt comfortable moving forward since they had a chance to be heard. Occasionally things came to a head and we had to push forward even without their support, but this at times strained relationships^S33 BOur team faced the challenge determining the most interesting direction of the research and bringing everyone on the table, we spent a lot of time to bring everyone on the same page so that our conversation made sense to all of us.^S34 BKeeping the big picture in mind helped with the former and learning about the methods and developing trust helped with the latter.^S35 interdisciplinary research based on their experience with the GP, most respondents indicated they were very likely to do so (M = 4.71, SD = 0.72; 1, very unlikely, 5, very likely). We interpret this as respondents' perceiving that the costs of interdisciplinary research are justified given the benefits received or that will be received. The most common perceived cost was the amount of work and time required for the project while having other graduate program demands (reported by 38% of respondents). Content analysis revealed two other primary costs (or barriers): disconnect from dissertation research and strained relationship with graduate advisor (Table 6). Importantly, respondents perceived these costs as interrelated (S36).
In terms of past assessments, these costs are unique to the graduate student experience (Morse et al. 2007;Read and Garcia 2015). Content analysis further revealed three primary benefits associated with the GP experience: developing relationships with other early-career researchers, being exposed to and gaining appreciation for different disciplines, and increased confidence and comfort moving across and integrating with disciplines. Participants also referenced benefits such as networking (S40), expanded epistemology (S41), and increased exposure to other disciplines (S42). These results help to explain the increased comfort with interdisciplinary research that participants expressed from pre-to post-GP.
Surprisingly, respondents did not commonly mention research outcomes (conference presentation, publications, job talks, technical reports, etc.) as a benefit of the GP, although teams developed several tangible research outcomes (Online Resource 2) (Keck et al. 2017). Often, the success of academic research is gauged by production of peer-reviewed manuscripts, with IDR/TS groups tending to produce fewer publications initially but more in the long- Time management BI had a hard time managing my time. I spent a considerable amount of time on this project but was not able to use any of it towards my degree requirements. I was able to overcome them because my advisor was understanding and required less of me to graduate.^S44 BIt was very time-intensive, more so than I really had the resources for as a graduate student^S45 BThis was a lot of freaking work in addition to my dissertation^S46 term ). Respondents may not have recognized the potential of their project to yield scholarly publications, were not yet focused on these outcomes, or simply felt they were secondary or resulting from more primary benefits offered by IDR/TS. Nevertheless, each team reported various research outcomes stemming from their GP project, which aligns with SESYNC's goal of facilitating successful collaborations and research outcomes ( Table 7).
Many of the costs and benefits reported here align with those identified by other assessments, which also describe benefits associated with training, salary, satisfaction, publications, knowledge for policy, and future funding potential . Potential costs include losses of credit and academic freedom, lower publication impact, and time. As with our results, time was the major cost identified, with networking or relationships with other early-career researchers cited as a major benefit. GP respondents, being graduate students, identified additional costs, such as the disconnect from dissertation research and advisor-advisee relationship, and benefits associated with increased confidence, comfort, and appreciation for IDR/TS. These added costs and benefits enrich our previous understanding of the graduate experience with IDR/TS and provide additional considerations for the design of doctoral training programs. They also provide relevant information for early-career researchers who are interested in engaging with IDR/TS research.

Conclusion
Our assessment and identification of four emergent themes highlights areas that current and future training and research programs can use to focus IDR and TS skills development, research efficacy, and collaborative experiences.
Reported benefits of the GP include independently conducting research (without faculty supervision), developing interpersonal skills applicable to collaborative settings, networking with other early-career researchers, and exposure to and comfort with IDR/TS. Findings reiterate the need for, and benefits of, developing effective interpersonal communication skills and communication strategies, which should be viewed as foundational components of IDR/TS success (Bennett et al. 2018). While respondents reported being open to different ideas and perspectives, a main challenge identified was difficulty integrating divergent methods or analytical techniques, which was coupled with time management challenges and balancing other graduate responsibilities Morse et al. 2007).
The autonomy and relatively unsupervised research environment of the GP provided a Blearn-by-doing^approach that facilitated participants' ability to actively propose, develop, lead, and complete an interdisciplinary S-E project within a TS setting (Roy et al. 2013). Broadly, our assessment observed that learn-by-doing conditions can be important facilitators of successful graduate training. Development of learnby-doing frameworks may be an essential expansion and evolution of interdisciplinary graduate training programs (Biancani et al. 2018). This conclusion reflects the practical, independent, long-term, and iterative research framework enacted by SESYNC (Fig. 1). Uniquely, the model of independent IDR used by the GP provides students with a safe environment to take risks, where failure is not detrimental to their graduate degree. The length of the GP (12-18 months) reflected the nature of most interdisciplinary research collaborations that respondents will encounter throughout their research careers. We are aware of no other graduate training program that has explicitly developed a setting and expectations that mimic conditions encountered beyond  Team 1  Team 2  Team 3  Team 4  Team 5  Team 6 Peer-reviewed manuscript Accepted -2 2 3 2 1 In-review -----1 In-preparation 1 1 1 --2 C o n f e r e n c e p r e s e n t a t i o n 2 6 2 1 2 3 Stakeholder presentation -1 ---1 Policy brief/technical report graduate school. This approach may serve as a new template for future training programs, which tangentially addresses a recommended best practice of developing a student's sense of ownership of a research project (Graybill et al. 2006;Roy et al. 2013). Moreover, GP projects required ongoing interaction with team members, allowing respondents to put their skills to the test in real time. Such an environment and timeframe, in turn, facilitated iterative learning of technical skills (computational, analytical), soft skills (communication, teamwork), and project management. At the individual level, our findings stress the importance of developing these skillsets to foster effective research, positive interactions, and beneficial experiences (Blickley et al. 2013;Cannon et al. 1996). While developing relevant computational and analytical skills has become a focal aspect of graduate program curricula, equally important are teamwork facilitation, project management, and interpersonal skills training Meyer et al. 2015). These and other soft skills-e.g., interpersonal communication, listening, and Bplaying well with others^-are critical but often under-nourished elements of training for graduate students and early-career scientists. Students often learn these skills ad hoc and through trial-and-error. In not developing these skills, graduate programs and advisors may be putting students at a disadvantage as they transition into the S-E profession as independent researchers and practitioners (Carr et al. 2018).
Collectively, our findings suggest a need and opportunity for both program-level elements (long-term, independent, and iterative) and individual-level elements (technical, interpersonal, and management skills development) to become foundational components of interdisciplinary graduate training. While this is a challenge for conventional graduate programs, which focus on scientific and technical training, our findings suggest practical soft skills are crucial to expanding IDR and TS capacity. In this regard, training programs that are independent of a university may be more beneficial, particularly given their potential to mimic the expectations and responsibilities that students will likely encounter in future, postgraduate collaborations. Deliberately prioritizing soft skills training at the same level as technical and analytical skills will further accelerate and expand interdisciplinary capacity and the establishment of a diverse research community capable of addressing the complexity of contemporary S-E issues.