Abstract
Sustainability competencies enable planners, the public, local communities, academics, and development practitioners to address environmental challenges, better envision the future and devise practical solutions. A key competency in this framework is Systems Thinking, allowing individuals to think comprehensively at different temporal and spatial scales. Among all interested groups, local and Indigenous communities play a significant role in preserving the sustainability of the natural environment and co-producing knowledge based on traditional ecological knowledge. Hence, new approaches are needed to integrate traditional ecological values into competency-based practices to articulate problems and related solutions. This project introduces place-based scenarios rooted in conventional forest management concerning two identified subsets of Bloom’s Taxonomy, Remembering and Understanding, including some competencies necessary for thinking systemically. Overall, 57 participants, including students and staff of the College of Menominee Nation and Menominee community members, in northeast Wisconsin, USA, randomly experienced two visual tools with the same information presented as either: a website with simple 2D images or a 3D virtual tour to investigate which visualization method can help better articulate systems, their components, and behaviors. Participants answered two kinds of questionnaires based on either cognitive mapping or reflection on place-based scenarios. The results show that 3D virtual tour users better demonstrated proficiency in Remembering and Understanding compared to users who experienced the 2D website. Our results thus highlight the potential for 3D virtual experiences to enable sustainability competencies. However, given the observed differences among age and educational groups, future visualization tools and associated research methods should attend to audiences’ competencies, preferences, and comfort, especially among older age groups.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
Forest management faces multiple challenges centered around long-time sustainability issues, such as forest degradation, decreasing natural resiliency, and divergent or conflicting stakeholder objectives (Lundmark et al. 2021; Mederski et al. 2021; Tang et al. 2023; Walters et al. 2021). Along with advancements in science and technology to improve forest management and better communicate these conflicts, transdisciplinary approaches, which involve stakeholder communities from the first stages of planning to the decision-making process, are increasingly recognized as essential for ensuring solutions are sustainable (Huang et al. 2021; Kask et al. 2018; Krätzig et al. 2021; Azadani 2022; Nasr-Azadani 2022; Nasr-Azadani et al. 2022, 2023). Co-designing management solutions with stakeholders allows for integrating multiple forms of knowledge and values (Jo and Nabatchi 2021; Talley et al. 2016; Wutich et al. 2020). However, despite the importance of sustainable forest management generally, scant attention has been paid to sustainable forest management within the context of tribal knowledge and local communities’ values (Dockry and Langston 2019; Gobster et al. 2021).
A stakeholder is considered any individual or group affected by, or who can potentially affect, the aims and outcomes of a project or decision and can range from the general public and communities to scientists, experts, and decision-makers (Freeman and McVea 2005; Jo and Nabatchi 2021; Nasr-Azadani 2022; Raum et al. 2021). Among all interested parties, local communities and Indigenous people play a significant role in preserving the natural environment, moving towards more sustainable ecosystems, and co-producing knowledge for sustainability planning based on traditional ecological knowledge (Mohd Salim et al. 2023; O'Donoghue et al. 2019; Whyte 2013b). As a result, the inclusion of Indigenous communities in forest conservation and management planning has attracted a rising level of interest from forest managers, academics, and tribal communities as a central part of sustainability efforts (Degai and Petrov 2021; Dockry 2020). For thousands of years, Indigenous communities stewarded landscape before colonization, and their economies, and resources have been supported by forest ecosystems. In the U.S. alone, about 18 million acres of forested land are under the management of 302 Indigenous tribes (Dockry 2012). Moreover, the most challenging social, economic, and ecological concerns faced by natural resource management appear to find solutions in tribal forestry (Dockry 2020; Lawler and Bullock 2017). There are numerous examples of employing Indigenous forest management practices and sustainable management techniques—including harvesting, prescribed fire, and precommercial treatments—to balance multifaceted goals for community well-being and economic development and build resilience to unexpected environmental ruptures (Aryal et al. 2023; Chukwuone et al. 2020; Dockry and Hoagland 2017; Fernandes et al. 2022; Hessburg et al. 2021; Lawler and Bullock 2017).
Perspectives of sustainable forestry differ significantly between Indigenous tribes and Western perspectives. Sustainability science is framed by multiple concepts, including social and environmental systems, integrative and multidisciplinary analyses, and practical applications connecting knowledge to action (Arora-Jonsson 2023; Dockry et al. 2016; Maison 2023). Indigenous knowledge strongly affirms and emphasizes these human and environmental connections and works toward maintaining this link (Krätzig et al. 2021; Virtanen et al. 2015). Moreover, accountability, morality, common law, ownership, and sovereignty are core principles ingrained in Indigenous cultures and languages, offering countless lessons on behaviors and innovations that extend past a Western scientific worldview and that have an inter-generational component. Therefore, Indigenous sustainable development places greater emphasis on equitable and responsible management of shared resources, sustainable Indigenous governance, resilient livelihoods, Indigenous rights, sustainable knowledge systems, and concern for future generations. Indigenous and sustainability sciences can both, separately and collectively, help to identify strategies to maintain resilient and sustainable systems (Johnson et al. 2016; Nasr-Azadani 2022; Nasr-Azadani et al. 2022, 2023). However, one fundamental problem is that the knowledge generated around Indigenous conceptualizations, theories, and epistemologies of sustainability is rarely fully involved in formulating existing sustainable development goals and metrics in the entire scientific community (Bwambale 2023; Degai and Petrov 2021; McGregor 2004). And in turn, although many Indigenous people seek meaningful and culturally suitable methods to comprehend, measure, educate, and practice sustainable development and natural resource management (Corntassel 2008; McGregor 2004; Weaver 2023; Whyte 2013a), the overall lack of Indigenous cultural values, concerns, worldviews, or teachings in mainstream sustainability science poses a challenge for many Indigenous communities.
Accordingly, to reintroduce Indigenous knowledge in sustainability learning and practice, we explored the development of sustainability competencies within the Menominee Nation with a focus on the dimensions of sustainability formalized through their Sustainable Development Institute. The Menominee people have managed natural resources in the area now known as northeast Wisconsin for thousands of years, notwithstanding the impact of colonization and federal attempts to terminate their sovereign status. Figure 1 shows the location of present-day Menominee Nation Reservation and representative landscapes used in this study. The Menominee had overseen sustainable timber supply since 1856 when they began what is widely considered the first sustainable forest operation in the U.S. (Dockry et al. 2016; Kern et al. 2017). Rooted in this long-term experience with land stewardship, both prior to and following colonization, the Sustainable Development Institute (SDI) at the College of Menominee Nation (CMN) articulates a holistic model of sustainable development based on the Menominee experience in the middle of the 1990s (Dockry et al. 2016). The SDI model was created to support dynamic interactions among systems components that were neglected in existing sustainability models. According to Dockry et al. (2016), the model "conceptualizes sustainable development as the process of maintaining the balance and reconciling the inherent tensions among six dimensions of sustainability: (1) land and sovereignty; (2) natural environment; (3) institutions; (4) technology; (5) economics; and (6) human perception, activity, and behavior" (p. 127). Menominee autochthony is a core cultural value and final concept of the model, occupying the center of the hexagon to represent a connection to the land that binds the other six dimensions together.
Our study focused on the tension between two sustainability dimensions technology (number 4), and human perception, activity, and behavior (number 6). Specifically, we investigated whether virtual technology enhances or impedes the incorporation of cultural beliefs and knowledge, values, experiences, perceptions, and attitudes about sustainable forest management practices and plans (Dockry et al. 2016). To do this, we assessed whether the use of virtual landscape visualization technologies and engagement with place-based forest management scenarios would enable a deeper exploration of Indigenous perceptions, activities, and behaviors toward sustainable forest management. These virtual experiences simulate an actual place and are typically made of a series of still images, 360-degree illustrations, or videos to create an immersive environment.
Landscape visualization and the technology dimension
Many studies have investigated the effectiveness of landscape visualization and shown that these techniques significantly improve the planning process by allowing for participants’ direct involvement (e.g., designing their neighborhoods with planners) (Al-Kodmany 1999; Azadani 2022; Stempel et al. 2023). These tools conquer barriers between experts and laypeople and provide a common language for all contributors with a wide range of interests, including various groups of stakeholders, residents, politicians, experts, managers, and planners (Al-Kodmany 1999; Schroth et al. 2011; Tyrväinen et al. 2006). In other words, visualizations let participants with less knowledge gain a better understanding of a plan and contribute to the discussion, have dialogue, and participate in planning (Warren-Kretzschmar and von Haaren 2014; Nasr-Azadani et al. 2023). They also support spatial awareness and help the public picture different aspects of the landscape (Al-Kodmany 1999; Warren-Kretzschmar and von Haaren 2014). The ability to illustrate alternative futures with varying levels of uncertainty, the possibility of asking "What if?" questions in the search for preferred or acceptable solutions, and observing the consequences of these changes and plans (Huang et al. 2021; Nasr-Azadani et al. 2022; Sheppard 2005) make visualization a unique approach to participatory landscape management. Facilitating conflict resolution and constructing consensus by revealing differences, misunderstandings, and potential agreements are other advantages of these methods (Schroth et al. 2011).
Sustainability competencies and the human perception, activity, and behavior dimension
Competencies are defined in various ways (Baartman et al. 2007) but can generally be considered as the cooperation of knowledge and perspectives with specialized skills. Importantly, competencies are seen to be skills that are achievable and can be developed through experience and effort (de Haan 2006; Lozano et al. 2022; Rieckmann 2012). As Barth et al. (2007) put it, "they are learnable, not teachable" (p. 4). Sustainability competency is defined as having knowledge, skills, and attitudes that enable individuals to take specific actions or behaviors toward the environment (Anderson 2015; Baartman et al. 2007; Barth et al. 2007; Brundiers et al. 2010; Cebrián and Junyent 2015; de Haan 2006; Demssie et al. 2019; Lambrechts et al. 2013; Wiek et al. 2011a, b; Willard et al. 2010). More specifically, Wiek and colleagues (2011a, p. 204) define sustainability competency as "complexes of knowledge, skills, and attitudes that enable successful task performance and problem-solving respecting real-world sustainability problems, challenges, and opportunities." Sustainability competencies have also been variously categorized (see Delphi et al.; Rieckman 2012). Wiek et al. (2011b) summarized competencies into five key skills: Systems Thinking, Anticipatory, Normative, Strategic, and Interpersonal competencies (Fig. 2). Gains in sustainability competencies can be seen as an ambitious knowledge and skill profile as a point of reference, which enables people to be better decision-makers, problem solvers, and game-changers (Wiek et al. 2011a, b). It follows, then, that those who have gained sustainability competencies can play a vital role in moving society toward sustainability through active participation that is reflective and cooperative to the point of balancing ecological, technological, and development objectives (Rieckmann 2012). Systems Thinking, as one of the leading sustainability competencies, is the capacity to think comprehensively; while you decide based on the current situation, you consider the future consequences of your actions. While you see one aspect of an issue, you can observe and discuss other possibilities in other elements (Nasr-Azadani 2020).
Research gap, objectives, and hypotheses
To achieve the objectives, multiple topics have been reviewed including the application of visualization in Indigenous studies, the application of visualization techniques in Systems Thinking, and the integration of Systems Thinking and Indigenous knowledge. This extensive review showed that not that many studies have comprehensively brought these topics together for collaborative sustainable forest management and practice. While sustainability competencies and Systems Thinking are recognized as important in addressing environmental challenges, there is a lack of research on how to integrate traditional ecological knowledge and values from local and Indigenous communities into these competencies. Therefore, this research addresses the need for identifying effective tools to enhance sustainability competencies, particularly the integration of traditional ecological values into competency-based practices. To fill this gap, this research introduces place-based scenarios rooted in conventional forest management and investigates the effectiveness of different visualization methods.
Here, we tested whether virtual interactive experiences can be used to enhance competency-based sustainability education and planning. In a previous review, Nasr-Azadani et al. (2023) found that landscape visualizations that are real, static, still, non-immersive, and 2D, such as realistic images and paintings, are compelling for participatory decision-making in forestry and sustainability studies. Here, we test whether more complex visualizations lead to similar or enhanced improvements in learning, as evidenced by the attainment of key sustainability competencies. We expected that through learning from an interactive 3D experience rooted in traditional values, combined with a soundtrack, participants could better identify a system, its components, and the relationship between these components (Objective 1) and better recognize and understand the system’s dynamics and circular nature, compared to 2D simple images and texts (Objective 2). We also expected that demographic attributes of the participants (age, gender, education, duration of being in the area, and familiarity with the place) would affect participants’ ability to better identify a system, its components, and the relationship between these components (Objective 3). Specifically, we hypothesized that older generations, people with higher education levels, and participants who have lived in the area longer and know the area very well would likely better recognize a system, its components, and the relationship between them, as well as the systems’ dynamic and circular nature.
Materials and methods
In this research, we tested landscape visualization through two sets of visualization interventions: (a) Real, Static, Still, Non-immersive, and 2D through a websiteFootnote 1 containing simple images, maps, and text (will be called the 2D website, hereafter), or (b) a 3D interactive web-based environments with the audio track that is Real, Dynamic, Interactive, Non-immersive, and 3D as the more complex toolFootnote 2 (will be called the 3D virtual tour, henceforth). The 2D website and 3D virtual tour had the same message content, and the 2D website was modeled on the explanatory sequence of the 3D virtual tour. The visual information shows how prescribed fire can be used as a forest management tool in various planning steps. Historically, fire – whether from lightning or Indigenous burning practices – created diverse open habitats called Pine Barrens. Pine Barrens are imperiled both globally and across Wisconsin and neighboring states. Wisconsin land managers recognize the importance of returning fire to the landscape to restore and connect fragments of this now-rare habitat (Steidle-Nix 2022; Steidle et al. 2023). We used conceptual mapping (Gray et al. 2019; Hopper 2007; Maani and Maharaj 2002; Smithwick et al. 2018) and scenario-based assessment tools (Arnold and Wade 2017; Assaraf and Orion 2005, 2010; Dorani et al. 2015; Grohs et al. 2018; Maani and Maharaj 2002) to evaluate Systems Thinking competency.
Study procedure
Participants included members of the Menominee community, including CMN students, staff, and their family members, as well as community members of Menominee Nation. Our audiences received the recruitment materials through the CMN email list and Menominee community Facebook page. A total number of 57 participants were included in the study. We randomly assigned each participant to be exposed to the same series of information using (a) a 2D website or (b) a 3D virtual tour. Following the intervention, participants were asked to respond to three sets of questions through QualtricsXM: (1) Personal information, including age, gender, educational level, familiarity with the area, and the duration of their presence in the area, before the intervention, (2) prompts to create cognitive maps, and (3) their insights on place-based scenarios (Appendix 1).
Cognitive mapping
After the intervention (either a 2D website or a 3D virtual tour), we asked each participant to create a cognitive map of prescribed fire and pine barren restoration. A cognitive map can be defined as any visual representation of a person’s (or a group’s) mental model for a given process or concept. Analyzing these mental maps allows us to understand how visualization has helped them recognize system components and the interconnection between these components. Comparisons among the groups’ average results would determine if more complex and interactive visualization techniques provide a more complex understanding of systems dynamics. Participants were asked to use provided pen and paper to create their cognitive map based on what they had seen and/or read in the intervention. We also offered them a list of words to provide examples of what we are looking for, e.g., Pine Barren/Forest/Thinning/Prescribed Fire/Habitat/Wildlife/Culture, etc. (Appendix 1). We asked participants to select a minimum of five words (either from the provided list or not) to draw all connections these components might have with other components, the directionality of the relationship (positive or negative), and to signify circular connections among multiple components if relevant. Participants were also asked to rank the size effect of the relationship (1–100).
Place-based scenarios
Place-based scenarios are inspired by the local community, environment, culture, history, and other resources as the starting point to express a context. Participants read three scenarios in this part and were asked to reflect on each in 2–5 written sentences. The objective was not to characterize their scientific knowledge but rather their general understanding of ideas within the paragraph. To develop such scenarios and articulate local contexts, we utilized several interviews with elders of the Menominee, conducted previously by Visualizing Forest Future (ViFF) project.Footnote 3 The interviews were about how natural and prescribed fire had been used in the community and the consequences of fire suppression. The three place-based scenarios rooted in Indigenous knowledge are provided in Table 1 (see also Appendix 1).
Making systems thinking measurable
To assess whether Systems Thinking can be improved through the use of visualization, we employed the cognitive hierarchy of Bloom’s Taxonomy (Pappas et al. 2013) (Fig. 3), which has been previously applied to guide and feed assessment techniques (Palmer and Devitt 2007; Pappas et al. 2013; Zaidi et al. 2018) and Systems Thinking skills (Zaidi et al. 2018). This taxonomy involves five cognitive domains to gain, retain, and engage new information: remembering, understanding, applying, analyzing, and creating (Stanny 2016). Specifically, remembering and understanding include competencies necessary for thinking systemically, i.e., identifying components of a system, recognizing the interconnection between these components, understanding the dynamic and circular nature of a system, etc. (Hopper 2007; Plate and Monroe 2014). We mapped sub-competencies of Systems Thinking to the Remembering and Understanding levels of Bloom’s Taxonomy, prioritizing nine distinct but connected thinking skills that flourish in systems thinkers (Table 2 and Fig. 3; Arnold and Wade 2017; Dorani et al. 2015; Evans 2019; Hopper 2007; Huang et al. 2020; López-Alcarria et al. 2019; Maani and Maharaj 2002; Plate and Monroe 2014; Redman et al. 2021; Richmond 1997). The first skill, Dynamic thinking, helps identify the issue. The following four skills, system-as-cause, forest/holistic, cause and effect, and stock and flow thinking, determine what aspects of the problem should be included and investigated in the solution. The other three—operational, closed-loop, and quantitative thinking—play essential roles in offering hypotheses and developing mental models regarding the consequences of the solution. The final skill, Scientific Thinking, helps examine the proposed approaches and models (Córdoba 2004; Peterson 2004; Richmond 1997).
Coding responses
To measure and analyze sustainability competencies related to Systems Thinking, we focused on the Remembering component of Bloom’s Taxonomy, which is built from Closed-Loop and Cause and Effect subgroups related to Systems Thinking. Specifically, we developed a rubric to weigh the cognitive maps and scenario responses based on three aspects: the number of components, the articulated relationship between components, and the circular nature of the components (Table 3). The overall Systems Thinking score is the sum of these elements. We coded each individual’s cognitive map by going through the written responses (Table 3) and coded scenario-based question responses using NVivo 1.6.1. (Table 4). To balance three elements of cognitive map coding, we normalized the number of components each individual mentioned to 10.
To analyze the scenario-based responses, we used coding to capture a higher level of Bloom’s taxonomy, Understanding, and the associated Systems Thinking sub-group components (holistic thinking, dynamic thinking, system as cause thinking, and stock and flow thinking, Table 4). Additionally, we included two additional categories of "Acknowledging Knowledge and Science" and the sufficiency of the response in general. The overall Systems Thinking score is the sum of holistic, dynamic, system as cause, stock and flow thinking, with acknowledging knowledge and science minus the sum of irrelevant and no response codes.
Statistical analysis
To compare whether an interactive 3D experience enhances Systems Thinking compared to simple images and texts and how Systems Thinking varies among participants based on visualization method, age, gender, level of education, being in the area, and familiarity with the area, we first used t tests and ANOVA to compare differences among groups. To more deeply explore the interacting drivers of overall Systems Thinking scores, we built decision trees using the partitioning regression model (predictive modelling > partition) (McClean 2003). JMP 16.2.0 was used for all statistical analyses. The research method has been summarized in Fig. 4.
Results
In all, 57 students, staff, and the Menominee community participated in our study; 52 finished the cognitive mapping section, and 50 finished scenario-based questions. Of the 57 original participants, 29 used the 3D virtual tours and spent an average of 46 min, and 28 visited the 2D website and spent an average of 34 min to gain information. 39 participants were female, 15 were male, and one was genderfluid. 54.5% of our participants had a college degree, 59.6% were between 30 and 50 years old, 38.5% were born in the area, and 70.9% were very familiar with the area (Table 5). The total number of words that 3D Tour participants typed in answer boxes was almost 4500, whereas 2D Website responders typed 3700.
Objective 1: Systems Thinking competencies through remembering (system components and relationships) through cognitive mapping
An example of a cognitive map created by one of the study participants is shown in Fig. 5a. The results showed that participants who used the 3D virtual tour in comparison with those who visited the 2D website scored higher (Fig. 5b t test p value: 0.08 < 0.1, 90% confidence level). This map displays many of the elements that were assessed across all maps, including the number of components picked, the circular and linear relation between these components, and, if any, how they affect each other.
a One example of cognitive mapping; created by one of the participants after experiencing the 3D virtual tour. The scores of this participant are as follows: number of components normalized by 10: 9.4/establishing relations: 9/recognizing circular nature of the system: 9. b The total score of cognitive mapping regarding the tools. 3D virtual tour users had a higher score for the number of systems components each individual mentioned compared to 2D website users (p value: 0.03 < 0.05). Also, the average of establishing relations is higher in 3D virtual experience users by 90% confidence (p value: 0.08 < 0.1)
Objective 2: Systems Thinking competencies through understanding (holistic, dynamics, system as cause thinking, and stock and flow thinking) through scenario-based questions
As shown in Fig. 6, the overall Systems Thinking score is significantly higher in 3D virtual tour users (11.7 vs. 7.1). Scores in the 3D virtual tour are significantly higher for holistic, dynamic, and acknowledging knowledge and science and higher but not significant for systems as cause thinking and stock and flow thinking.
The average score of Systems Thinking skills for participants of each visual tool. Virtual tour users had a higher average for dynamic thinking skill (p value: 0.02 < 0.05; 95% confidence), holistic thinking, acknowledging knowledge and science, and overall systems thinking (p value < 0.1; 90%) in scenario-based questions
Objective 3: demographic drivers of competency outcomes
The overall score through the 2D website and 3D virtual tour interventions showed that Systems Thinking competencies for Remembering system components and interactions varied significantly with age (F ratio: 5.0103, p value: 0.0019 < 0.05; Fig. 7a), decreasing with increasing age. Specifically, the average score is considerably higher for 18–21-year-olds than those aged 29 and above. Scores were higher for females than males, but this was not statistically significant. The average overall score is higher when participants are educated. Participants who are already in college or have a college degree or teach in the college (graduate level) have higher scores in all components (for overall score F ratio: 3.475, p value: 0.0233 < 0.05; Fig. 7b). People who came to the place a long time ago showed a higher average score. Many participants reported that they were born in the place, left, and then came back. People who went to the area a long time ago had a higher score than those who were born there (p value: 0.0007 < 0.05) and those who were raised there (P value: 0.02 < 0.05; Fig. 7c). Familiarity with the area did not show any effects on the score for components of closed-loop and cause and effect thinking.
Similarly, the overall score for Systems Thinking competencies through understanding (place-based scenarios) was significantly higher in participants 18–22 years old (F ratio: 3.6822, p value: 0.0108 < 0.05; Fig. 7d). This difference was also meaningful for all Systems Thinking skills, holistic (F ratio: 5.0888, p value: 0.001 < 0.05), dynamic (F ratio: 6.8624, p-value: 0.0002 < 0.05), system as cause (F ratio: 4.4962, p value: 0.0038 < 0.05) and stock and flow thinking skills (F ratio: 3.5905, p value: 0.0123 < 0.05). No specific pattern was detected in the average of Systems Thinking skills and overall Systems Thinking regarding gender (p value: 0.598 > 0.05). There was a significant difference between Systems Thinking skills scores and overall Systems Thinking regarding the level of education (Fig. 7e). This average was significantly higher for individuals with higher education levels (F ratio: 4.4514, p value: 0.0077 < 0.05). In many cases, the average Systems Thinking skills scores and overall Systems Thinking are higher when participants are already in college (college degree) or teaching in the college (graduate level). The highest third average mainly belongs to elders with No-formal education but a high amount of familiarity with the area. Those with no formal education have higher familiarity with the area and experience, which can justify their higher score. There was no pattern in the Systems Thinking skill score and overall Systems Thinking regarding how familiar participants are with the place or the duration of their presence in the area. The only specific significance was respecting the indigenous knowledge code; this is higher among people who are very or extremely familiar with the area (p value < 0.05).
Collectively, based on the decision tree partitioning analysis, participants who have been in the area for a long time or were raised in the area have a higher overall score if they are 18–39 years old (R2: 0.3). On the other hand, participants born in the area but who left and came back recently, and participants who came to the place recently have a higher score if they are younger than 60 with at least a college-level education. Similarly, the decision tree analysis shows that the average score for 5ynamic thinking skills is higher when participants have at least a college education. The younger these educated groups are, the more dynamic thinkers they are. Among those who are less educated, females have a higher level of dynamic thinking than males. In addition, in general, younger educated people think more systematically. Apparently, for less-educated groups, the 2D website experience better illustrates the context of Systems Thinking (Fig. 8).
Discussion
We examined the effect of visualization techniques to make Systems Thinking and learning more tangible compared to simple texts. The general results of this experiment illustrate the effectiveness of landscape visualization, especially virtual tour, to elucidate Systems Thinking skills that underpin critical sustainability competencies. In addition, we identified participant attributes that appear to support Systems Thinking related to place-based practices, such as having a long duration of residence in the area. Furthermore, this research showed that education and age could affect Systems Thinking skills and components. The younger participants are, and the higher their education level is, the more systematic their thoughts are or can be.
Previous studies have shown that visual data can affect higher analysis and evaluation (Ealy 2016; Eppler and Kernbach 2016; Lindquist et al. 2016; Lovett et al. 2015; Onitsuka et al. 2018; Polys et al. 2018). We extended this analysis to see if those types of visual data are effective in systematically analyzing issues regarding sustainability issues. Eppler and Kernbach (2016) have previously shown that 3D depictions will assist with thinking more holistically and making better-informed decisions. In the work of Wilkie and Clarke (2016), spatial visualization of patterns (landscape visualization) is also discussed as a potential trigger for improving functional thinking. This level of thought includes detecting relationships among multiple representations and generalizing non-linear relationships, which we categorized under identifying systems components and their relationships. Jones et al. (2011) claim that spatial visualization can improve an individual’s cognitive abilities for reasoning about environments at different scales. Gu and Deal (2018) also discussed a two-way relationship between geo-designs (land-use modeling) and Systems Thinking. Although these studies bolster our findings, none of them investigated thinking styles in the context of sustainability and natural resource participatory management, such as we offered in this research.
Regarding cognitive mapping results, since the 1970s, several pieces of literature have declared the effectiveness of visuals in developing people’s cognitive capacity and thinking. In 1980, Arnheim argued that the way we think is linked to our visual presentations. Meaning how we draw our thoughts through a cognitive map represents a summary of our logic and reasoning. These maps can also facilitate the participatory decision-making process by allowing participants to brainstorm and quickly communicate the concept (Kolkman et al. 2005). Öllinger et al. (2015) had a more complicated discussion on causal maps as a subgroup of concept mapping. They argued that theoretical arguments of concept maps’ mechanisms and effects are not profound yet. However, causal maps can still be practical in understanding the problems and better thinking for problem-solving and decision-making. They highly recommend that inexperienced users benefit from an experienced mentor while drawing their first maps to explain what they mean and what they want to show. This practical advice helped us collect higher-quality data since some participants strongly resisted drawing cognitive maps; instead, they preferred to write their thoughts because they were not confident enough to draw their ideas.
In regard to the 3D virtual tour results, as well as higher accuracy and discipline in designing their cognitive maps, can be indicators that virtual tour has been more engaging to audiences. Interactive dynamic 3D methods (like our study stimuli) can increase initial interest in planning and spatial issues—exploring the planning proposals with dynamic displays that continuously change and interactively tracking real-time alterations can be enlightening and informative and improve participants’ understanding of the issue (Ellis and Merdian 2015; Jones et al. 2011; Salter et al. 2009). Seeing how trees are growing or burning, how animals are moving through the landscape, and how water flows could help the viewer feel connected to the landscape, and the effects of the proposed plan on the landscape become more tangible (i.e., prescribed fire in this research). Also, the interactivity offers attractive possibilities for engagement, awareness building, and reaching the viewer’s emotions (Sheppard 2005), meanwhile providing an impactful platform for learning complex Systems Thinking contexts around sustainability (Smithwick et al. 2018). Another successful employment of interactive visualized methods in forest management can be found in the works of Cristal et al. (2019), Smith et al. (2012), which agree with our findings on the efficacy of these tools. Some of the participants’ comments on how the dynamic interactive video was an engaging and enjoyable experience while helpful in learning about sustainable forestry.
"This was a good tool. Very helpful and informative and thought-provoking…", "I like the virtual tour. It was very knowledgeable…", "…very interesting and interactive.", "Cool tour. I loved the feet when I was in the air and looked down. Lots of great information…" "… I really like the simulation….", "I learned many new things today…."
The growing utilization of games in all shapes, especially computer games, for addressing essential issues is emerging in many fields. The 3D virtual tour we engaged in this research was partly developed using a video game engine or video game designing software. In a recent paper, Bengston et al. (2018) used a game called IMPACT to help forestry professionals and stakeholders think more broadly, critically, and creatively about forest futures. This game was designed to enhance holistic perspectives on natural resource management and forestry to help players broaden their thinking about alternative plans in forest management. Like what we concluded here, this game enabled players to think systemically to affect forestry in the future. Whilst our results align with what they have concluded about the effects of gaming on improving Holistic and Dynamic thinking, there is a downside to gaming which we also experienced in our study. Some participants resist games and playful thinking, especially in communities with more traditional values, as well as in older generations (Bengston et al. 2018).
In addition to visualization techniques, two other factors influenced Systems Thinking in our study: Age and Level of Education. Our study showed that people who are already engaged in higher education, either students or professors and instructors in college, have a higher level of Systems Thinking. As previously mentioned, sustainability and competency-based studies have been traditionally focused on higher education (i.e., Huang et al. 2020; Lozano et al. 2022; Membrillo-Hernández et al. 2021; Moreno-Pino et al. 2021; Solís-Espallargas and Morón-Monge 2020; Žalėnienė and Pereira 2021). Also, in many cases, literature has shown no direct relationship between the level of education and practicing sustainability. The results of our study can be an indicator that sustainability competency-based education focuses on k-12 and higher education in recent years may have improved sustainability competencies among students and at this education level but may be less effective for the general populace. In general, further research is required for a more extended period to prove these assertions more strongly.
Concerning the effect of participants’ age, we generally saw that younger individuals demonstrated more systemic thinking. Although some literature has discussed that brain capability for analytical functioning declines with age (Peng et al. 2018), our results do not mean that elders do not think systemically; rather, it can be a direct result of elders’ difficulties in engaging our 3D visual tour. Anecdotal conversations with elders prior to and after the experience showed us how knowledgeable they were about the area. Also, Systems Thinking is embedded in the community’s culture and history, which has kept the forest biodiverse and productive for a long time (Bang et al. 2007; Dockry et al. 2016; Kern et al. 2017; Pecore 2017; Tribal et al. 2019). Ensuring visualization tools and research methods are designed across a diverse set of audiences’ competencies, preferences, and comfort is thus critically important. For instance, interviews, focus groups, and storytelling may be complementary methodologies that could be coupled with visualization tools to improve decision-making and manage future consequences of our decisions (Creed et al. 2021), embracing a fuller range of sustainability competencies because elders found it more challenging to engage with the technology.
Research limitations
This study may possess certain limitations. First, due to funding and COVID-19 limitations, our interaction with audiences was restricted to a single intervention, so longer-term perspectives may not have been fully captured. Future studies would benefit by having a repetitive intervention over more extended periods (Arneson and Offerhahl 2018). Also, since the study was situated within a particular cultural, social, or geographical context and focused on a specific community with limited sample size, the generalizability of the findings to other populations or regions might be restricted. Moreover, the coding and data analysis were based on the researchers’ own perspectives and biases. However, the research team attempted to reduce these biases by incorporating input from several individuals when coding and evaluating the credibility of the analysis. In addition, our research focused on specific virtual landscape visualization technologies, which only represent part of the spectrum of available tools. In our case, the visualization was found to be challenging to engage the elders in the community, and may even have been intimidating, perhaps due to unfamiliarity resulting from limited prior exposure to such tools. Additionally, cultural and generational differences could have created barriers to technology acceptance, as traditional knowledge and practices are deeply rooted in the Menominee way of life. In some instances, there might have been language barriers, leading to confusion and frustration, and future research should consider conducting the experiment in the Menominee language. While our research did not address all these limitations, our findings offer insight into new modes of engagement with 3D technologies that may deepen learning and engagement of sustainability across knowledge systems.
Nourishing decision-making by integration of Indigenous knowledge and Systems Thinking
The Menominee Nation possesses a wealth of ecological knowledge that has been passed down through generations, encompassing a deep understanding of the environment’s interconnections. Acknowledging the importance of Indigenous knowledge and its incorporation into decision-making processes, this research made an effort to introduce and develop approaches to capture this knowledge within a Systems Thinking framework. These approaches evolve fostering partnerships and collaborations that prioritize the inclusion of Indigenous voices in decision-making for land management, conservation, and sustainability. Also, through interdisciplinary collaborations, including ecology, anthropology, Indigenous studies, and systems science, as well as participatory approaches that value the engagement of community members and promote co-learning and co-creation of knowledge, Systems Thinking can create a more inclusive framework that respects the unique insights and perspectives of the Menominee Nation. Another approach that this research recommends is to value long-term observations and intergenerational learning, to provide a nuanced understanding of ecological systems’ dynamics. Our results indicate that inclusive participatory methodologies that address a broader range of systems perspectives can more fully describe the decision space. By effectively capturing and incorporating this ecological knowledge, Systems Thinking expands its scope and acknowledges the Menominee Nation’s values and priorities to eventually nourish decision-making processes.
This research implicitly declares recognition of ecological knowledge held by the Menominee Nation can be achieved through deepened engagement and collaboration between the Menominee Nation and relevant government agencies or organizations, allowing for a comprehensive understanding of ecological systems and the promotion of sustainable practices. Inclusive policies that recognize Indigenous rights foster participatory decision-making, invest in capacity-building and knowledge exchange, and integrate Indigenous knowledge and Systems Thinking into governance structures are recommended. These can include the development of culturally sensitive resource management strategies, ensuring inclusive and participatory processes, investing in capacity-building, encouraging collaborative research, promoting adaptive management, and allocating sufficient resources and funding. We posit that these can be advanced through visualization and similar methodologies that enable inclusive and reciprocal dialogue. In so doing, it is possible to involve Indigenous communities as holistic partners in the decision-making processes, respecting their self-determination and contributing to their empowerment and well-being. By supporting the transmission of traditional ecological knowledge, policies can preserve cultural heritage and contribute to the long-term sustainability of ecosystems.
Conclusion
In this research, we proposed a framework to measure Systems Thinking and its components using landscape visualization. This research also aimed to enhance decision-making opportunities for tribal communities by providing clear routes to recognizing and acknowledging their identity concerning the land and their local, traditional, and cultural values. The strength of our research is embedded within the integration of traditional knowledge about management strategies (i.e., low-intensity, prescribed fire) with sustainability competencies and decision-making capacity that exists in local communities and potential in Tribal Colleges and Universities students as the future leaders of sustainable planning. There are many examples of how sustainability is embedded in Indigenous Nations’ decision-making processes and land management, especially Menominee, with a long history in successful sustainable forestry and planning.
Engaging Indigenous knowledge, we designed visualizations to communicate local understanding and institutional values that affect human perception, activity, and behavior, to promote the quality of natural resources and environment in search of a better economy, healthier community, and a stronger connection with the land. Since there has been little research on sustainability education at Tribal Colleges and Universities (Dockry et al. 2016), this research indicates that showing visualization may be an entry point for deeper understanding and exploration of the sustainability model (Dockry 2020). Notably, it can create a platform for the CMN students and local communities to explore systems context and how different system elements are connected, and where educational models can help reinforce connections among dynamics that are not yet fully expressed or understood. Given the affinity of younger participants to engage more fully with the visualization experience, these and similar tools may be a way to enhance intergenerational learning about sustainability (Liu et al. 2020; Wang and Cosley 2014). Also, benefiting from this advantage, the six dimensions of the Menominee Theoretical Model of Sustainability, their interactions, and how they have co-evolved through time can better be presented. Seeing the dimensions more tangibly, younger generations and students will grasp that sustainability affects all facets of life, fostering a holistic, systematic perspective that enables them to integrate their values, cultures, and local and western knowledge on sustainability (Dockry et al. 2016), which can be considered as the final goal for sustainable development model and education.
Data availability
All material and data that support the findings of this study are available from the corresponding author, [ENA], upon request.
Notes
NSF Award: # 1617396/ CNH-L: Visualizing Forest Futures Under Climate Uncertainty: Integrating Indigenous Knowledge into Decision-Support Tools for Collaborative Decision Making. https://viff.psu.edu/.
References
Al-Kodmany K (1999) Using visualization techniques for enhancing public participation in planning and design: process, implementation, and evaluation. Landscape Urban Plann 45(1):37–45. https://doi.org/10.1016/S0169-2046(99)00024-9
Anderson EL (2015) Developing key sustainability competencies through real-world learning experiences. Evaluating community environmental services
Arneson JB, Offerhahl EG (2018) Arneson.pdf. CBE Life Sci Educ 17(1)
Arnold RD, Wade JP (2017) A complete set of systems thinking skills. INCOSE Int Symp 27(1):1355–1370. https://doi.org/10.1002/j.2334-5837.2017.00433.x
Arora-Jonsson S (2023) The sustainable development goals: a universalist promise for the future. Futures 146:103087. https://doi.org/10.1016/j.futures.2022.103087
Aryal K, Maraseni T, Apan A (2023) A call for ‘management authorship’ in community forestry. Environ Sci Policy 139:204–208. https://doi.org/10.1016/j.envsci.2022.10.023
Assaraf OBZ, Orion N (2005) Development of system thinking skills in the context of earth system education. J Res Sci Teach 42(5):518–560. https://doi.org/10.1002/tea.20061
Assaraf OBZ, Orion N (2010) System thinking skills at the elementary school level. J Res Sci Teach 47(5):540–563. https://doi.org/10.1002/tea.20351
Azadani EN (2022) Landscape visualization to improve sustainability competencies in participatory natural resource management (Order No. 30396327). Available from Dissertations & Theses @ Big Ten Academic Alliance; ProQuest Dissertations & Theses A&I; ProQuest Dissertations & Theses Global. (2812064785). https://ezaccess.libraries.psu.edu/login?url=https://www.proquest.com/dissertations-theses/landscape-visualization-improve-sustainability/docview/2812064785/se-2
Baartman LKJ, Bastiaens TJ, Kirschner PA, van der Vleuten CPM (2007) Evaluating assessment quality in competence-based education: a qualitative comparison of two frameworks. Educ Res Rev 2(2):114–129
Bang M, Medin DL, Atran S (2007) Cultural mosaics and mental models of nature. Proc Natl Acad Sci USA 104(35):13868–13874. https://doi.org/10.1073/pnas.0706627104
Barth M, Godemann J, Rieckmann M, Stoltenberg U (2007) Developing key competencies for sustainable development in higher education. Int J Sustain High Educ 8(4):416–430
Bengston DN, Dockry MJ, Shifley SR (2018) Anticipating cascading change in land use: exploring the implications of a major trend in US Northern forests. Land Use Policy 71(January 2017):222–229. https://doi.org/10.1016/j.landusepol.2017.11.046
Brundiers K, Wiek A, Redman CL (2010) Real-world learning opportunities in sustainability: from classroom into the real world. Int J Sustain High Educ 11(4):308–324
Bwambale B (2023) Integrating indigenous knowledge with science to suitably tackle disasters due to climate and environmental change: an overview of the progress and way forward. In: Multi-hazard vulnerability and resilience building. Elsevier, pp 127–143. https://doi.org/10.1016/B978-0-323-95682-6.00008-5
Cebrián G, Junyent M (2015) Competencies in education for sustainable development: exploring the student teachers’ views. Sustainability (switzerland) 7(3):2768–2786
Chukwuone NA, Adeosun KP, Chukwuone CA (2020) Socioeconomic factors affecting households’ use of indigenous forest management practices in managing non-wood forest products: evidence from forest communities in Nigeria derived savannah. Heliyon. https://doi.org/10.1016/j.heliyon.2020.e05281
Córdoba J (2004) Introduction to systems thinking: walking the ideas and rethinking the way, by Enrique Herrscher, prefaced by J. Gharajedaghi. Published by Granica Ediciones, Buenos Aires, Argentina, 2003, 270 pp., ISBN 950 641 386 X, $18.85 (£12.00 approx.) (in Spanish). In: Systems research and behavioral science, vol 21, issue 1. https://doi.org/10.1002/sres.580
Corntassel J (2008) Rethinking the contemporary indigenous-rights discourse. Altern Glob Local Polit 33:105–132
Creed A, Zutshi A, Connelly BL (2021) Leadership lessons in sustainability from elders and events in historical clan survival stories. In: Spee JC, McMurray A, McMillan M (eds) Clan and tribal perspectives on social, economic and environmental sustainability. Emerald Publishing Limited, pp 87–101. https://doi.org/10.1108/978-1-78973-365-520211010
Cristal I, Ameztegui A, González-Olabarria JR, Garcia-Gonzalo J (2019) A decision support tool for assessing the impact of climate change on multiple ecosystem services. Forests 10(5):1–20. https://doi.org/10.3390/f10050440
de Haan G (2006) The BLK ‘21’ programme in Germany: a ‘Gestaltungskompetenz’-based model for Education for Sustainable Development. Environ Educ Res 12(1):19–32
Degai TS, Petrov AN (2021) Rethinking arctic sustainable development agenda through indigenizing UN sustainable development goals. Int J Sust Dev World 28(6):518–523. https://doi.org/10.1080/13504509.2020.1868608
Demssie YN, Wesselink R, Biemans HJA, Mulder M (2019) Think outside the European box: identifying sustainability competencies for a base of the pyramid context. J Clean Prod 221:828–838. https://doi.org/10.1016/j.jclepro.2019.02.255
Dockry MJ (2012) Indigenous Forestry in the Americas: comparative environmental histories in Bolivia and Wisconsin. University Of Wisconsin-Madison.
Dockry MJ (2020) Indigenous rights and empowerment in natural resource management and decision making as a driver of change in US forestry. In: Dockry MJ, Bengston DN, Westphal, pp 76–83. https://www.fs.usda.gov/treesearch/pubs/61564
Dockry MJ, Hoagland SJ (2017) A special issue of the journal of forestry— tribal forest management: Innovations for sustainable forest management. J for 115(5):339–340. https://doi.org/10.5849/JOF-2017-040
Dockry MJ, Langston N (2019) Indigenous protest and the roots of sustainable forestry in Bolivia. Environ Hist 24(1):52–77. https://doi.org/10.1093/envhis/emy090
Dockry MJ, Hall K, Van Lopik W, Caldwell CM (2016) Sustainable development education, practice, and research: an indigenous model of sustainable development at the College of Menominee Nation, Keshena, WI, USA. Sustain Sci 11(1):127–138. https://doi.org/10.1007/s11625-015-0304-x
Dorani K, Mortazavi A, Dehdarian MA, Mahmoudi H, Khandan M Mashayekhi A (2015) Developing question sets to assess systems thinking skills. In: Proceedings of the 33rd international conference of the system dynamics society, assessment (Richmond 2000)
Ealy JB (2016) Visualization of kinetics: stimulating higher-order thinking via visualization. J Chem Educ 93(2):394–396. https://doi.org/10.1021/acs.jchemed.5b00215
Ellis DA, Merdian HL (2015) Thinking outside the box: developing dynamic data visualizations for psychology with Shiny. In: Frontiers in psychology, vol 6, issue DEC. https://doi.org/10.3389/fpsyg.2015.01782
Eppler MJ, Kernbach S (2016) Dynagrams: enhancing design thinking through dynamic diagrams. Des Stud 47:91–117. https://doi.org/10.1016/j.destud.2016.09.001
Evans TL (2019) Competencies and pedagogies for sustainability education: a roadmap for sustainability studies program development in colleges and universities. In: Sustainability (Switzerland), vol 11, issue 19. https://doi.org/10.3390/su11195526
Fernandes LM, Visscher AM, do Couto HTZ, Marcusso GM, Righi CA (2022) Indigenous agriculture at the beginning of the twenty-first century: the Guaraní Mbyás minority conserves ethnoknowledge and agrobiodiversity within the remnants of the Brazilian Atlantic Forest. Agrofor Syst 96(8):1211–1224. https://doi.org/10.1007/s10457-022-00780-5
Freeman REE, McVea J (2005) A stakeholder approach to strategic management. SSRN Electron J. https://doi.org/10.2139/ssrn.263511
Gobster PH, Schneider IE, Floress KM, Haines AL, Arnberger A, Dockry MJ, Benton C (2021) Understanding the key characteristics and challenges of pine barrens restoration: insights from a Delphi survey of forest land managers and researchers. Restor Ecol 29(1):1–12. https://doi.org/10.1111/rec.13273
Gray S, Sterling EJ, Aminpour P, Goralnik L, Singer A, Wei C, Akabas S, Jordan RC, Giabbanelli PJ, Hodbod J, Betley E, Norris P (2019) Assessing (social-ecological) systems thinking by evaluating cognitive maps. Sustainability (switzerland) 11(20):1–11. https://doi.org/10.3390/su11205753
Grohs JR, Kirk GR, Soledad MM, Knight DB (2018) Assessing systems thinking: a tool to measure complex reasoning through ill-structured problems. Think Skills Creativity 28(2017):110–130. https://doi.org/10.1016/j.tsc.2018.03.003
Gu Y, Deal B (2018) Coupling systems thinking and geodesign processes in land-use modelling, design, and planning. J Digit Landsc Archit 2018(3):51–59. https://doi.org/10.14627/537642006
Hessburg PF, Prichard SJ, Hagmann RK, Povak NA, Lake FK (2021) Wildfire and climate change adaptation of western North American forests: a case for intentional management. Ecol Appl. https://doi.org/10.1002/eap.2432
Hopper MA (2007) Proposing measures for assessing systems thinking interventions. University of Nevada, Las Vegas
Huang Z, Peng A, Yang T, Deng S, He Y (2020) A design-based learning approach for fostering sustainability competency in engineering education. Sustainability (switzerland). https://doi.org/10.3390/su12072958
Huang J, Lucash MS, Scheller RM, Klippel A (2021) Walking through the forests of the future: using data-driven virtual reality to visualize forests under climate change. Int J Geogr Inf Sci 35(6):1155–1178. https://doi.org/10.1080/13658816.2020.1830997
Jo S, Nabatchi T (2021) Different processes, different outcomes? Assessing the individual-level impacts of public participation. Public Adm Rev 81(1):137–151. https://doi.org/10.1111/puar.13272
Johnson JT, Howitt R, Cajete G, Berkes F, Louis RP, Kliskey A (2016) Weaving indigenous and sustainability sciences to diversify our methods. Sustain Sci 11(1):1–11. https://doi.org/10.1007/s11625-015-0349-x
Jones MG, Gardner G, Taylor AR, Wiebe E, Forrester J (2011) Conceptualizing magnification and scale: the roles of spatial visualization and logical thinking. Res Sci Educ 41(3):357–368. https://doi.org/10.1007/s11165-010-9169-2
Kask S, Kull T, Orru K (2018) The use of 3D visualization for sustainable tourism planning. J Baltic Stud 49(3):371–385. https://doi.org/10.1080/01629778.2018.1455719
Kern CC, Schoelch M, Crocker P, Fellman D, Marsh A, Mausel D, Pecore M, Phillippi J, Waukau R, Waupochick A (2017) Group opening outcomes, sustainable forest management, and the Menominee nation lands. J for 115(5):416–424. https://doi.org/10.5849/jof.2016-092
Kolkman MJ, Kok M, van der Veen A (2005) Mental model mapping as a new tool to analyse the use of information in decision-making in integrated water management. Phys Chem Earth 30(4–5 SPEC. ISS.):317–332. https://doi.org/10.1016/j.pce.2005.01.002
Krätzig S, Warren-Kretzschmar BBB, Kim AM, Hadar L, Orenstein DE, Carmel Y, Mulder J, Kirchhoff A, Perevolotsky A, Osem Y, Metze T, Chamberlain BC, Liu R, Canfield J, Hayek UW, Waltisberg D, Philipp N, Grêt-Regamey A, Bilge G, Käyhkö N (2021) Participatory mapping and visualization of local knowledge: an example from Eberbach. Germany. J Digit Landsc Archit 2020(4):1–16. https://doi.org/10.1007/s13753-020-00312-8
Lambrechts W, Mulà I, Ceulemans K, Molderez I, Gaeremynck V (2013) The integration of competences for sustainable development in higher education: an analysis of bachelor programs in management. J Clean Prod 48:65–73
Lawler JH, Bullock RCL (2017) A case for indigenous community forestry. J for 115(2):117–125. https://doi.org/10.5849/jof.16-038
Lindquist M, Lange E, Kang J (2016) From 3D landscape visualization to environmental simulation: the contribution of sound to the perception of virtual environments. Landsc Urban Plan 148:216–231. https://doi.org/10.1016/j.landurbplan.2015.12.017
Liu S, Guo D, Sun J, Yu J, Zhou D (2020) MapOnLearn: the use of maps in online learning systems for education sustainability. Sustainability (switzerland). https://doi.org/10.3390/su12177018
López-Alcarria A, Olivares-Vicente A, Poza-Vilches F (2019) A systematic review of the use of Agile methodologies in education to foster sustainability competencies. Sustainability (switzerland) 11(10):1–30. https://doi.org/10.3390/su11102915
Lovett A, Appleton K, Warren-Kretzschmar B, Von Haaren C (2015) Using 3D visualization methods in landscape planning: an evaluation of options and practical issues. Landsc Urban Plan 142:85–94. https://doi.org/10.1016/j.landurbplan.2015.02.021
Lozano R, Bautista-Puig N, Barreiro-Gen M (2022) Developing a sustainability competences paradigm in higher education or a white elephant? Sustain Dev. https://doi.org/10.1002/sd.2286
Lundmark R, Lundgren T, Olofsson E, Zhou W (2021) Meeting challenges in forestry: improving performance and competitiveness. Forests 12(2):1–20. https://doi.org/10.3390/f12020208
Maani KE, Maharaj V (2002) Links between systems thinking and complex problem solving—further evidence. In: Proceedings of the 20th international conference of the system dynamics society, pp 1–29. http://www.systemdynamics.org/conferences/2002/proceed/papers/Maani1.pdf
Maison LM (2023) Beyond Western and Indigenous perspectives on sustainability: politicizing sustainability with the Zapatista rebellious education. J Transform Educ 21(1):41–58. https://doi.org/10.1177/15413446221079595
McClean SI (2003) Data mining and knowledge discovery. In: Encyclopedia of physical science and technology, pp 229–246. https://doi.org/10.1016/B0-12-227410-5/00845-0
McGregor D (2004) Coming full circle: Indigenous knowledge, environment, and our future. Am Indian Q 28(3):385–410. https://doi.org/10.1353/aiq.2004.0101
Mederski PS, Borz SA, Đuka A, Lazdiņš A (2021) Challenges in forestry and forest engineering—case studies from four countries in East Europe. Croat J for Eng 42(1):117–134. https://doi.org/10.5552/crojfe.2021.838
Membrillo-Hernández J, Lara-Prieto V, Caratozzolo P (2021) Sustainability: a public policy, a concept, or a competence? Efforts on the implementation of sustainability as a transversal competence throughout higher education programs. Sustainability (switzerland). https://doi.org/10.3390/su132413989
Mohd Salim J, Anuar SN, Omar K, Tengku Mohamad TR, Sanusi NA (2023) The impacts of traditional ecological knowledge towards indigenous peoples: a systematic literature review. Sustainability (switzerland) 15(1):1–22. https://doi.org/10.3390/su15010824
Moreno-Pino FM, Jiménez-Fontana R, Domingo JMC, Goded PA (2021) Study of the presence of sustainability competencies in teacher training in mathematics education. Sustainability (switzerland). https://doi.org/10.3390/su13105629
Nasr-Azadani E (2020). Sustainability competencies. https://sites.psu.edu/ellienasr/2020/01/27/sustainability-competencies/
Nasr-Azadani E (2022) Landscape visualization to improve sustainability competencies in participatory natural resource management. Pennsylvania State University
Nasr-Azadani E, Wardrop D, Brooks R (2022) Is the rapid development of visualization techniques enhancing the quality of public participation in natural resource policy and management? A systematic review. Landsc Urban Plan 228(2021):104586. https://doi.org/10.1016/j.landurbplan.2022.104586
Nasr-Azadani E, Wardrop DH, Brooks RP (2023) Pathways for the utilization of visualization techniques in designing participatory natural resource policy and management. J Environ Manag 333(2022):117407. https://doi.org/10.1016/j.jenvman.2023.117407
O’Donoghue R, Sandoval-Rivera JCA, Payyappallimana U (2019) Landscape, memory and learning to change in changing worlds: contemplating intergenerational learning and traditional knowledge practices within social-ecological landscapes of change. South Afr J Environ Educ 35(1):1–34. https://doi.org/10.4314/sajee.v35i1.10
Öllinger M, Hammon S, von Grundherr M, Funke J (2015) Does visualization enhance complex problem solving? The effect of causal mapping on performance in the computer-based microworld Tailorshop. Educ Tech Res Dev 63(4):621–637. https://doi.org/10.1007/s11423-015-9393-6
Onitsuka K, Ninomiya K, Hoshino S (2018) Potential of 3D visualization for collaborative rural landscape planning with remote participants. Sustainability (switzerland). https://doi.org/10.3390/su10093059
Palmer EJ, Devitt PG (2007) Assessment of higher order cognitive skills in undergraduate education: modified essay or multiple choice questions? Research paper. BMC Med Educ 7:1–7. https://doi.org/10.1186/1472-6920-7-49
Pappas E, Pierrakos O, Nagel R (2013) Using Bloom’s taxonomy to teach sustainability in multiple contexts. J Clean Prod 48:54–64
Pecore M (2017) Menominee forestry: past, present, future. Forestry 90(September):109–124
Peng SL, Chen X, Li Y, Rodrigue KM, Park DC, Lu H (2018) Age-related changes in cerebrovascular reactivity and their relationship to cognition: A four-year longitudinal study. Neuroimage 174(November 2017):257–262. https://doi.org/10.1016/j.neuroimage.2018.03.033
Peterson S (2004) Applying system dynamics to public policy: the legacy of Barry Richmond. www.pegasuscom.com/lrnmore.html
Plate RR, Monroe M (2014) A structure for assessing systems thinking. Creative Learn Exchange 23(1):1–12
Polys N, Newcomb C, Schenk T, Skuzinski T, Dunay D (2018) The value of 3D models and immersive technology in planning urban density. In: Proceedings—Web3D 2018: 23rd international ACM conference on 3D web technology. https://doi.org/10.1145/3208806.3208824
Raum S, Rawlings-Sanaei F, Potter C (2021) A web content-based method of stakeholder analysis: the case of forestry in the context of natural resource management. J Environ Manag 300(2):113733. https://doi.org/10.1016/j.jenvman.2021.113733
Redman A, Wiek A, Barth M (2021) Current practice of assessing students’ sustainability competencies: a review of tools. Sustain Sci 16(1):117–135. https://doi.org/10.1007/s11625-020-00855-1
Richmond B (1997) The “thinking” in systems thinking: how can we make it easier to master? Syst Think 8(2):1–14
Rieckmann M (2012) Future-oriented higher education: Which key competencies should be fostered through university teaching and learning? Futures 44(2):127–135. https://doi.org/10.1016/j.futures.2011.09.005
Salter JD, Campbell C, Journeay M, Sheppard SRJ (2009) The digital workshop: exploring the use of interactive and immersive visualisation tools in participatory planning. J Environ Manage 90(6):2090–2101. https://doi.org/10.1016/j.jenvman.2007.08.023
Schroth O, Pond E, Campbell C, Cizek P, Bohus S, Sheppard SRJ (2011) Tool or toy? virtual globes in landscape planning. Future Internet 3(4):204–227. https://doi.org/10.3390/fi3040204
Sheppard SRJ (2005) Landscape visualisation and climate change: the potential for influencing perceptions and behaviour. Environ Sci Policy 8(6):637–654. https://doi.org/10.1016/j.envsci.2005.08.002
Smith EL, Bishop ID, Williams KJH, Ford RM (2012) Scenario chooser: an interactive approach to eliciting public landscape preferences. Landsc Urban Plan 106(3):230–243. https://doi.org/10.1016/j.landurbplan.2012.03.013
Smithwick E, Baxter E, Kim K, Edel-malizia S, Blackstock D, Smithwick E, Baxter E, Kim K, Edel-malizia S, Smithwick E, Baxter E, Kim K, Edel-malizia S, Rocco S, Blackstock D (2018) Interactive videos enhance learning about socio- ecological systems. J Geogr. https://doi.org/10.1080/00221341.2017.1374433
Solís-Espallargas C, Morón-Monge H (2020) How to improve sustainability competences of teacher training? Inquiring the prior knowledge on climate change in primary school students. Sustainability (switzerland) 12(16):1–18. https://doi.org/10.3390/su12166486
Stanny CJ (2016) Reevaluating Bloom’s taxonomy: what measurable verbs can and cannot say about student learning. Educ Sci. https://doi.org/10.3390/educsci6040037
Steidle S, Lucash M, Nasr-Azadani E, Smithwick E (2023) Testing presence, assessing attitudes: study of a 3D virtual tour in an “aesthetically challenged” landscape. J Environ Manag 337(March):117574. https://doi.org/10.1016/j.jenvman.2023.117574
Steidle-Nix S (2022) Testing presence, assessing attitudes: study of a virtual tour in an “aesthetically challenged” landscape. University of Oregon
Stempel P, Becker A, Nasr-Azadani E (2023) Expert perceptions of uncertainty communication in 3D visualizations of coastal hazards. J Digital Landscape Architect 2023(8):564–573. https://doi.org/10.14627/537740059
Talley JL, Schneider J, Lindquist E (2016) A simplified approach to stakeholder engagement in natural resource management: the five-feature framework. Ecol Soc. https://doi.org/10.5751/ES-08830-210438
Tang J, Fang Y, Tian Z, Gong Y, Yuan L (2023) Ecosystem services research in green sustainable science and technology field: trends, issues, and future directions. Sustainability (switzerland). https://doi.org/10.3390/su15010658
Tribal C, Journal C, Higher I (2019) Indigenous sustainability at college of Menominee nation. Tribal Coll 30(Spring):42–43
Tyrväinen L, Gustavsson R, Konijnendijk C, Ode Å (2006) Visualization and landscape laboratories in planning, design and management of urban woodlands. Forest Policy Econ 8(8):811–823. https://doi.org/10.1016/j.forpol.2004.12.005
Virtanen JP, Hyyppä H, Kämäräinen A, Hollström T, Vastaranta M, Hyyppä J (2015) Intelligent open data 3D maps in a collaborative virtual world. ISPRS Int J Geo Inf 4(2):837–857. https://doi.org/10.3390/ijgi4020837
Walters MB, Roloff GJ, Henry CR, Hartman JP, Donovan ML, Farinosi EJ, Starking MD (2021) Rethinking northern hardwood forest management paradigms with silvicultural systems research: research–management partnerships ensure relevance and application. J Forest 118(3):260–274. https://doi.org/10.1093/JOFORE/FVZ071
Warren-Kretzschmar B, von Haaren C (2014) Communicating spatial planning decisions at the landscape and farm level with landscape visualization. IForest 7(7):434–442. https://doi.org/10.3832/ifor1175-007
Wang X, Cosley D (2014) TweetDrops: a visualization to foster awareness and collective learning of sustainability. In: Proceedings of the ACM conference on computer supported cooperative work, CSCW, pp 33–36. https://doi.org/10.1145/2556420.2556787
Weaver K (2023) Bridging indigenous and western knowledge-systems in knowledge co-production with Amazonian Indigenous communities: a systematic realist review. Dev Stud Res. https://doi.org/10.1080/21665095.2023.2203842
Whyte KP (2013a) Justice forward: tribes, climate adaptation and responsibility. Clim Change 120(3):517–530. https://doi.org/10.1007/s10584-013-0743-2
Whyte KP (2013b) On the role of traditional ecological knowledge as a collaborative concept: a philosophical study. Ecol Process 2(1):1–12. https://doi.org/10.1186/2192-1709-2-7
Wiek A, Withycombe L, Redman CL (2011a) Key competencies in sustainability: a reference framework for academic program development. Sustain Sci 6(2):203–218. https://doi.org/10.1007/s11625-011-0132-6
Wiek A, Withycombe L, Redman C, Mills SB (2011b) Moving forward on competence in sustainability research and problem solving. Environment 53(2):3–12
Wilkie KJ, Clarke DM (2016) Developing students’ functional thinking in algebra through different visualisations of a growing pattern’s structure. Math Educ Res J 28(2):223–243. https://doi.org/10.1007/s13394-015-0146-y
Willard M, Wiedmeyer C, Warren Flint R, Weedon JS, Woodward R, Feldman I, Edwards M (2010) The sustainability professional: 2010 competency survey report. Environ Qual Manage 20(1):49–83
Wutich A, Beresford M, Bausch JC, Eaton W, Brasier KJ, Williams CF, Porter S (2020) Identifying stakeholder groups in natural resource management: comparing quantitative and qualitative social network approaches. Soc Nat Resour 33(7):941–948. https://doi.org/10.1080/08941920.2019.1707922
Zaidi NLB, Grob KL, Monrad SM, Kurtz JB, Tai A, Ahmed AZ, Gruppen LD, Santen SA (2018) Pushing critical thinking skills with multiple-choice questions: does Bloom’s taxonomy work? Acad Med 93(6):856–859. https://doi.org/10.1097/ACM.0000000000002087
Žalėnienė I, Pereira P (2021) Higher education for sustainability: a global perspective. Geogr Sustain 2(2):99–106. https://doi.org/10.1016/j.geosus.2021.05.001
Acknowledgements
This work is a part of the "Visualizing Forest Futures Under Climate Uncertainty: Integrating Indigenous Knowledge into Decision-Support Tools for Collaborative Decision Making (ViFF)" project, supported by the National Science Foundation (Award # BCS 1617396). The authors greatly appreciate the insights and improvements to the manuscript by Professor Trevor Birkenholts, Professor Alex Klipple, Professor Colleen Connolly-Ahern, Professor Peter Stempel, and our colleagues and Partners in the ViFF Project. We also appreciate the chance to work with College of Menominee Nation students, staff, and members of the Menominee community.
Funding
The research leading to these results received funding from the National Science Foundation (Award # BCS 1617396; the findings and conclusions do not necessarily reflect the view of the funding agency).
Author information
Authors and Affiliations
Contributions
EN-A conceptualization, data curation, formal analysis, investigation, methodology, writing-original draft, writing-review and editing. EAHS conceptualization, funding acquisition, methodology, project administration, resources, supervision, validation, writing-review and editing. SJS methodology, software, visualization, writing-review and editing. MSL visualization, supervision, validation, writing-review, and editing. DHW conceptualization and methodology. NTF resources, validation, writing-review and editing. TRK resources, validation, writing-review, and editing.
Corresponding author
Ethics declarations
Conflict of interest
Ellie Nasr-Azadani’s salary as a graduate student in the Geography department at Penn State was covered by the NSF Award # BCS 1617396 from August 2021 to July 2022.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Handled by Yadong Yu, East China University of Science and Technology, China.
Appendices
Appendix
Survey manuscript/questionnaire outline
Background information
Some information on the project: about the study.
Hello, and thanks for agreeing to participate in our research today. We are working on modeling and visualizing prescribed fire's application in reintroducing and preserving Pine Barrens habitats in northern Wisconsin's Chequamegon-Nicolet National Forest (CNNF). We also consider how these visualizations can help us better understand fire's temporal and spatial effects as a forest management tool. You will experience a 360 web-based environment (for the first group)/be given some information using text and images (for the second group). Then you will be asked to share your thoughts and insights on the topic.
Before we get started, I want to emphasize that your participation is entirely voluntary. You may withdraw at any time. Also, your responses will be kept confidential. If you have any questions about what we have already told you or what we will do, I can answer those now and later. Again, we appreciate your time and participation.
Consent statement
I have been asked to take part in the Pennsylvania State University research project specified above. I have read and understood the Explanatory Statement, and I hereby consent to participate in this project. I consent to the following:
I am at least 18 years of age and agree to participate in the study. Yes–No.
My participation is voluntary, and I can withdraw at any stage of the survey. Yes–No.
Any data that the researchers extracted from the study for reports or published findings will not contain names or identifying characteristics. Yes–No.
At the end of the experience, I will receive a $50 gift card. Yes–No.
Background/Demographic information
![figure a](http://media.springernature.com/lw685/springer-static/image/art%3A10.1007%2Fs11625-023-01399-w/MediaObjects/11625_2023_1399_Figa_HTML.png)
Main questionnaire
Cognitive mapping
I hope you enjoyed your experience. Now we are going to introduce a concept called cognitive map. In all, a cognitive map can be defined as any visual representation of a person's (or a group's) mental model for a given process or concept (Fig.
9). The first picture below shows how a cognitive map looks like in general. An example will clarify it; as an international graduate student, I have to deal with many difficulties. Let's look at how I map my thoughts regarding my life as an international student (Fig.
10). It is not that simple, though. Sometimes concepts and cognitive maps can get more complicated (Fig.
11 shows a more detailed map of my life).
Hopefully, you got comfortable with the cognitive map. As you explored in the previous section, fire is a natural process in many tribal lands. Historically, Savannah-like habitats dominated by mixed forbs, grasses, small trees, and a scattering of larger Pines (a habitat known as Pine Barrens) occupied a significant part of the ecological niche in the area and were maintained through the regular use of fire by the Menominee people. However, with the introduction of fire suppression (firefighting tactics to suppress wildfire) and elimination of fire over the years, Pine Barrens have naturally succeeded in Pine-Oak hardwood lands. Integration of fire into the landscape can ensure the restoration of Pine Barrens and biodiversity within this ecosystem. Prescribed burning is a powerful tool for seedbed preparation, releasing nutrients of dead organic material, reducing fuel, removing undesirable brush, etc. It can also be used to protect and improve the harvest and stands of timber and make this method a more economically feasible restoration approach.
Now, please use the provided pen and paper to create a cognitive map on various aspects of applying prescribed fire for restoring Pine Barren habitat relying on what you have seen and read today. We do not expect you to create something as complicated as the third figure. You can refer to the list of words offered (Feel free to use your own words; you do not have to use all provided words): Pine Barren—Forest—Thinning—Prescribed Fire—Habitat—Wildlife—Culture—Business—Open Landscape—Canopy—Aesthetic—Sustainable Forestry—Diversity—Fire exclusion—Hunting—Nutrient—Outreach—Traditional Resources—Soil—Diversity—Fire Regime—Stand—Fuel—Seed Bed—etc.
-
Would you please provide us with a minimum of five keywords (you can write as many words as you want) and show us how they are interconnected and affect each other? (Please make sure your given code is matched on your paper and screen.)
-
Is there any connection between each factor?
-
Is the connection one way, or are the components interconnected in two ways?
-
Is each component impacting the other factors positively (increasing in one factor will increase the impact of the other) or negatively (increasing in one aspect will decrease the effectiveness or consequences of the other one and vice versa)?
-
On a scale of 1–100, which number do you give to the size of this effect?
Scenario-Based assessments
Thank you very much for creating the cognitive map. That might have been an exciting challenge. Now let's delve into some scenarios related to what we experienced today. I appreciate it if you read each paragraph carefully and reflect on each of them in 2–5 sentences (you are more than welcome to write more). You are not supposed to know everything about the context; we do not need scientific responses. What matters to us is your thoughts about the general idea of each paragraph. Please be aware that scenarios are not necessarily real.
-
1.
The Oak Savanna has been an essential component of the Menominee forest because it also produces Blueberry patches. Historically, some particular stands were mainly Oak with lots of Blueberries. Cultural stories narrated by an elder in the community emphasize active fire regimes at different parts of the forest periodically so that each year, they had some patches of Blueberry left to harvest for the winter. Recently, some particular species, like Soft Maples, are starting to grow due to increased fire suppression. Maple never was here, but now it is becoming predominant in the region, and Soft Maple may take over Oak stands in two generations. In a conservation effort, a group of fire managers proposed to prescribe fire in the area. They offered to burn the whole site so that the entire region would be back to its original condition soon. However, the elder member believes that Menominees learned long ago that multiple low-intensity fires could keep a stand diversified and healthy and prevent catastrophic fires.
-
•
Which management method do you prefer and why? (Dynamic Thinking)
-
•
Why do you think the elder emphasizes that multiple low-intensity fires can benefit the land for a longer time? (Holistic Thinking)
-
2.
The Oak Savanah has been the habitat of elks for many years. After eliminating fire, the ecosystem started to change and became more favorable to white-tailed deers. The first time the number of white-tailed deer jumpstarted, the community did not take that seriously. They believed that elks were a challenging hunt, which makes any deer more ideal to the community. However, at that time, an elder argued that deers would cause problems shortly and suggested prescribing fire to balance the region before it was too late.
-
•
Why do you think deers could have been a problem based on the elder's knowledge and experience? (Cause and Effect Thinking)
-
3.
Forest succession can be defined as the predictable changes in dominant forest species, which mainly happen orderly and naturally. In a forest tribal community, there are two beliefs regarding forest succession. The first group believes that the more succession is set back, the more disturbance and effort are needed to restore the forest. However, the second group argues that while the forest is in the best situation with healthy, beautiful plants, and while it is a green area which can produce oxygen or hunting area and food, why wouldn't we suppress the fire?
-
•
What do you think is missing in the argument of the second group? Do you think something is also overlooked in the first group point? (System as a Cause Thinking)
Before finishing the session, are there any thoughts, comments, or missing points you would like to share?
On behalf of our research group, I sincerely appreciate your time and insight. With gratitude, please accept the $50 gift card as a small measure of our acknowledgment. Do not hesitate to contact me with any questions or concerns regarding this research (Authors email).
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Nasr-Azadani, E., Smithwick, E.A.H., Steidle, S.J. et al. Integrating Menominee model for sustainable forestry with Systems Thinking competency through 3D virtual tours. Sustain Sci 18, 2605–2628 (2023). https://doi.org/10.1007/s11625-023-01399-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11625-023-01399-w