Skip to main content
Log in

A simulation-based method to evaluate the impact of product architecture on product evolvability

  • Original Paper
  • Published:
Research in Engineering Design Aims and scope Submit manuscript

Abstract

Products evolve over time via the continual redesigns of interdependent components. Product architecture, which is embodied in the structure of interactions among components, influences the ability for the product to be subsequently evolved. Despite extensive studies of change propagation via inter-component connections, little is known about the specific influences of product architecture on product evolvability. Related metrics and methods to assess the evolvability of products with given architectures are also under-developed. This paper proposes a simulation-based method to assess the isolated effect of product architecture on product evolvability by analyzing a design structure matrix. We define product evolvability as the ability of the product’s design to subsequently generate heritable performance-improving variations, and propose a quantitative measure for it. We demonstrate the proposed method by using it to investigate a wide spectrum of model-generated DSMs representing products with varied architectures, and show that modularity and inter-component influence cycles promote product evolvability. Our primary contribution is a repeatable method to assess and compare alternative product architectures for architecture selection or redesign for evolvability. A second contribution is the simulation-based evidence about the impacts of two particular product architectural patterns on product evolvability. Both contributions aim to aid in designing for evolvability.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. Biological and technological evolution processes are not exactly the same. One major difference is that technologies are indeed consciously “designed” by “intelligent designers,” whereas biology evolution relies on natural selection. The technology evolution process may experience more occasions of non-sequential inheritance and leaps then biological evolution because of the role and decisions of designers on technologies, even though both processes are incremental and generally slow. Readers interested in contrasting the biological and technology evolution processes may refer to Kelly (2010) and Beesemyer et al. (2011). In the present paper, we do not study processes, dynamics and influences from designer’s choices, but the evolvability of a product at a time, given by its architecture at the time. Our analogy focuses on (1) variation of elements (genes vs. components), (2) how inter-element interactions constrain variations (to make use of the NK model) and (3) preferential selection of fitness-improving variations (to define our evolvability metric). Section 2 provides more detailed review of related concepts of biological and product evolutions.

  2. For example, if the design choice of component A influences the working of B, which influences C, which influences A, components A, B and C form a cycle.

  3. The number of design choices for individual components affects the size of the design space, but does not affect the qualitative results on the isolated influences of different product architectures on evolvability. The pioneers and leading scholars of NK model had written about the consequences of using ω i  = 2 for all i. Kauffman and Weinberger (1989), who first published the NK model, wrote that, “although it is difficult to draw a picture of such high dimensional spaces, a sense of their structure can be captured by considering proteins with only two amino acids, e.g., alanine and glycine.” Levinthal (1997), who introduced NK model to the field of organization sciences, wrote that, “the model can be extended to an arbitrary finite number of possible values of an attribute, but the qualitative properties of the model are robust to such a generalization.” In this paper, the focus is to assess the isolated impact of product architecture rather than the size of design space, setting ω i  = 2 provides the simplest and most tractable model for this purpose.

  4. That means the component design choices in consideration are those that do not alter the pattern of interactions among the components. In real-world design practices, potential design choices of a component may require new interactions or eliminate existing interactions with other components. Such design choices are not included in the design space resulting from a given architecture that we focus on to assess. That is, the design space given by architecture only constitutes of those design choices of individual components complying with the architecture.

  5. Our method follows the NK model specifically to use the random fitness function to simulate the fitness landscape. In theory, the fitness function can have other forms. If the engineer has a deterministic fitness function, he can obtain a fixed landscape given specific product architecture. The fixed landscape, rather than a sample of random landscapes, will be assessed using the evolvability metric in Eq. (2). In addition, if the engineer has total knowledge of the fixed fitness landscape, he/she can choose the global optimal design directly. However, this is normally not the case of real engineering practices. Often engineers are unable to have a deterministic fitness function. In such most cases, random fitness functions can be used to assess the influence of product architecture on evolvability.

  6. K i of each component is still preserved, whereas the component’s influence links are now totally nonspecific to any predefined niche. In addition, the resulted networks with D = 1 are not purely random. The components that are primarily in more upstream of a product hierarchy have a broader scope of influence than components that are more downstream. By a simple robustness checking simulation exercise, we found that if the networks are rewired without preserving each component’s preassigned number of outgoing influences (K i ) when rewiring, the main conclusions of the paper still hold.

  7. The model is repeatedly run to simulate many network samples. For each given combination of inputs (N, K, G), we simulate 2,000 networks and calculate the average cyclic degree of each sample of 2,000 networks. To improve the fitness of the randomly generated networks, only the ones with the given N components fully connected and K within 3% of the target value were accepted as valid trials.

References

  • Ahmad N, Wynn DC, Clarkson JP (2013) Change impact on a product and its redesign process: a tool for knowledge capture and reuse. Res Eng Design 24:219–244

    Article  Google Scholar 

  • Baldwin CY, Clark KB (2000) Design rules, vol 1., the power of modularityMIT Press, Cambridge

    Google Scholar 

  • Beesemyer JC, Fulcoly DO, Ross AM, Rhodes DH (2011) Developing methods to design for evolvability: research approach and preliminary design principles. In: 9th conference on systems engineering research, Los Angeles, CA

  • Butterfield MI, Pearlman JS, Vickroy SC (2008) A system-of-systems engineering GEOSS: architectural approach. IEEE Syst J 2(3):321–332

    Article  Google Scholar 

  • Cardin MA, Kolfschoten GL, Frey DD, de Neufville R, de Weck OL, Geltner DM (2013) Empirical evaluation of procedures to generate flexibility in engineering systems and improve lifecycle performance. Res Eng Design 24:277–295

    Article  Google Scholar 

  • Cheng H, Chu X (2012) A network-based assessment approach for change impacts on complex product. J Intell Manuf 23(4):1419–1431

    Article  Google Scholar 

  • Clark K, Fujimoto T (1991) Product development performance: strategy, organization, and management in the world auto industry. Harvard Business School Press, Boston

    Google Scholar 

  • Clarkson J, Simons C, Eckert C (2004) Predicting change propagation in complex design. ASME J Mech Des 126(5):788–797

    Article  Google Scholar 

  • Cohen T, Navathe SB, Fulton RE (2000) C-FAR, change favorable representation. Comput Aided Des 32(5):321–338

    Article  Google Scholar 

  • Colagrave N, Collins S (2008) Experimental evolution: experimental evolution and evolvability. Heredity 100:464–470

    Article  Google Scholar 

  • Dahmus JB, Gonzalez-Zugasti JP, Otto KN (2001) Modular product architecture. Des Stud 22(5):409–424

    Article  Google Scholar 

  • Danilovic M, Browning TR (2007) Managing complex product development projects with design structure matrices and domain mapping matrices. Int J Project Manage 25:300–314

    Article  Google Scholar 

  • de Neufville R, Scholtes S (2011) Flexibility in engineering design. The MIT Press, Cambridge

    Google Scholar 

  • de Neufville R, de Weck OL, Frey D, Hastings D, Larson R, Simchi-Levi D, Oye K, Weigel A, Welsch R (2004) Uncertainty management for engineering systems planning and design. In: MIT engineering systems division monograph, engineering systems symposium, Cambridge, MA

  • Eckert C, Clarkson P, Zanker W (2004) Change and customization in complex engineering domains. Res Eng Design 15:1–21

    Article  Google Scholar 

  • Engel A, Reich Y (2013) Architecting systems for optimal lifetime adaptability. In: International conference on engineering design, Seoul, Korea

  • Eppinger SD, Browning TR (2012) Design structure matrix: methods and applications. The MIT Press, Cambridge

    Google Scholar 

  • Fixson SK, Park JK (2008) The power of integrality: linkages between product architecture, innovation, and industry structure. Res Policy 37:1296–1316

    Article  Google Scholar 

  • Fricke E, Schulz AP (2005) Design for changeability (DFC): principles to enable changes in systems throughout their entire lifecycle. Systems Engineering 8(4):342–359

    Article  Google Scholar 

  • Fulcoly DO (2012) A normative approach to designing for evolvability: methods and metrics for considering evolvability in systems engineering. Master’s Thesis, Massachusetts Institute of Technology

  • Giffin M, Keller R, Eckert C, de Weck OL, Bounova G, Clarkson PJ (2009) Change propagation analysis in complex technical systems. J Mech Des 131(8):081001

    Article  Google Scholar 

  • Hamraz B, Caldwell NHM, Clarkson PJ (2012) A multi-domain engineering change propagation model to support uncertainty reduction and risk management in design. J Mech Design 134(10):100905.01

  • Hamraz B, Caldwell NHM, Clarkson PJ (2013) A holistic framework for categorisation of literature in engineering change management. Syst Eng 16(4):473–505

    Article  Google Scholar 

  • Hansen TF (2003) Is modularity necessary for evolvability? Remarks on the relationship between pleiotropy and evolvability. Biosystems 69(2–3):83–94

    Article  Google Scholar 

  • Henderson RM, Clark KB (1990) Architectural innovation: the reconfiguration of existing product technologies and failure of established firms. Adm Sci Q 35:9–30

    Article  Google Scholar 

  • Hölttä-Otto K, Chiriac N, Suh ES, Lysy D (2012) Comparative analysis of coupling modularity metrics. J Eng Des 23:10–11

    Article  Google Scholar 

  • Jarratt TAW, Eckert CM, Caldwell NHM, Clarkson PJ (2011) Engineering change: an overview and perspective on the literature. Res Eng Design 22(2):103–124

    Article  Google Scholar 

  • Kauffman SA (1993) The origins of order: self-organization and selection in evolution. Oxford University Press, New York

    Google Scholar 

  • Kauffman SA, Weinberger DE (1989) The NK model of rugged fitness landscapes and its application to maturation of the immune response. J Theor Bio 141:211–245

    Article  Google Scholar 

  • Keese D, Seepersad C, Wood KL (2009) Product flexibility measurement with enhanced change modes and effects analysis (CMEA). Int J Mass Cust 3(2):115–145

    Article  Google Scholar 

  • Keller R, Eckert CM, Clarkson PJ (2006) Matrices or node-link diagrams: which visual representation is better for visualising connectivity models. Inf Vis 5:62–76

    Article  Google Scholar 

  • Kelly K (2010) What technology wants. Viking, New York

    Google Scholar 

  • Kirschner M, Gerhart J (1998) Evolvability. Proc Natl Acad Sci USA 95:8420–8427

    Article  Google Scholar 

  • Koh ECY, Caldwell NHM, Clarkson PJ (2012) A method to assess the effects of engineering change propagation. Res Eng Design 23(4):329–351

    Article  Google Scholar 

  • Koh ECY, Caldwell NHM, Clarkson PJ (2013) A technique to assess the changeability of complex engineering systems. J Eng Des 24(7):477–498

    Article  Google Scholar 

  • Levinthal DA (1997) Adaptation on rugged landscapes. Manag Sci 43(7):934–950

    Article  MATH  Google Scholar 

  • Luo J, Magee CL (2011) Detecting evolving patterns of self-organizing networks by flow hierarchy measurement. Complexity 16(6):53–61

    Article  Google Scholar 

  • MacCormack A, Rusnak J, Baldwin CY (2006) Exploring the structure of complex software designs: an empirical study of open source and proprietary code. Manage Sci 52(7):1015–1030

    Article  Google Scholar 

  • Martin MV, Ishii K (2002) Design for variety: developing standardized and modularized product platform architectures. Res Eng Design 13:213–235

    Google Scholar 

  • Mihm J, Loch C, Huchzermeier A (2003) Problem-solving oscillations in complex engineering projects. Manage Sci 49(6):733–750

    Article  Google Scholar 

  • Newman MEJ (2003) Structure and function of complex networks. SIAM Rev 45:167

    Article  MATH  MathSciNet  Google Scholar 

  • Ollinger GA, Stahovich TF (2004) RedesignIT—a model-based tool for managing design changes. J Mech Des 126(2):208–216

    Article  Google Scholar 

  • Otto KN, Wood KL (1998) Product evolution: a reverse engineering and redesign methodology. Res Eng Design 10(4):226–243

    Article  Google Scholar 

  • Pasqual MC, deWeck OL (2012) Multilayer network model for analysis and management of change propagation. Res Eng Design 23(4):305–328

    Article  Google Scholar 

  • Pimmler TU, Eppinger SD (1994) Integration analysis of product decompositions. In: Proceedings of ASME 6th international conference on design theory and methodology, Minneapolis, MN

  • Rajan P, Van Wie M, Wood KL, Campbell MI, Otto KN (2005) An empirical foundation for product flexibility. Des Stud 26(3):405–438

    Article  Google Scholar 

  • Ricci N, Rhodes RH, Roos AM (2014) Evolvability-related options in military systems of systems. Proc Comput Sci 28:314–321

    Article  Google Scholar 

  • Rivkin JW, Siggelkow N (2007) Patterned interactions in complex systems: implications for exploration. Manage Sci 53(7):1068–1085

    Article  Google Scholar 

  • Ross AM, Rhodes DH, Hastings DE (2008) Defining changeability: reconciling flexibility, adaptability, scalability, modifiability, and robustness for maintaining system lifecycle value. Syst Eng 11(3):246–262

    Article  Google Scholar 

  • Rutka A, Guenov M, Lemmens Y, Schmdit-Schaeffer T, Coleman P, Rivi`ere A (2006) Methods for engineering change propagation analysis. In: Proceedings of the 25th congress of the international council of the aeronautical sciences, ICAS, Stockholm, Sweden

  • Saleh JH, Mark G, Jordan NC (2009) Flexibility: a multi-disciplinary literature review and a research agenda for designing flexible engineering systems. J Eng Des 20(3):307–323

    Article  Google Scholar 

  • Siddiqi A, de Weck OL (2008) Modeling methods and conceptual design principles for reconfigurable systems. J Mech Des 130:101102–101115

    Article  Google Scholar 

  • Silver M, de Weck OL (2007) Time-expanded decision networks: a framework for designing evolvable complex systems. Systems Engineering 10:167–186

    Article  Google Scholar 

  • Simon HA (1962) The architecture of complexity. Proc Am Philos Soc 106:467–482

    Google Scholar 

  • Simpson TW, Maier JRA, Mistree F (2001) Product platform design: method and application. Res Eng Design 13(1):2–22

    Article  Google Scholar 

  • Simpson TW, Jiao J, Siddique Z, Hölttä-Otto K (2013) Advances in product family and product platform design: methods and applications. Springer, Berlin

    Google Scholar 

  • Singh V, Skiles SM, Krager JE, Wood KL, Jensen D, Sierakowski R (2009) Innovations in design through transformation: a fundamental study of transformation principles. J Mech Des 131(8):081010

    Article  Google Scholar 

  • Smaling R, de Weck OL (2007) Assessing risks and opportunities of technology infusion in system design. Syst Eng 10(1):1–25

    Article  Google Scholar 

  • Smith RP, Eppinger SD (1997a) Identifying controlling features of engineering design iteration. Manage Sci 43(3):276–293

    Article  MATH  Google Scholar 

  • Smith RP, Eppinger SD (1997b) A predictive model of sequential iteration in engineering design. Manage Sci 43(8):1104–1120

    Article  MATH  Google Scholar 

  • Sosa ME, Eppinger SD, Rowles CM (2007) A network approach to define modularity of components in complex products. J Mech Des 129(11):1118–1129

    Article  Google Scholar 

  • Sosa ME, Mihm J, Browning TR (2013) Linking cyclicality and product quality. Manuf Serv Oper Manag 15(3):473–491

    Google Scholar 

  • Suh NP (1990) axiomatic design: the principles of design. Oxford University Press, Oxford

    Google Scholar 

  • Suh ES, de Weck OL, Chang D (2007) Flexible product platforms: framework and case study. Res Eng Design 18(2):67–89

    Article  Google Scholar 

  • Tilstra A, Seepersad C, Wood KL (2012) High definition design structure matrix for quantitative assessment of product architecture. J Eng Des 23(10–11):767–789

    Article  Google Scholar 

  • Tilstra A, Backlund P, Seepersad C, Wood KL (2013) Principles for design products with flexibility for future evolution. Int J Mass Cust (forthcoming)

  • Ulrich KT (1995) The role of product architecture in the manufacturing firm. Res Policy 24(3):419–440

    Article  MathSciNet  Google Scholar 

  • Ulrich KT, Eppinger SD (2011) Product design and development. McGraw-Hill, New York

    Google Scholar 

  • Wagner GP, Altenberg L (1996) Perspective: complex adaptations and the evolution of evolvability. Evolution 50:967–976

    Article  Google Scholar 

  • Whitney DE (1996) Why mechanical design cannot be like VLSI design. Res Eng Design 8(3):125–138

    Article  Google Scholar 

  • Whitney DE, Crawley E, deWeck O, Eppinger S, Magee C, Moses J, Seering W, Schindall J, Wallace D (2004) The influence of architecture in engineering systems. Engineering Systems Monograph, MIT Engineering Systems Division, Cambridge

    Google Scholar 

  • Williams R, Martinez N (2000) Simple rules yield complex food webs. Nature 404:180–183

    Article  Google Scholar 

  • Yassine AA, Falkenburg DR (1999) A framework for design process specifications management. J Eng Des 10(3):223–234

    Article  Google Scholar 

  • Ziman J (2000) Technological innovation as an evolutionary process. Cambridge University Press, Cambridge

    Google Scholar 

Download references

Acknowledgments

I am grateful to Kristin Wood, Kevin Otto, Katja Otto, Richard de Neufville, Karen Wilcox, Christopher Magee, Daniel Whitney, Oliver de Weck, Jason Woodard, Carliss Baldwin and other colleagues at Singapore University of Technology & Design, Massachusetts Institute of Technology, and Harvard University. The enormous discussions with them have greatly inspired and shaped this research. This work was funded, in part, by the SUTD-MIT International Design Centre, http://idc.sutd.edu.sg.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jianxi Luo.

Appendix

Appendix

The network generation model is revised on the basis of a mathematical model that replicates ecological networks (Williams and Martinez 2000). The simulation model uses three input parameters, which may represent different architectural properties of a product.

  1. (1)

    Network size (N): the total number of components in the product.

  2. (2)

    Interaction density (K): the average number of components that each component influences. For a product with N components and M influence links, K = M/N. In the context of product design, it is an indicator of product integrality or reverse indicator of product modularity.

  3. (3)

    Influence diversity (D): the scope of other components that an average component can influence in an ideal and hypothesized product hierarchy (Fig. 6a) or a “serial design chain,” as Sosa et al. (2013) put it. Its reverse concept is “influence specificity,” which indicates the degree to which a component’s influences concentrate on a subset of components that are proximate to each other in the product hierarchy. As influence diversity increases, inter-influence relationships among components will gradually deviate from the pure serial or upstream–downstream manner.

    Fig. 6
    figure 6

    Network rewiring model

1.1 Baseline Scenario (D = 0)

We begin by creating an ideal and hypothesized sequential (upstream–downstream) influence or dependence relationship between components in their interaction network, which will be rewired later to generate more general and cyclic networks. To do this, each of the N components is assigned to a uniformly distributed random position λ i , along an axis ranging from 0 to 1 (Fig. 6a). Consider a focal component i with position value λ i , the entire downstream interval for component i has a length (1 − λ i ). The component’s “influence niche” range r i is the interval containing the components that it can influence, as defined by

$$r_{i} = X(1 - \lambda_{i} )$$
(4)

where X is a random variable between 0 and 1, and the probability distribution of X is component independent (to be set up later).

The focal component’s influence niche range can be located anywhere downstream. The position parameter b i fixes the location of component i’s niche range by defining its left most point. b i is assumed to be uniformly distributed between λ i and (1 − r i ). Networks generated this way are strictly acyclic; there is no influence cycle among any components. Thus, they can be used as the basis for later rewiring to introduce cycles.

The niche range of a particular component r i , as defined in Eq. (4), is a random variable whose statistical properties are affected by the number of components (N) and interaction density (K) of the product. Now we explain this association further. First, the density of components on the entire segment is N. Because the distribution of these components is uniform, the expected number of components in the niche for component i is as follows:

$$E(K_{i} ) = N \cdot E(r_{i} )$$
(5)

For the entire system, excluding the rightmost component, the sum of the expected number of component that each component can influence is as follows:

$$E(M) = \sum\limits_{i = 1}^{N - 1} {E(K_{i} ) = N} \sum\limits_{i = 1}^{N - 1} {E(r_{i} )}$$
(6)

In addition, the expected average number of components that each components influences is simply

$$E(K) = \frac{E(M)}{N} = \sum\limits_{i = 1}^{N - 1} {E(r_{i} ) = } \sum\limits_{i = 1}^{N - 1} {E(1 - \lambda_{i} )} E(X) = \frac{(N - 1)}{2}E(X)$$
(7)

Thus, the random variable X is not only constrained to be between 0 and 1, but its expected value is

$$E(X) = \frac{2E(K)}{N - 1}$$
(8)

E(K) is given as the input variable K to the network construction model. Note that, although K i is component-specific and randomly distributed, K is the average and an empirically measurable property of a given product’s component network. To generate a network, we need to choose an appropriate functional form for the distribution of X and then impose the constraint of Eq. (8). For computational ease, a beta-distribution with parameters (1, β) is used for the random variable X. This allows E(X) to be in a computationally convenient form, 1/(1 + β). Given K and N as inputs, β will be determined by

$$\beta = \frac{N - 1}{2K} - 1$$
(9)

Then, a random niche range constrained by (4) can be given to each of the aforementioned array of components randomly organized between 0 and 1 on the axis. The focal component is then linked to each component in its influence niche.

1.2 Hybrid (0 < D < 1): Random rewiring

When “influence diversity (D)” is greater than zero (D > 0), a portion D of influence links of a component, which assumedly go into its hypothesized niche, become nonspecific and are wired to components anywhere in the product hierarchy (including the preassigned niche).Footnote 6 Figure 6b demonstrates a hybrid configuration after rewiring. Thus, influence diversity D is operationalized as the percentage of a component’s influence links that can deviate away from its predefined niche of components as given in the baseline scenario, and is the control for the extent of rewiring. Now, cycles can emerge to the degree of rewiring determined by D.

Tuning parameters N, K and D, the model generates random networks with gradually varied cyclic degrees (C). We statistically assessed the basic regularity in the relationship between N, K, D and C via simulationsFootnote 7 before using the simulated networks to investigate evolvability. First, the cyclic degree appears almost unaffected by changes in N when N is sufficiently large. Second, the cyclic degree is an increasing function of both K and D. The average cyclic degree of randomly generated network samples as a function of the inputs K and D (when N = 100) is plotted in Fig. 7. In particular, because the relationship between K or D and C is monotonic, one can infer the nominal “influence diversity” of an actual product from its empirically measurable interaction density (K) and cyclic degree (C).

Fig. 7
figure 7

Impact of influence diversity and interaction density on cycle degree

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Luo, J. A simulation-based method to evaluate the impact of product architecture on product evolvability. Res Eng Design 26, 355–371 (2015). https://doi.org/10.1007/s00163-015-0202-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00163-015-0202-3

Keywords

Navigation