Abstract
A federated instrument-to-edge-to-center architecture is needed to autonomously collect, transfer, store, process, curate, and archive scientific data and reduce human-in-the-loop needs with (a) common interfaces to leverage community and custom software, (b) pluggability to permit adaptable solutions, reuse, and digital twins, and (c) an open standard to enable adoption by science facilities world-wide. The Selfdriven Experiments for Science/Interconnected Science Ecosystem (INTERSECT) Open Architecture enables science breakthroughs using intelligent networked systems, instruments and facilities with autonomous experiments, “self-driving” laboratories, smart manufacturing and artificial intelligence (AI) driven design, discovery and evaluation. It creates an open federated architecture for the laboratory of the future using a novel approach, consisting of (1) science use case design patterns, (2) a system of systems architecture, and (3) a microservice architecture.
Research sponsored by the Laboratory Directed Research and Development Program’s INTERSECT Initiative of Oak Ridge National Laboratory. This manuscript has been authored by UT-Battelle, LLC under Contract No. DE-AC05-00OR22725 with the U.S. Department of Energy. The United States Government retains and the publisher, by accepting the article for publication, acknowledges that the United States Government retains a non-exclusive, paid-up, irrevocable, world-wide license to publish or reproduce the published form of this manuscript, or allow others to do so, for United States Government purposes. The Department of Energy will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan (http://energy.gov/downloads/doe-public-access-plan).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Al-Najjar, A., et al.: Virtual framework for development and testing of federation software stack. In: 2021 IEEE 46th Conference on Local Computer Networks (LCN), pp. 323–326 (2021). https://doi.org/10.1109/LCN52139.2021.9524993
Amstutz, P., Mikheev, M., Crusoe, M.R., Tijanić, N., Lampa, S., et al.: Existing workflow systems (2022). https://s.apache.org/existing-workflow-systems
Balsam workflows (2022). https://www.alcf.anl.gov/support-center/theta/balsam
Borchers, J.: A Pattern Approach to Interaction Design. Wiley, New York (2001)
Buschmann, F., Henney, K., Schmidt, D.C.: Pattern-Oriented Software Architecture - Volume 4: A Pattern Language for Distributed Computing. Wiley, Hoboken (2007)
Buschmann, F., Meunier, R., Rohnert, H., Sommerlad, P., Stal, M.: Pattern-Oriented Software Architecture - Volume 1: A System of Patterns. Wiley, Hoboken (1996)
Defense Advanced Research Projects Agency, U.S. Department of Defense: Creating cross-domain kill webs in real time (2022). https://www.darpa.mil/news-events/2020-09-18a
Defense Advanced Research Projects Agency, U.S. Department of Defense: System of systems integration technology and experimentation (SoSITE) (2022). https://www.darpa.mil/program/system-of-systems-integration-technology-and-experimentation
DOE national laboratories’ computational facilities - Research workshop report. Technical report, ANL/MCS-TM-388, Argonne National Laboratory, Lemont, IL, USA (2020). https://publications.anl.gov/anlpubs/2020/02/158604.pdf
Dougherty, C., Sayre, K., Seacord, R., Svoboda, D., Togashi, K.: Secure design patterns. Technical report, CMU/SEI-2009-TR-010, Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA (2009). https://doi.org/10.1184/R1/6583640.v1
Duyne, D.K.V., Landay, J., Hong, J.I.: The Design of Sites: Patterns, Principles, and Processes for Crafting a Customer-Centered Web Experience. Addison-Wesley Longman Publishing Co. Inc., Boston (2002)
FireCrest RESTful API (2022). https://firecrest.readthedocs.io/en/latest/index.html
Fortunato, E.: STITCHES - SoS technology integration tool chain for heterogeneous electronic systems (2016). https://ndiastorage.blob.core.usgovcloudapi.net/ndia/2016/systems/18869_Fortunato_SoSITE_STITCHES_Overview_Long_ 9Sep2016_.pdf
Fowler, M.: Patterns of Enterprise Application Architecture. Addison-Wesley Longman Publishing Co. Inc., Boston (2002)
Gamma, E., Helm, R., Johnson, R., Vlissides, J.: Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley Professional (1994)
Gladier experiment steering (2022). https://labs.globus.org/projects/gladier.html
Globus automation services (2022). https://docs.globus.org/globus-automation-services
Heer, J., Agrawala, M.: Software design patterns for information visualization. IEEE Trans. Vis. Comput. Graph. 12(5), 853–860 (2006). https://doi.org/10.1109/TVCG.2006.178
Heinonen, N.: Argonne researchers use Theta for real-time analysis of COVID-19 proteins (2020). https://www.alcf.anl.gov/news/argonne-researchers-use-theta-real-time-analysis-covid-19-proteins
Hukerikar, S., Engelmann, C.: Resilience design patterns: a structured approach to resilience at extreme scale. J. Supercomput. Front. Innov. (JSFI) 4(3), 4–42 (2017). https://doi.org/10.14529/jsfi170301
Hukerikar, S., Engelmann, C.: Resilience design patterns: a structured approach to resilience at extreme scale (version 1.2). Technical report, ORNL/TM-2017/745, Oak Ridge National Laboratory, Oak Ridge, TN, USA (2017). https://doi.org/10.2172/1436045
ISO/IEC JTC 1/SC 7 Software and systems engineering: ISO/IEC/IEEE 21839:2019 (2019). https://www.iso.org/standard/71955.html
ISO/IEC/IEEE: ISO/IEC/IEEE 42010 - A Conceptual Model of Architecture Description (2019). http://www.iso-architecture.org/42010/cm/
Kaplan, L.: HPE cray supercomputer modernized system management and compute environment. Presentation at the 10th Accelerated Data Analytics and Computing Institute Workshop (2021)
Kebotix (2022). https://www.kebotix.com
Kircher, M., Jain, P.: Pattern-Oriented Software Architecture, Volume 3: Patterns for Resource Management. Wiley, Hoboken (2004)
Kruchten, P.: Architectural blueprints - the “4+1” view model of software architecture. IEEE Softw. 12(6), 42–50 (1995). http://www.cs.ubc.ca/gregor/teaching/papers/4+1view-architecture.pdf
Kubernetes (2022). https://kubernetes.io
Maier, M.W.: Architecting principles for system-of-systems. Syst. Eng. 1(4), 267–284 (1998)
Maier, M.W., Rechtin, E.: The Art of Systems Architecting (Systems Engineering). CRC Press, Boca Raton (2009)
Manthorpe, W.H.J., Jr.: The emerging joint system of systems: a systems engineering challenge and opportunity for APL. John Hopkins APL Tech. Digest 17(3), 305–313 (1996)
National Energy Research Scientific Computing Center (NERSC): Superfacility API (2022). https://api.nersc.gov
National Energy Research Scientific Computing Center (NERSC): Superfacility project (2022). https://www.nersc.gov/research-and-development/superfacility
Naughton, T., et al.: Software framework for federated science instruments. In: Nichols, J., Verastegui, B., Maccabe, A.B., Hernandez, O., Parete-Koon, S., Ahearn, T. (eds.) SMC 2020. CCIS, vol. 1315, pp. 189–203. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-63393-6_13
Netflix: Netflix OSS (2022). https://netflix.github.io
Netflix: Spring Cloud Netflix (2022). https://spring.io/projects/spring-cloud-netflix
Pei, R.S.: System of systems integration (SoSI) - a smart way of acquiring army C4I2WS systems. In: Proceedings of the Summer Computer Simulation Conference 2000, pp. 574–579 (2000)
Rechtin, E.: Systems Architecting: Creating & Building Complex Systems. Prentice Hall (1990)
Sanderson, K.: Automation: chemistry shoots for the moon. Nature 568, 577–579 (2019). https://doi.org/10.1038/d41586-019-01246-y. https://www.nature.com/articles/d41586-019-01246-y
Schmidt, D.C., Stal, M., Rohnert, H., Buschmann, F.: Pattern-Oriented Software Architecture Volume 2: Patterns for Concurrent and Networked Objects. Wiley, Hoboken (2000)
Stevens, R., Taylor, V., Nichols, J., Maccabe, A.B., Yelick, K., Brown, D.: AI for science report (2020). https://www.anl.gov/ai-for-science-report
Talton, J., Yang, L., Kumar, R., Lim, M., Goodman, N., Měch, R.: Learning design patterns with Bayesian grammar induction. In: Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST) 2012, pp. 63–74. ACM, New York (2012). https://doi.org/10.1145/2380116.2380127
Troutman, K.: Superfacility framework advances photosynthesis research (2019). https://www.nersc.gov/news-publications/nersc-news/science-news/2019/superfacility-framework-advances-photosynthesis-research
UIPath (2022). https://www.uipath.com
UK Ministry of Defense: MOD architecture framework (2012). https://www.gov.uk/guidance/mod-architecture-framework
U.S. Department of Defense: The DoDAF architecture framework version 2.02 (2010). https://dodcio.defense.gov/Library/DoD-Architecture-Framework
Wolff, E.: Microservices: Flexible Software Architectures. Addison-Wesley Professional (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Engelmann, C. et al. (2022). The INTERSECT Open Federated Architecture for the Laboratory of the Future. In: Doug, K., Al, G., Pophale, S., Liu, H., Parete-Koon, S. (eds) Accelerating Science and Engineering Discoveries Through Integrated Research Infrastructure for Experiment, Big Data, Modeling and Simulation. SMC 2022. Communications in Computer and Information Science, vol 1690. Springer, Cham. https://doi.org/10.1007/978-3-031-23606-8_11
Download citation
DOI: https://doi.org/10.1007/978-3-031-23606-8_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-23605-1
Online ISBN: 978-3-031-23606-8
eBook Packages: Computer ScienceComputer Science (R0)