In this research article, we explore the use of a design process for adapting existing cyber risk assessment standards to allow the calculation of economic impact from IoT cyber risk. The paper presents a new model that includes a design process with new risk assessment vectors, specific for IoT cyber risk. To design new risk assessment vectors for IoT, the study applied a range of methodologies, including literature review, empirical study and comparative study, followed by theoretical analysis and grounded theory. An epistemological framework emerges from applying the constructivist grounded theory methodology to draw on knowledge from existing cyber risk frameworks, models and methodologies. This framework presents the current gaps in cyber risk standards and policies, and defines the design principles of future cyber risk impact assessment. The core contribution of the article therefore, being the presentation of a new model for impact assessment of IoT cyber risk.
There is a strong interest in industry and academia to standardise existing cyber risk assessment standards. Standardisation of cyber security frameworks, models and methodologies is an attempt to combine existing standards. This has not been done until present. Standardisation in this article refers to the compounding of knowledge to advance the efforts on integrating cyber risk standards and governance, and to offer a better understanding of cyber risk assessments. Here we combine literature analysis  with epistemological analysis, and an empirical  with a comparative study . The empirical study is conducted with fifteen national high-technology (high-tech) strategies, seven cyber risk frameworks and two cyber risk models. The comparative study engages with fifteen high-tech national strategies. The epistemological analysis and an empirical study seek to probe the current understanding of cyber risk impact assessment.
To adapt the current cyber security standards, firstly the specific IoT cyber risk vectors need to be identified. By risk vectors, we refer to Internet of Things (IoT) attack vectors from particular approach used, to exploit big data vulnerabilities . Subsequently, these specific risk vectors need to be integrated in a holistic cyber risk impact assessment model .
Documented process represents a new design for mapping and optimising IoT cyber security and assessing its associated impact. We discuss and expand on these further in the remainder of this article. The research article is structured in the following format. In Sect. 2 we present the research methodology. In Sect. 3 we conduct literature review. In Sect. 4 we propose the IoT cyber risk vectors by conducting a comparative study of national high-tech strategies and initiatives. In Sect. 5 we propose the design principles for impact assessment of IoT cyber risk by conducting empirical study cyber security frameworks, methods and quantitative models. In Sect. 6 we evaluate the design principles by conducting theoretical analysis to uncover the best method to define a unified cyber risk assessment. In Sect. 7 we propose a new epistemological framework for cyber risk assessment standardisation and we discuss the new impact assessment principles. In Sect. 8 we present the conclusions and limitations of the research.
Literature review of academic and industry literature from several different countries is undertaken to advance the epistemological framework into a design model.
Recent literature on this subject
The increasing number of high-impact cyber-attacks has raised concerns of the economic impact [6,7,8,9] and the issues from quantifying cyber insurance . This triggers questions on our ability to measure the impact of cyber risk [11,12,13,14,15]. The literature review is focused on defining the IoT risk vectors which are often overlooked by cyber security experts. The IoT risk vectors are investigated in the context of Social Internet of Things , the Industry 4.0 (I4.0) and the Industrial Internet of Things (IIoT). In the Social Internet of Things, the IoT is autonomously establishing social relationships with other objects, and a social network of objects and humans is created [17, 18]. The I4.0 is also known as the fourth industrial revolution and brings new operational risk for connected digital cyber networks . Finally, the IIoT represents the use of IoT technologies in manufacturing .
Cyber risk in shared infrastructure from autonomous IoT
The cyber risk challenges  from IoT technological concepts, mostly evolve around the design  and the potential economic impact (loss) from cyber-attacks [23, 24]. IoT revolves around machine-to-machine [25, 26] and cyber-physical systems (CPS) . Similarly, the IoT is based on intelligent manufacturing equipment [28,29,30,31,32], creating systems of machines capable of interacting with the physical world . The integration of such technologies creates new cyber risk, for example from integrating less secured systems . Incorporating the cyber element in manufacturing, for instance, also bring an inherent cyber risk . There are multiple attempts in literature where existing models are applied understand the economic impact of cyber risk . However, these calculations largely ignore the cyber risk of sharing infrastructure , such as IoT infrastructure [11, 12, 38], [39,40,41,42,43,44,45,46]. Understanding the shared risk is vital for risk assessment , but the cyber risk estimated loss range can vary significantly . Furthermore, there is no direct correlation between cyber ranking  and digital infrastructure , thus contradicting the argument that cyber risk is related to integrating new technologies . It seems more likely that the cyber challenges are caused by the adoption and implementation  and the cost of smart manufacturing technologies .
Cyber risk and IoT cloud technologies
If the Cloud architecture is properly engineered, the security of the cloud instance is adequately maintained and the connectivity from cloud to Thing can be assured, then cyber risks can be reduced with cloud technologies . To ensure cyber risk is reduced, cloud technologies should be supported with: internet-based system, service platforms , processes, services , for machine decision making . Creating cyber service architecture  and cloud distributed manufacturing planning . Cyber risk mitigation also require compiling of data, processes, devices and systems . IoT technologies need to be supported with a life cycle process for updating the list of assets that are added to the network across multiple time-scales [59,60,61]. IoT cyber risk is also present in components modified to enable a disruption [37, 62]. One option by which such risk could be mitigated is to consider the standardisation of the IoT design and process ; unfortunately however, such system security is complex  and risk assessing IoT systems is still a key problem in research . Nevertheless, cyber networks need to be secure , vigilant , resilient  and fully integrated [66,67,68]. Therefore, the IoT need to encompass the security and privacy , along with electronic  and physical security of real-time data [71, 72].
The IoT consists of heterogeneous cloud technologies and varying lifecycle of the IoT devices, the question of value [73,74,75] in inheriting outdated data  where machines store knowledge and create a virtual living representation in the cloud . The access to existing knowledge could be of value to design more resilient systems and processes in the future.
Cyber risk from social machines and real-time technologies
Cyber risk emerges from the Web , but also from any interface to a digital processing component, wired and wireless and the entire Web can be perceived as a social machine . The term social machines in the context of this paper is used in relation to systems that depend on interaction between humans and technology and enable real time output or action, such as Facebook and Twitter. Social machines  are vulnerable to cyber risks, because of the connection between physical and human networks  operating as systems of systems  and mechanisms for real-time feedback . Cyber risk from real-time IoT technology  requires information security for data in transit . In addition, access control is required for granting or denying requests for information and processing services . Despite expectations that information security and access control for social machines exists, the business of personal data has triggered many privacy concerns for social machines such as Facebook and Google . Some of these concerns have already materialised [83, 84]. IoT brings inherent cyber risks which require appropriate cyber recovery plans. The relationship between IoT cyber risk assessment and recovery planning emerges from new processes, such as machine learning, that can be used to patch known vulnerabilities in real-time.
IoT cyber risk vectors from the literature review
The IoT cyber risk vectors relate to the overall aim of defining the design principles for cyber risk impact assessment. Prior to assessing the impact, we required an understanding of the IoT risk.
A list of IoT cyber risk vectors derive from the literature review.
These IoT cyber risk vectors are not clearly visible and focus should be on the communications risk; whether conventional wired (broadband or IP networks) or wireless (W-Fi, Bluetooth and 3G/4G/5G)—the connectivity is one of the weak spots .
While there are many more cyber risk vectors, analysing every single risk vector was considered beyond the scope of this study and the focus was placed on the most prominent vectors as identified in the literature. The idea was to identify a risk assessment process that can be applied by future researchers to many different risk vectors. The IoT risk vectors outlined above are analysed in the following section through comparative analysis of cyber risk in high-tech strategies.
The methods applied in this study consist of literature review, comparative study, empirical analysis, theoretical and epistemological analysis and case study workshops. The selection of methodologies is based on their flexibility to be applied simultaneously to analyse the same research topic from different perspectives. We use practical studies of major projects in the I4.0 to showcase recent developments of IoT systems in the context of I4.0 high-tech strategies. We need practical studies to bridge the gaps, to assess the impact and overcome some of the cyber risk limitations and to construct the relationship between IoT and high-tech strategies. The proposed design principles support the process of building a holistic IoT cyber risk impact assessment model.
The methodology applies theoretical analysis through logical discourse of knowledge, also known as epistemological analysis. An epistemological analysis enables an investigation on how existing knowledge is justified and what makes justified beliefs justified , what does it mean to say that we understand something  and how do we understand that we understand.
The methodology reported here has two objectives. The first objective is to enable an up-to-date overview of existing and emerging cyber risk vectors from IoT advancements, which includes cyber-physical systems, the industrial Internet of things, cloud computing and cognitive computing [53, 92, 93]. If we were performing a vector specific analysis of risk for the Internet of Things, we would include examining risk vectors related to consumer IoT and specific high-risk verticals like eHealth and Smart Cities. But this study is focused on the developing an economic impact assessment of IoT cyber risk as a component in the context of other emerging technologies. This methodological approach proposes a new design for assessing the impact of cyber risk and promotes the adaptation of existing cyber risk frameworks, models and methodologies. The second objective is to enable the adaptation of the best cyber security practices and standards to include cyber risk from IoT vectors.
The methodology begins with an academic and industry literature review on IoT cyber risk. A comparative study  classifies the cyber risk vectors, specific to the IoT, based on the current technological trends. An empirical study  categorises cyber risk frameworks, methodologies, systems, and models (particularly those that are quantitative). Afterwards, the compounded findings are compared with the existing standards through a grounded theory assessment method. This is followed by a theoretical analysis to uncover the best method to define a unified cyber risk assessment. The objective of the methodology is to synthesise and to build upon knowledge from existing cyber risk standards.
Comparative study on IoT cyber risk in high-tech strategies
This section represents a comparative study  of national high-tech strategies, because the IoT is strongly represented in the Industry 4.0. The selection of high-tech strategies—sources for analysis is based on the richness of the documented processes. The comparative study is applied on a range of IoT high-technology strategies to enhance the framework and to build upon previous literature on this subject . Defining the most prominent IoT cyber risk vectors is of crucial importance to understanding IoT cyber risk, because IoT cyber risk is often invisible to cyber security experts. In this section, the study intent is to analyse Industry 4.0 and present it as an example of how risk assessment takes place at the national level.
Understanding IoT cyber risk in national high-tech strategies
The current direction of impact assessment from IoT cyber risk, seems to be decided by assessment activities, e.g. workgroups  or testbeds , supported by economic assessments . In some strategies, impact is decided by assessing key projects in the digital industry, e.g. Fabbrica Intelligente  and Industrie 4.0 .
The different approaches to impact assessment, could be resulting from the differences in IoT focus. The Industrial Internet Consortium [20, 98] focuses on promoting core IoT industries; while the New France Industrial (NFI) , the High Value Manufacturing Catapult (HVM)  and the National Technology Initiative , all focus on promoting the development of key IoT technologies. Another high-tech strategy, Made in China 2025 , promotes tech sectors, while the Made Different  promotes key IoT transformations.
The diversity of the approaches can also be identified in the less evolved in identifying IoT cyber risk vectors (e.g. The Netherlands—Smart Industry ; Belgium—Made Different ; Spain—Industrie Conectada ; Italy—Fabbrica Intelligente ; G20—New Industrial Revolution ). This could be because some high-tech strategies lack documentation and appear disorganised. Such arguments are present in literature .
The Industrie 4.0 [86, 107]; the report by Department for Culture, Media and Sport (DCMS) , and the Industrial Value Chain Initiative (IVI) [94, 109] promote different risk vectors than the Russian National Technology Initiative (NTI) .
In some strategies, e.g. the Advanced Manufacturing Partnership , these differences are understandable, because one strategy would have evolved into a new high-the strategy, e.g. IIC , or are very narrowly focused on futuristic IoT technologies, e.g. New Robot Strategy ; Robot Revolution Initiative ; and the IoT technologies do not yet exist. Hence, we can only speculate on the expected cyber risks [11, 12].
The Table 1 summarises the analysis of the comparative study. The most prominent IoT cyber risk vectors derive from the analysis and are presented in a comparative decomposition approach. The aim of the comparative analysis and decomposition is to show the IoT cyber risk vectors and areas not covered (gaps) in national high-tech strategies. Secondly, the comparative analysis and decomposition enables visualising how the areas not covered in one high-tech strategy, have been addressed in other high-tech strategies. Therefore, the comparative study enables standardisation of approaches. The Table 1 enables policy makers to firstly identify the gaps and secondly to identify the best approach to address individual risk vectors. However, the analysis in Table 1 is limited to the most prominent vectors as identified in existing literature previously in Sect. 3.1.
To provide clarity on the areas not covered (gaps), the IoT cyber risk vectors are used as reference categories (Table 1), for decomposing the IoT cyber risk into sub-categories. The sub-categories are used for defining various IoT cyber risks vectors and for clarifying different and sometimes contrasting understanding of IoT cyber risks. The comparative study in Table 1, follows the grounded theory approach , and categorises the areas not covered in IoT risk vectors, to construct the cyber assessment design principles. In the following sections, a more general assessment is being presented and the national plans analysed are presented in a broader sense that take in more of the landscape of IoT implementation.
Empirical study of cyber security standards
A key part of understanding the risks and issues facing the IoT involves reflecting on the standards and models present today. In what follows, we reflect on seven cyber risk standards and two cyber risk models. The design initiates with integrating best practices. Through empirical analysis , we compare existing cyber security measures and standards (e.g. FAIR and NIST cyber security frameworks) to propose a new and improved design principles for calculating the economic impact of IoT cyber risk.
The analysis presented in this section emerge from the analysis in this study, but also represent a stand-alone piece of work because the nature of security frameworks and assessment tools is quite diverse. What is presented in this section is an attempt to apply comparative analysis to synthesize a common, best practice approach that pulls the best features from each of the frameworks into a single, theoretical approach.
Empirical analysis of cyber security frameworks, models and methodologies
A majority of the cyber security frameworks today apply qualitative approaches to measuring cyber risk [114,115,116,117,118]. Some of the frameworks propose diverse qualitative methods, such as OCTAVE, which stands for Operationally Critical Threat, Asset, and Vulnerability Evaluation  and recommends three levels of risk (low, medium, high). Methodologies, such as the Threat Assessment and Remediation Analysis (TARA)  are also qualitative and apply a standardised template to record system threats. There also systems that combine qualitative and quantitative approaches. The Common Vulnerability Scoring System (CVSS)  provides modified base metrics for assigning metric values to real vulnerabilities. The CVSS applies expert’s opinions, presented as statements, where each statement is allocated a level of cyber risk and the calculator assesses the overall level of risk form all statements.
Considering the lack of more precise methods, the modified base metrics represent the state of the art at present. The supply chain cyber risks are also assessed with qualitative approaches [39, 46, 120,121,122,123,124,125,126,127]. The Exostar system , which represent a qualitative approach, provides guidance points for assessing the supply chain cyber risk. The overall current state of cyber maturity can be verified with the Capability Maturity Model Integrated (CMMI) , which integrates five levels of the original Capability Maturity Model (CMM) . To reach the required cyber security maturity level, the current cyber state can be transformed into a given a target cyber state by applying the National Institute of Standards and Technology’s (NIST)  cyber security framework implementation guidance . The risk assessment approach is based on the framework for improving cybersecurity of critical infrastructure  and follows recommendations for qualitative risk assessments e.g. standards based approach, or internal controls approach.
Slightly different approach to understanding risk is the use of emerging quantitative cyber risk models, such as the Factor Analysis of Information Risk Institute (FAIR) approach . In effect, quantitative approaches are mostly present in the cyber security models [133, 134]. The FAIR approach is complementary to existing risk frameworks that are deliberately distanced from quantitative modelling (e.g. NIST) and applies knowledge from existing quantitative models, e.g. RiskLens , and Cyber VaR (CyVaR) . In a way, FAIR is complementing the work of NIST and the International Organisation for Standardisation (ISO) , which is the international standard-setting body and includes cyber risk standards. For example, the ISO 27032 is a framework for collaboration that provides specific recommendations for cyber security, and ISO 27001 sets requirements for organisations to establish an Information Security Management System (ISMS).
Notable for this discussion, only ISO 27031 and NIST  provide recommendations for recovery planning, which some of the other frameworks and models have focused on less. A key point to note here is that risk estimation is used for recovery planning, and as such quantitative risk impact estimation  is needed for making decisions on topics such as cyber risk insurance . The quantitative risk assessment approaches e.g. FAIR , RiskLens , and CyVaR , are still be in their infancy. Hence, the state of the art in current risk estimation (also known as risk analysis) is based on the high, medium, low scales (also known as the traffic lights system or colour system).
The diversity of approaches for cyber risk impact assessment, reemphasises the requirement for standardisation of cyber risk assessment approaches. The diversity and the gaps in the proposed approaches, become clearly visible in Table 2. This diversity presents conflict in risk assessment, e.g. qualitative versus quantitative. To enable the standardisation design, in Table 2, core cyber impact assessment concepts are extracted to defining the design principles for cyber risk impact assessment from IoT vectors. The design principles initiate with defining how to measure, standardise and compute cyber risk and how to recover. These are defined as:
Measure—calculate economic impact of cyber risk.
Standardise—international cyber risk assessment approach.
Compute—quantify cyber risk.
Recover—plan for impact of cyber-attacks, e.g. cyber insurance.
Beyond these issues, the empirical research outlined in Table 2 has highlighted other challenges in adopting existing cyber risk frameworks for dynamic and connected systems, where the IoT presents great complexities. For example the increasing ability of risk to propogate given the high degrees of connectivity in digital, cyber-physical, and social systems, and challenges pertaining to the limited knowledge that risk assessors have of dynamic IoT systems .
Theoretical analysis to uncover the best method to define a unified cyber risk assessment
The above empirical and comparative analysis correlated academic literature with government and industry cyber security frameworks, models and methodologies. In this section, epistemological analysis is applied to probe the existing understanding of cyber risk assessment. Such an approach was considered appropriate for our purposes because most cyber security frameworks and methodologies propose answers to a quantitative question with qualitative assessments. The analysis in this study examines how the current cyber risk assessment approaches are based on conventional abstractions, for instance, the colour coding in the NIST framework traffic light protocol , or the mathematical approximation in CVSS . In quantified cases, we may have a modified attack vector allocated to a numerical value of 0.85 for a network metric value, and a numerical value of 0.62 for adjacent network metric value . The question is why 0.85 and why 0.62 and why red represents information not for disclosure . These measurements represent conventional abstractions that when expressed, become important units of measurement. These units of measurement in effect represent symbols with a defined set of rules in a conventional system, where truths about their validity can be derived from expert opinions, hence proven to be correct. These units of measurement do not, however, represent quantitative units based on statistical methods for predicting uncertainty.
Knowledge requires ‘truth, belief and justification’ as individual conditions . Knowledge that a numerical value of 0.62 is ‘true’ metric value for adjacent network, as the related CVSS approach ‘believes’, needs to be ‘justified’ to confirm it does not represent just a guess of luck. Since a numerical value. Justification needs to be based on evidentialism [139, 140], where a proposition e.g. numerical value of 0.62, is epistemically justified as determined entirely by evidence. The debate whether cyber risk standards can be epistemically justified, must be based on the facts and evidence currently available. In evidentialism, epistemic evaluations are separate from moral believes and practical assessments, as epistemically justified evaluations might conflict with moral and practical estimations .
The integration of the theoretical analysis, with the empirical study of existing models with the comparative study of national strategies leads to a new epistemological framework consistent of sets of techniques for impact assessment of IoT cyber risk. Subsequently, a grounded theory approach is applied on the results of the epistemological framework with the output of the case study research into IoT cyber trends and technologies. The case study research is not applied to identify new, or the most prominent risk vectors. It would be challenging to argue that there is no bias if the vectors came from a limited population of stakeholders. The case study research simply represents an example of how the epistemological framework could be applied in a step by step process.
Proposed epistemological framework for cyber risk assessment standardisation
To define a standardisation framework, firstly the Pugh controlled convergence  is applied with a group of experts in the field. The Pugh controlled convergence is a time-tested method for concept selection and for validation of research design. The results from the comparative study and the empirical analysis were presented, including the Fig. 1, to a group of experts. The Pugh controlled convergence  was applied to organise the emerging concepts into definitions of the design principles. The resulting definition of design principles for a standardisation framework are derived from four workshops that included 18 distinguished engineers from Cisco Systems, and 2 distinguished engineers from Fujitsu. The workshops with Cisco Systems were conducted in the USA in four different Cisco research centres. The Fujitsu workshop was conducted separately to avoid those experts being influenced or outspoken by the larger group from Cisco systems.
This approach to pursuing validity follows existing literature on this topics [40, 142] and provides clear definitions that specify the units of analysis for IoT cyber risk vectors. The reason for pursuing clarity on the units of analysis for IoT cyber risk, was justified by existing literature, where these are identified as recommended areas for further research . The IoT risk units of analysis from individual high-tech strategy are combined into standardisation vectors. The process of defining the standardisation vectors followed the Pugh controlled convergence method, where experts were asked to confirm the valid concept, merge duplicated concepts, and delete conflicting concepts.
In the assessment and transcription process, discourse analysis is applied to interpret the data  and for recognising the most profound concepts in the data . The findings from the workshops are summarised in the table below (Table 3). The findings are presented in Table 3 after the controlled convergence was performed on all five workshops. The controlled convergence resulted with some units of analysis being merged to avoid duplication, such as Cloud-based computing ; and Cloud computing . Or the concepts of CPS, which was identified as vector 2 in multiple high-tech strategies [86, 92, 103]. Similarly, the units of analysis of cyber risk standards are presented as merged definitions of the design principles, as categorised on the controlled convergence workshops.
The Table 3 below presents an epistemological framework of the knowledge and understanding, gathered from the comparative empirical analysis. The epistemological framework in Table 3 presents a narrowed framework of current understanding of IoT cyber risk, which is analysed and verified with the Pugh controlled convergence method for concept selection and for validation of research design.
The epistemological framework in Table 3 defines the IoT cyber risk vectors and relates the risk vectors with units of analysis. Defining the IoT cyber risk vectors and the related units of analysis, represents a crucial milestone in defining the design principles for cyber risk assessment of IoT. The epistemological framework in Table 3 proposes the design principles for measuring, standardising, computing and recovering from IoT risk. An example of how the epistemological framework in Table 3 can be applied:
Measure the ‘vector 3’: economic impact of cyber risk from autonomous ‘robotics in IoT’—calculate economic impact of cyber risk with ‘BetaPERT distributions’.
Standardise the ‘vector 3’—international cyber risk impact from autonomous ‘robotics in IoT’—assessment approach with ‘Mathematical approximation’.
Compute the impact from ‘vector 3’: economic impact of cyber risk from autonomous ‘robotics in IoT’—quantify cyber risk with ‘Quantitative risk analytics with Monte Carlo and sensitivity analysis’.
Recovery planning for the ‘vector 3’: calculate financial cost from cyber risk from autonomous ‘robotics in IoT’ and determine maximum acceptable ‘level of exposure’ for ‘system recovery’—plan for cyber insurance for the determined ‘level of exposure’.
This example covers only one risk vector and one unit of analysis. The example is appropriate for an enterprise that aims to deploy autonomous robotics in IoT. National high-tech strategies would need to perform all analysis, for all risk vectors, with all units of analysis provided in the epistemological framework in Table 3. It is surprising that national high-tech strategies have not until present performed such analysis. Especially concerning are the findings from the gap analysis in Table 1 which confirms that many of the areas covered by the epistemological framework in Table 3 are not covered in some of the national high-tech national strategies. An example of how such analysis could be performed in provided in Fig. 1 below. This design process follows recommendations from literature , and shows how individual cyber risk components can be integrated into an impact assessment standardisation infrastructure. The epistemological framework is promoting the development of a generally accepted cyber security approach. This is also called for in current research work [11,12,13], because the IoT adoption requires standardisation reference architecture [53, 86, 147, 148] to encompass security and privacy .
Defining the design principles for cyber risk assessment of IoT vectors
In the section above, we propose a new set of design principles for assessing the cyber risk from IoT risk vectors. The principles had been tested through workshops and a comparative study to ensure the process can be applied in real-world practice. The comparative study shows that IoT trends have failed to implement the recovery planning. This is in contradiction with the findings from the second reflection of the empirical study of cyber risk assessment standards, where the recovery planning is strongly emphasised (see: ISO, FAIR, NIST, OCTAVE, TARA). It seems that the IoT high-tech strategies may have overlooked the recommendations from the cyber risk assessment standards. A standardisation approach for IoT impact assessment should firstly consider the new IoT cyber risk vectors derived from the comparative study. Secondly, a standardisation approach should consider the recommendations from the empirical study. The empirical study recommends a decomposition process of assessment standards, conducting grounded theory analysis. This was followed by a compounding of concepts to address individual gaps in cyber risk assessment standards.
The empirical and comparative study investigated the soundness of current cyber risk assessments. The theoretical analysis however, was applied to probe the soundness of the qualitative versus quantitative assessment approaches. Theoretical analysis confirmed that to identify the cost of recovery planning and/or the cost of cyber insurance, a new quantitative model is needed that would anticipate IoT risks. The empirical study analysed the leading quantitative cyber risk models (RiskLens, supported by FAIR; and CyVaR, supported by the World Economic Forum, Deloitte and FAIR). The unifying link between the two cyber risk models was identified as the application of Monte Carlo simulations, for predicting cyber risk uncertainty. A new impact assessment model for the IoT risk vectors, should implement the guidance from RiskLense and CyVaR. The main guidance is that the application of Monte Carlo simulation would reduce the IoT cyber risk uncertainty and enable the approximation and estimation of the economic impact of cyber risk from IoT devices. Such calculation would enable companies to develop appropriate recovery planning and the insurance industry to provide a more realistic cost of cyber insurance.
At a higher analytical level, in Fig. 1 we propose a new set of design principles for assessing the cyber risk from IoT risk vectors. The comparative study of IoT in national high-tech strategies shows that I4.0 trends have failed to implement the recovery planning in the leading national initiatives. This is in contradiction with the findings from the second reflection from the empirical study of the leading cyber risk frameworks, where the recovery planning is strongly emphasised (ISO, FAIR, NIST, Octave, TARA). It seems that the leading high-tech strategies initiatives have ignored the recommendations from the world leading cyber risk frameworks. A new model for IoT risk impact assessment should firstly consider the findings from the comparative study of I4.0 trends, secondly the recommendations from the empirical study of leading cyber risk frameworks. To identify the cost of recovery planning or the cost of cyber insurance, a new quantitative model is needed that would be applicable to IoT cyber risks. There are currently two leading quantitative cyber risk models. First is the RiskLens approach, promoted by FAIR. Second is the Cyber VaR, promoted by the World Economic Forum, Deloitte and more recently by FAIR. The unifying link between the two cyber risk models is the application of Monte Carlo simulations for predicting cyber risk uncertainty. From this study, it appears that a new impact assessment model for the cyber risks from IoT in high-tech national strategies, should start with the guidance from RiskLense and Cyber VaR. The application of Monte Carlo simulation would reduce the IoT cyber risk uncertainty and enable the approximation and estimation of the economic impact of cyber risk from IoT devices. Such calculation would enable companies to develop appropriate recovery planning and the insurance industry to provide a more realistic cost of cyber insurance.
The proposed design principles suggest anticipating recovery planning in the assessment of economic impact of IoT cyber risk. Such approach would enable cyber insurance companies to value the impact of IoT cyber risks in I4.0. The rationale of the proposed design principles is that without appropriate recovery planning, the economic impact can be miscalculated, resulting in greater losses than we anticipated initially. The design principles are developed to advance the existing efforts (from the World Economic Forum, Deloitte, FAIR, etc.) in developing a standardised quantitative approach for assessing the impact of cyber risks. The described design process decomposes the most prominent risk vectors and units of analysis and formulates a generalised set of IoT risk vectors. This does not refer to a complete set of vectors, but to the most prominent risk vectors. Considering that such study has not been conducted until present, the process of integrating the most prominent vectors, with a comparative analysis of the a diverse set of security frameworks and tools, represents the first step in understanding the standardisation process. The design principles in Fig. 1, also present multiple approaches to calculating the economic risk of IoT implementation (e.g. BetaPert, Cyber VaR, RiskLense). This connects the design with the described issues related to the costs of risk.
Case study research is applied for extending, evaluating and comparing the framework with the other frameworks listed in the empirical analysis (Sect. 5.1—Table 2). The industrial case study requesting the participants to apply the framework to their cyber risk assessment of IoT risk. To clarify the participants understanding of the framework, a series of open-ended interviews were performed. The pool of participants interviewed were proportionally representative of different levels of seniority. The initial participants were selected through convenience sampling. Only part of the interviews were predetermined in the initial selection and the rest were chosen based on the development of the case study research. The industrial case study involved series of 20 qualitative interviews, followed by 4 group discussions, two with experts from Cisco Systems in the USA; one with experts from Fujitsu centre for Artificial Intelligence the UK and second with Fujitsu Coelition (I4.0 centre) in the UK. The data collected was transcribed and categorised with aims to investigate the relationship between the notion of IoT and existing cyber risk assessments with their company established approaches (see Table 2 for all approaches investigated and compared in the case study). The aim of the analysis was to verify the ideas behind the epistemological framework and to relate IoT technologies to established models for cyber risk assessment.
The generic diagram from Fig. 1 was presented to the participants and it enables quick comparative analysis of the entire epistemological design process. This enabled practitioners to compare the new framework, with the established cyber risk assessment approaches (in Table 2). The design process for IoT risk assessment (in Fig. 1) is generic and could be applied by other companies and sectors. The generic design outlines a new approach for cyber risk assessment from the IoT. This was considered by the participants as easier to understand and navigate through than the cyber risk assessment approaches (from Table 2). The main feedback from the use cases was that this framework enables easier understanding of the specifics of IoT cyber risk with the direct reference points to the required type of assessment. While the existing cyber risk assessment approaches that were compared (see Table 2) were considered more time demanding. While many comprehensive frameworks and modes are currently in use, from our use case study we determined that many experts do not understand the technicalities and the continuous updates of the established frameworks. The epistemological framework we presented on the use case, was confirmed as easier, quicker, and more practical for the participating practitioners.
The research problem investigated in this article was the present lack of standardised methodology that would measure the cost and probabilities of cyber-attacks in specific IoT related verticals (ex. connected spaces or commercial and industrial IoT equipment) and the economic impact (IoT product, service or platform related) of such cyber risk.
The lack of recovery planning is consistent in all of the high-tech strategies reviewed. Adding to this, the new risks emerging from IoT connected devices and services, and the lack of economic impact assessments from IoT cyber risks, makes it imperative to emphasise the lack of recovery planning. The volume of data generated by the IoT devices creates diverse challenges in variety of verticals (e.g. machine learning, ethics, business models). Simultaneously, to design and build cyber security architecture for complex coupled IoT systems, while understanding the economic impact, demands bold new solutions for optimisation and decision making . Much of the research is application-oriented and by default interdisciplinary, requiring hybrid research in different academic areas. Hybrid and interdisciplinary approaches are required, for the design of cyber risk assessment that integrate economic impact from IoT verticals. Such design must meet public acceptability, security standards, and legal scrutiny.
As a result of the fast growth of the IoT, cyber risk finance and insurance markets are lacking empirical data to construct actuarial tables. Despite the development of models related to the impact of cyber risk, there is a lack of such models related to specific IoT verticals. Hence, banks and insurers are unable to price IoT cyber risk with the same precision as in traditional insurance lines. Even more concerning, the current macroeconomic costs estimates of cyber-attacks related to IoT products, services and platforms are entirely speculative. The approach by ‘early adopters’ that IoT products are ‘secure by default’ is misleading. Even governments advocate security standards ex. standards like ISA 99, or C2M2 [129, 149] that accept that the truth on the ground is that IoT devices are unable to secure themselves, so the logical placement of security capability is in the communications network.
This article decomposes the cyber risk assessment standards and combines concepts for the purposes of building a model for the standardisation of impact assessment approaches. The model enables the implementation of two current problems with assessing cyber risk from IoT devices. First, the model enables identifying and capturing the IoT cyber risk from different risk vectors. Second, the model offers new design principles for assessing cyber risk. The analysis in this paper was focused on understanding the best approach for quantifying the impact of cyber risk in the IoT space. The model and the documented process represents a new design for mapping IoT risk vectors and optimising IoT risk impact assessment.
The model proposes a process for adapting existing cyber security practices and standards to include IoT cyber risk. Despite the interest to standardise existing cyber risk frameworks, models and methodologies, this has not been done until present. Standardisation framework currently does not exist in literature and the epistemological framework represents the first attempt to define the standardisation process for cyber risk impact assessment of IoT vectors. This article applies empirical (via literature reviews and workshops) and comparative studies with theoretical analysis and the grounded theory to define a process of standardisation of cyber risk impact assessment approaches. The study advances the efforts of integrating standards and governance on IoT cyber risk and offers a better understanding of a holistic impact assessment approach for cyber risk. The documented process represents a new design for mapping and optimising IoT cyber security.
The empirical study defined the gaps in current cyber risk assessment frameworks, models and methodologies. The identified gaps are analysed to define a process of decomposing risks and compounding assessment concepts, to address the gaps in cyber risk standards. The comparative study defines the IoT cyber risk vectors which are not anticipated or considered in existing cyber risk assessment standards. The epistemological analysis adapts the current cyber security standards and defines the principles for integrating specific IoT risk vectors in a holistic impact assessment framework. It is anticipated that the analysis of the complete economic impact of data compromise of IoT risk vectors, would empower the communications network providers to create clear, rigorous, industry-accepted mechanisms to measure, control, analyse, distribute and manage critical data needed to develop, deploy and operate cost-effective cyber security for critical infrastructure. The research design identifies and captures the IoT cyber risk vectors and defines a framework for adapting existing cyber risk standards to include IoT cyber risk.
Limitations and further research
The epistemological framework in this article is derived from empirical and comparative studies, supported with theoretical analysis of a limited set of frameworks, models, methodologies and high-tech strategies. The set selection was based on documented availability and on relevance to cyber risk impact assessment of IoT risk vectors. Holistic analysis of all risk assessment approaches was considered beyond the scope of this study. Additional research is required to integrate the knowledge from other studies.
Ezell BC, Bennett SP, von Winterfeldt D, Sokolowski J, Collins AJ (2010) Probabilistic risk analysis and terrorism risk. Risk Anal 30(4):575–589
Davis G, Garcia A, Zhang W (2009) Empirical analysis of the effects of cyber security incidents. Risk Anal 29(9):1304–1316
Ganin AA, Quach P, Panwar M, Collier ZA, Keisler JM, Marchese D, Linkov I (2017) Multicriteria decision framework for cybersecurity risk assessment and management. Risk Anal. https://doi.org/10.1111/risa.12891
Choi T-M, Lambert JH (2017) Advances in risk analysis with big data. Risk Anal 37(8):1435–1442
Gisladottir V, Ganin AA, Keisler JM, Kepner J, Linkov I (2017) Resilience of cyber systems with over- and underregulation. Risk Anal 37(9):1644–1651
Andrijcic E, Horowitz B (2006) A macro-economic framework for evaluation of cyber security risks related to protection of intellectual property. Risk Anal 26(4):907–923
Henry MH, Haimes YY (2009) A comprehensive network security risk model for process control networks. Risk Anal 29(2):223–248
Haimes YY (2018) Risk modeling of interdependent complex systems of systems: theory and practice. Risk Anal 38(1):84–98
Santos JR, Haimes YY, Lian C (2007) A framework for linking cybersecurity metrics to the modeling of macroeconomic interdependencies. Risk Anal 27(5):1283–1297
Malhotra Y (2017) Advancing cyber risk insurance underwriting model risk management beyond VaR to pre-empt and prevent the forthcoming global cyber insurance crisis
Radanliev P et al (2018) Integration of cyber security frameworks, models and approaches for building design principles for the internet-of-things in industry 4.0. In: Living in the internet of things: cybersecurity of the IoT, p 41
Radanliev P, De Roure D, Cannady S, Montalvo R, Nicolescu R, Huth M (2018) Economic impact of IoT cyber risk—analysing past and present to predict the future developments in IoT risk analysis and IoT cyber insurance. In: Living in the internet of things: cybersecurity of the IoT—2018, no. CP740, p 3
Nurse J, Creese S, De Roure D (2017) Security risk assessment in internet of things systems. IT Prof 19(5):20–26
Nurse JRC, Radanliev P, Creese S, De Roure D (2018) Realities of risk: ‘If you can’t understand it, you can’t properly assess it!’: the reality of assessing security risks in Internet of Things systems. In: Living in the internet of things: cybersecurity of the IoT—2018, pp 1–9
Mitic P (2019) Adaptive risk consensus models: simulations and applications. SN Appl Sci 1(12):1743
Atzori L, Iera A, Morabito G, Nitti M (2012) The social internet of things (SIoT)—when social networks meet the internet of things: concept, architecture and network characterization. Comput Netw 56(16):3594–3608
Ortiz AM, Hussein D, Park S, Han SN, Crespi N (2014) The cluster between internet of things and social networks: review and research challenges. IEEE Internet Things J 1(3):206–215
Hussein D, Han SN, Lee GM, Crespi N, Bertin E (2017) Towards a dynamic discovery of smart services in the social internet of things. Comput Electr Eng 58:429–443
Peasley S, Waslo R, Lewis T, Hajj R, Carton R (2017) Industry 4.0 and cybersecurity managing risk in an age of connected production
IIC (2017) The industrial internet of things volume G5: connectivity framework; industrial internet consortium
Paté-Cornell M-E, Kuypers M, Smith M, Keller P (2018) Cyber risk management for critical infrastructure: a risk analysis model and three case studies. Risk Anal 38(2):226–241
Khorshidi E, Ghezavati VR (2019) Application of mathematical modeling value-at-risk (VaR) to optimize decision making in distribution networks. SN Appl Sci 1(12):1671
Radanliev P et al (2019) Definition of cyber strategy transformation roadmap for standardisation of IoT risk impact assessment with a goal-oriented approach and the internet of things micro mart. University of Oxford combined working papers and project reports prepared for the PETRAS National Centre of Excellence and the Cisco Research Centre, Oxford
Radanliev P et al (2018) Future developments in cyber risk assessment for the internet of things. Comput Ind 102:14–22
Wan J, Chen M, Xia F, Di L, Zhou K (2013) From machine-to-machine communications towards cyber-physical systems. Comput Sci Inf Syst 10(3):1105–1128
Stojmenovic I (2014) Machine-to-machine communications with in-network data aggregation, processing, and actuation for large-scale cyber-physical systems. IEEE Internet Things J 1(2):122–128
Drath R, Horch A (2014) Industrie 4.0: hit or hype? [industry forum]. IEEE Ind Electron Mag 8(2):56–58
Lee J, Bagheri B, Kao H-A (2015) A cyber-physical systems architecture for industry 4.0-based manufacturing systems
Leitão P, Colombo AW, Karnouskos S (2016) Industrial automation based on cyber-physical systems technologies: prototype implementations and challenges. Comput Ind 81:11–25
Marwedel P, Engel M (2016) Cyber-physical systems: opportunities, challenges and (some) solutions. Springer, Berlin, pp 1–30
Shafiq SI, Sanin C, Szczerbicki E, Toro C (2015) Virtual engineering object/virtual engineering process: a specialized form of cyber physical system for Industrie 4.0. Procedia Comput Sci 60:1146–1155
Posada J et al (2015) Visual computing as a key enabling technology for Industrie 4.0 and industrial internet. IEEE Comput Graph Appl 35(2):26–40
Brettel M, Fischer FG, Bendig D, Weber AR, Wolff B (2016) Enablers for self-optimizing production systems in the context of Industrie 4.0. Procedia CIRP 41:93–98
Evans A (2019) Managing cyber risk. Taylor and Francis, London
Kashyap AK, Wetherilt A (2019) Some principles for regulating cyber risk. AEA Pap Proc 109:482–487
Rodewald G (2005) Aligning information security investments with a firm’s risk tolerance. In: Proceedings of the 2nd annual conference on information security curriculum development—InfoSecCD’05, p 139
DiMase D, Collier ZA, Heffner K, Linkov I (2015) Systems engineering framework for cyber physical security and resilience. Environ Syst Decis 35(2):291–300
Radanliev P, De Roure DC, Nurse JRC, Montalvo RM, Burnap P (2019) Standardisation of cyber risk impact assessment for the Internet of Things (IoT). University of Oxford combined working papers and project reports prepared for the PETRAS National Centre of Excellence and the Cisco Research Centre, Oxford
Radanliev P et al (2019) Cyber risk from IoT technologies in the supply chain—decision support system for the Industry 4.0. University of Oxford combined working papers and project reports prepared for the PETRAS National Centre of Excellence and the Cisco Research Centre, Oxford
Axon L, Alahmadi B, Nurse JRC, Goldsmith M, Creese S (2018) Sonification in security operations centres: what do security practitioners think?. In: Proceedings of the workshop on usable security (USEC) at the network and distributed system security (NDSS) symposium, pp 1–12
Radanliev P et al (2019) New developments in cyber physical systems, the internet of things and the digital economy—future developments in the industrial internet of things and Industry 4.0. University of Oxford combined working papers and project reports prepared for the PETRAS National Centre of Excellence and the Cisco Research Centre, Oxford (preprints)
Radanliev P et al (2019) Design principles for cyber risk impact assessment from Internet of Things (IoT). University of Oxford combined working papers and project reports prepared for the PETRAS National Centre of Excellence and the Cisco Research Centre, Oxford
Radanliev P et al (2019) Cyber risk impact assessment—assessing the risk from the IoT to the digital economy. University of Oxford combined working papers and project reports prepared for the PETRAS National Centre of Excellence and the Cisco Research Centre, Oxford (preprints)
Radanliev P, De Roure D, Nicolescu R, Huth M (2019) A reference architecture for integrating the Industrial Internet of Things in the Industry 4.0. University of Oxford combined working papers and project reports prepared for the PETRAS National Centre of Excellence and the Cisco Research Centre, Oxford
Radanliev P et al (2019) Definition of internet of things (IoT) cyber risk—discussion on a transformation roadmap for standardisation of regulations, risk maturity, strategy design and impact assessment. Oxford, preprints, arXiv:201903.0080.v1
Radanliev P, Charles De Roure D, Nurse JRC, Burnap P, Montalvo RM (2019) Methodology for designing decision support supply chain systems for visualising and mitigating cyber risk from IoT technologies. University of Oxford combined working papers and project reports prepared for the PETRAS National Centre of Excellence and the Cisco Research Centre, Oxford
Ruan K (2017) Introducing cybernomics: a unifying economic framework for measuring cyber risk. Comput Secur 65:77–89
Shackelford SJ (2016) Protecting intellectual property and privacy in the digital age: the use of national cybersecurity strategies to mitigate cyber risk. Chapman Law Rev 19:412–445
Hamilton BA (2014) Cyber power index: findings and methodology. Booz Allen Hamilton, McLean
Amintoosi H, Taresh AJ (2019) Sparse coding-based feature extraction for biometric remote authentication in Internet of Things. SN Appl Sci 1(9):1098
Anderson G (2016) The economic impact of technology infrastructure for smart manufacturing. NIST Econ Anal Briefs 4:1–5
Ribeiro L, Barata J, Ferreira J (2010) An agent-based interaction-oriented shop floor to support emergent diagnosis. In: 2010 8th IEEE international conference on industrial informatics, pp 189–194
Weyer S, Schmitt M, Ohmer M, Gorecky D (2015) Towards Industry 4.0-standardization as the crucial challenge for highly modular, multi-vendor production systems. IFAC-PapersOnLine 48(3):579–584
Hussain F (2017) Internet of things. Building blocks and business models. SpringerBriefs in Electrical and Computer Engineering (BRIEFSELECTRIC). https://doi.org/10.1007/978-3-319-55405-1
Wang L (2013) Machine availability monitoring and machining process planning towards Cloud manufacturing. CIRP J Manuf Sci Technol 6(4):263–273
Ghirardello K, Maple C, Ng D, Kearney P (2018) Cyber security of smart homes: development of a reference architecture for attack surface analysis. In: Living in the internet of things: cybersecurity of the IoT—2018, 2018, p 45
Anthi E, Williams L, Burnap P (2018) Pulse: an adaptive intrusion detection for the internet of things. In: Living in the internet of things: cybersecurity of the IoT, 2018, p 35
Safa NS, Maple C, Watson T, Von Solms R (2018) Motivation and opportunity based model to reduce information security insider threats in organisations. J Inf Secur Appl 40:247–257
Sokolov B, Ivanov D (2015) Integrated scheduling of material flows and information services in industry 4.0 supply networks. IFAC-PapersOnLine 48(3):1533–1538
Benveniste A (2010) Loosely time-triggered architectures for cyber-physical systems. In: 2010 design, automation and test in Europe conference and exhibition Dresden, pp 3–8
Benveniste A, Bouillard A, Caspi P (2010) A unifying view of loosely time-triggered architectures. In: Proceedings of the tenth ACM international conference on embedded software—EMSOFT’10, p 189
Evans PC, Annunziata M (2012) Industrial internet: pushing the boundaries of minds and machines. General Electric
Banjanovic-Mehmedovic L, Zukic M, Mehmedovic F (2019) Alarm detection and monitoring in industrial environment using hybrid wireless sensor network. SN Appl Sci 1(3):263
Medina-García J, Sánchez-Rodríguez T, Galán JAG, Delgado A, Gómez-Bravo F, Jiménez R (2017) A wireless sensor system for real-time monitoring and fault detection of motor arrays. Sensors (Switzerland) 17(3):469
Feroz Khan AB, Anandharaj G (2019) A cognitive key management technique for energy efficiency and scalability in securing the sensor nodes in the IoT environment: CKMT. SN Appl Sci 1(12):1575
Giordano A, Spezzano G, Vinci A (2016) A smart platform for large-scale cyber-physical systems. Springer, Berlin, pp 115–134
Waslo R, Lewis T, Hajj R, Carton R (2017) Industry 4.0 and cybersecurity in the age of connected production | Deloitte University Press. Deloitte University Press. https://dupress.deloitte.com/dup-us-en/focus/industry-4-0/cybersecurity-managing-risk-in-age-of-connected-production.html. Accessed 04 Aug 2017
Bhave A, Krogh B, Garlan D, Schmerl B (2010) Multi-domain modeling of cyber-physical systems using architectural views. In: Proc. Anal. Virtual Integr. Cyber-Physical Syst. Work
Zhu Q, Rieger C, Basar T (2011) A hierarchical security architecture for cyber-physical systems. In: 2011 4th international symposium on resilient control systems, pp 15–20
Gladson SC, Narayana AH, Bhaskar M (2019) An ultra-low-power low-noise amplifier using cross-coupled positive feedback for 5G IoT applications. SN Appl Sci 1(11):1418
Niggemann O, Biswas G, Kinnebrew JS, Khorasgani H, Volgmann S, Bunte A (2015) Data-driven monitoring of cyber-physical systems leveraging on big data and the internet-of-things for diagnosis and control. In: International workshop on the principles of diagnosis (DX), pp 185–192
Almeida L, Santos F, Oliveira L (2016) Structuring communications for mobile cyber-physical systems. Springer, Berlin, pp 51–76
Nicolescu R, Huth M, Radanliev P, De Roure D (2018) Mapping the values of IoT. J Inf Technol 33(4):345–360. https://doi.org/10.1057/s41265-018-0054-1
Taylor P, Allpress S, Carr M, Lupu E, Norton J, Smith L et al (2018) Internet of things realising the potential of a trusted smart world. Royal Academy of Engineering, London
Nicolescu R, Huth M, Radanliev P, De Roure D (2018) State of the Art in IoT—beyond economic value, London
Ruffle SJ et al (2014) Stress test scenario: sybil logic bomb cyber catastrophe. Cambridge risk framework series. Center for Risk Studies, University of Cambridge, Cambridge
Ibrahim H et al (2019) A layered IoT architecture for greenhouse monitoring and remote control. SN Appl Sci 1(3):223
Hall W, Tiropanis T (2012) Web evolution and web science. Comput Netw 56:3859–3865
Van Kleek M et al (2018) X-ray refine. In: Proceedings of the 2018 CHI conference on human factors in computing systems—CHI’18, pp 1–13
Hermann M, Pentek T, Otto B (2016) Design principles for Industrie 4.0 scenarios. In: 2016 49th Hawaii international conference on system sciences (HICSS), 2016, pp 3928–3937
Anthonysamy P, Rashid A, Chitchyan R (2017) Privacy requirements: present and future. In: 2017 IEEE/ACM 39th international conference on software engineering: software engineering in society track (ICSE-SEIS), 2017, pp 13–22
Esteve A (2017) The business of personal data: Google, Facebook, and privacy issues in the EU and the USA. Int Data Priv Law 7(1):36–47
Hindman M (2018) How Cambridge Analytica’s Facebook targeting model really worked—according to the person who built it
Arnold CC, Teppler SW (2018) Class action complaint against defendants Facebook, Inc. and Cambridge analytica, pp 1–15
Thramboulidis K (2015) A cyber–physical system-based approach for industrial automation systems. Comput Ind 72:92–102
Wahlster W et al (2013) Recommendations for implementing the strategic initiative INDUSTRIE 4.0. Federal Ministry of Educational Research
Toro C, Barandiaran I, Posada J (2015) A perspective on knowledge based and intelligent systems implementation in Industrie 4.0. Procedia Comput Sci 60:362–370
Wan J, Cai H, Zhou K (2015) Industrie 4.0: enabling technologies. In: Proceedings of 2015 international conference on intelligent computing and internet of things, 2015, pp 135–140
Kolberg D, Zühlke D (2015) Lean automation enabled by Industry 4.0 Technologies. IFAC-PapersOnLine 48(3):1870–1875
Steup M (2005) Epistemology: Stanford encyclopedia of philosophy. Stanford University, Center for the Study of Language and Information (U.S.), Stanford
Wenning CJ (2009) Scientific epistemology: how scientists know what they know. J Phys Teach Educ Online 5(2):3–16
MEICA (2015) Industria Conectada 4.0: La transformación digital de la industria española Dossier de prensa; Ministry of Economy Industry and Competitiveness Accessibility, Madrid
Liao Y, Deschamps F, Loures EDFR, Ramos LFP (2017) Past, present and future of Industry 4.0—a systematic literature review and research agenda proposal. Int J Prod Res 55(12):3609–3629
IVI (2017) Industrial value chain reference architecture; industrial value chain initiative, Hannover, Germany
Catapult UK (2017) The catapult programme—catapult. https://catapult.org.uk/. Accessed 13 May 2017
MIUR (2014) Italian technology cluster: intelligent factories; Ministry of Education Universities and Research. Cluster Tecnologico Nazionale Fabbrica Intelligente | Imprese, università, organismi di ricerca, associazioni e enti territoriali: insieme per la crescita del Manifatturiero. http://www.fabbricaintelligente.it/en/. Accessed 09 May 2017
GTAI (2014) Industrie 4.0 smart manufacturing for the future, Berlin
IIC (2016) The industrial internet of things, volume B01: business strategy and innovation framework; industrial internet consortium
NIF (2016) New industrial France: building France’s industrial future—updated text from the 2013 version, Paris
John P (2017) High value manufacturing catapult, Solihull
A. for strategic initiatives ASI, National Technology initiative, Agency for Strategic Initiatives, Government of Russia, 2016. https://asi.ru/eng/nti/. Accessed 10 May 2017
SCPRC (2017) Made in China 2025; The State Council People Republic of China. www.english.gov.cn; http://english.gov.cn/2016special/madeinchina2025/. Accessed 10 May 2017
Sirris, Agoria (2017) Made different: factory of the future 4.0. http://www.madedifferent.be/en/what-factory-future-40. Accessed 09 May 2017
Bouws T et al (2015) Smart industry: Dutch industry fit for the future. Ministry of Foreign Affairs, Delft, Netherlands
G20 (2016) G20 new industrial revolution action plan
Kim J (2017) Are countries ready for the new meso revolution? Testing the waters for new industrial change in Korea. Technol Forecast Soc Change 132:34–39
Industrie 4.0 (2017) Plattform Industrie 4.0—testbeds. http://www.plattform-i40.de/I40/Navigation/EN/InPractice/Testbeds/testbeds.html. Accessed 13 May 2017
DCMS (2017) UK Digital Strategy 2017—GOV.UK; Department for Culture, Media and Sport, London
IVI. Industrial Value Chain Initiative (2016) An outline of smart manufacturing scenarios 2016. In: Monozukuri Nippon conference
AMP (2013) Advanced manufacturing partnership
METI (2015) NRS, new robot strategy—vision strategy and action plan; ministry of economy trade and industry of Japan
METIJ (2015) RRI, robot revolution initiative—summary of Japan’s robot strategy—it’s vision, strategy and action plan. Ministry of Economy, Trade and Industry of Japan
Glaser BG, Strauss AL (1967) The discovery of grounded theory : strategies for qualitative research. Routledge, Abingdon
NIST C (2016) Cybersecurity framework | NIST
Caralli RA, Stevens JF, Young LR, Wilson WR (2007) Introducing octave allegro: improving the information security risk assessment process. Hansom AFB, Bedford
Wynn J et al (2011) Threat assessment and remediation analysis (TARA) methodology description version 1.0, Bedford, MA
FIRST (2017) CVSS v3.0 specification document. https://www.first.org/cvss/specification-document#8-4-Metrics-Levels. Accessed 03 Oct 2017
CMMI (2017) What is capability maturity model integration (CMMI)®? | CMMI Institute. CMMI Institute, 2017. http://cmmiinstitute.com/capability-maturity-model-integration. Accessed 26 Dec 2017
CVSS (2017) Common vulnerability scoring system SIG, FIRST.org, 2017. https://www.first.org/cvss/. Accessed 26 Dec 2017
Radanliev P (2014) A conceptual framework for supply chain systems architecture and integration design based on practice and theory in the North Wales slate mining industry. British Library
Radanliev P, De Roure DC, Nurse JRC, Montalvo RM, Burnap P (2019) The industrial internet-of-things in the Industry 4.0 supply chains of small and medium sized enterprises. University of Oxford combined working papers and project reports prepared for the PETRAS National Centre of Excellence and the Cisco Research Centre, Oxford
Radanliev P (2015) Green-field architecture for sustainable supply chain strategy formulation. Int J Supply Chain Manag 4(2):62–67
Radanliev P (2015) Architectures for green-field supply chain integration. J Supply Chain Oper Manag 13(2):56–78
Radanliev P (2015) Engineering design methodology for green-field supply chain architectures taxonomic scheme. J Oper Supply Chain Manag 8(2):52–66
Radanliev P, Rowlands H, Thomas A (2014) Supply chain paradox: green-field architecture for sustainable strategy formulation. In: Cardiff: sustainable design and manufacturing 2014, part 2, international conference, 2014, pp 839–850
Radanliev P, De Roure DC, Nurse JRC, Rafael MM, Burnap P (2019) Supply chain design for the industrial internet of things and the Industry 4.0. University of Oxford combined working papers and project reports prepared for the PETRAS National Centre of Excellence and the Cisco Research Centre, Oxford
Radanliev P (2016) Supply chain systems architecture and engineering design: green-field supply chain integration. Oper Supply Chain Manag Int J 9(1):22–30
Shaw R, Takanti V, Zullo T, Director M, Llc E (2017) Best practices in cyber supply chain risk management boeing and exostar cyber security supply chain risk management interviews
U.S. Department of Energy (2014) Cybersecurity capability maturity model (C2M2). Department of Energy, Washington
Barrett M, Marron J, Yan Pillitteri V, Boyens J, Witte G, Feldman L (2017) Draft NISTIR 8170, the cybersecurity framework: implementation guidance for federal agencies, Maryland
NIST (2014) Framework for improving critical infrastructure cybersecurity
FAIR (2017) Quantitative information risk management | The FAIR Institute. Factor analysis of information risk, 2017. http://www.fairinstitute.org/. Accessed 26 Dec 2017
RiskLens (2017) Risk analytics platform | FAIR Platform Management, 2017. https://www.risklens.com/platform. Accessed 26 Dec 2017
FAIR (2017) What is a cyber value-at-risk model?. http://www.fairinstitute.org/blog/what-is-a-cyber-value-at-risk-model. Accessed 26 Dec 2017
ISO (2017) ISO—International Organization for Standardization. https://www.iso.org/home.html. Accessed 26 Dec 2017
Allodi L, Massacci F (2017) Security events and vulnerability data for cybersecurity risk estimation. Risk Anal 37(8):1606–1627
Öğüt H, Raghunathan S, Menon N (2011) Cyber security risk management: public policy implications of correlated risk, imperfect ability to prove loss, and observability of self-protection. Risk Anal 31(3):497–512
Johnson C, Badger L, Waltermire D, Snyder J, Skorupka C (2016) Guide to cyber threat information sharing. NIST Special Publication 800–150. U.S. Department of Commerce. https://doi.org/10.6028/NIST.SP.800-150
Conee E, Feldman R (2004) Evidentialism. Oxford University Press, Oxford
Mittag MD (2011) The internet encyclopedia of philosophy, ISSN 2161. University of Rochester: Internet Encyclopedia of Philosophy Pub
Pugh S (1991) Total design: integrated methods for successful product engineering. Addison-Wesley Publishing Company, p 278
Eggenschwiler J, Agrafiotis I, Nurse JR (2016) Insider threat response and recovery strategies in financial services firms. Comput Fraud Secur 2016(11):12–19
de Reuver M, Sørensen C, Basole RC (2017) The digital platform: a research agenda. J Inf Technol 33(2):1–12. https://doi.org/10.1057/s41265-016-0033-3
Eriksson P, Kovalainen A (2008) Qualitative methods in business research. Sage, London
Goulding C (2002) Grounded theory: a practical guide for management, business and market researchers. Sage, London
Strader TJ, Lin F-R, Shaw MJ (1999) Business-to-business electronic commerce and convergent assembly supply chain management. J Inf Technol 14(4):361–373
Ahmed SH, Kim G, Kim D (2013) Cyber physical system: architecture, applications and research challenges. In: 2013 IFIP wireless days (WD), 2013, pp 1–5
Stock T, Seliger G (2016) Opportunities of sustainable manufacturing in Industry 4.0. Procedia CIRP 40:536–541
U.S. Department of Energy (2015) Energy sector cybersecurity framework implementation guidance
Sincere gratitude to the Fulbright Project.
This work was supported by the UK EPSRC [project grant number: EP/S035362/1, EP/N023013/1, EP/N02334X/1] and by the Cisco Research Centre [Project grant number: 1525381]. Earlier versions of this work from the combined working papers and project reports prepared for the PETRAS National Centre of Excellence and the Cisco Research Centre can be found in a pre-print online .
Conflict of interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Radanliev, P., De Roure, D.C., Nurse, J.R.C. et al. Future developments in standardisation of cyber risk in the Internet of Things (IoT). SN Appl. Sci. 2, 169 (2020). https://doi.org/10.1007/s42452-019-1931-0
- Cyber risk
- Internet of Things cyber risk
- Internet of Things risk vectors
- Standardisation of cyber risk assessment
- Economic impact assessment