Skip to main content

Implementation of an Organic Database Structure for Population-Based Structural Health Monitoring

  • Conference paper
  • First Online:
Dynamics of Civil Structures, Volume 2

Abstract

Population-based Structural Health Monitoring (PBSHM) considers grouping multiple structures into a single population, thus allowing additional insight to be gained from SHM feature data as a whole, compared to insights gained for any individual structure. Current data storage methodologies for SHM often operate from a single structure point of view. Different types of data can often be stored in different systems, files, structures and languages. This approach means that bespoke methodologies must be developed for any new SHM application, making analysing and processing of SHM data costly. The advantage of the proposed unified approach is the facilitation of information sharing across populations of structures, a key principle in PBSHM. A generic pool of methodologies can then be developed, allowing any set of PBSHM data to be quickly and efficiently analysed and processed, bringing down the total cost of running a system.

In this paper a PBSHM schema is defined to store multiple populations of PBSHM data inside a NoSQL database via a Time First approach. The schema allows a single database that organically grows as more data/knowledge about the population becomes available. As everything is grouped by Time, the approach allows previously unknown data relationships to be easily viewed. In this paper the PBSHM schema is implemented in a MongoDB database and sensor data are added into the system to show the ease of use of a standardised data schema.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Encrypted Storage Engines are available as of MongoDB 3.2 Enterprise [10, 11].

  2. 2.

    Sharding is a method of splitting data across multiple database instances.

  3. 3.

    When using JavaScript to interact with the PBSHM Schema, there will be a loss of accuracy in the timestamps due to JavaScript only supporting 53 bytes in an Int64. This will also affect any interactions within the MongoDB Compass GUI tool as at the time of publishing this paper it is implemented in JavaScript.

  4. 4.

    The file for installation within MongoDB is structure-data-compiled-mongodb.min.json.

References

  1. Worden, K., Cross, E.J., Dervilis, N., Papatheou, E., Antoniadou, I.: Structural health monitoring: from structures to systems-of-systems. Int. Fed. Autom. Control 48(21), 1–17 (2015)

    Google Scholar 

  2. Bull, L.A., Gardner, P.A., Gosliga, J., Rogers, T.J., Dervilis, N., Cross, E.J., Papatheou, E., Maguire, A.E., Campos, C., Worden, K.: Foundations of population-based SHM, Part I: homogeneous populations and forms. Mech. Syst. Signal Process. 148, 107141 (2020)

    Article  Google Scholar 

  3. Worden, K., Bull, L.A., Gardner, P.A., Gosliga, J., Rogers, T.J., Cross, E.J., Papatheou, E., Lin, W., Dervilis, N.: A brief introduction to recent developments in population-based structural health monitoring. Frontiers (2020). https://doi.org/10.3389/fbuil.2020.00146

  4. Jeong, S., Byun, J., Kim, D., Sohn, H., Bae, H., Law, K.H.: A data management infrastructure for bridge monitoring. In: SPIE - The International Society for Optical Engineering (2015)

    Google Scholar 

  5. Wickramarachchi, C., Brennan, D.S., Weijiang, L., Harvey, D., Cross, E.J., Worden, K.: Towards a Population-Based Structural Health Monitoring: Part V, networks and databases. In: IMAC XXXIX (2021)

    Google Scholar 

  6. Codd, E.F.: A relational model of data for large shared data banks. 13(6), 377–387 (1970)

    Google Scholar 

  7. Nance, C., Losser, T., Iype, R., Harmon, G.: NoSQL vs RDBMS - Why there is room for both. In: SAIS 2013 Proceedings, vol. 27 (2013)

    Google Scholar 

  8. Zafar, R., Yafi, E., Zuhairi, M.F., Dao, H.: Big Data: The NoSQL and RDBMS review. In: International Conference on Information and Communication Technology (2016)

    Google Scholar 

  9. Gandini, A., Gribaudo, M., Knottenbelt, W.J., Osman, R., Piazzolla, P.: Performance evaluation of NoSQL databases. In: European Workshop on Performance Engineering (2014)

    Google Scholar 

  10. Bradshaw, S., Brazil, E., Chodorow, K.: MongoDB: The Definitive Guide, 3rd edn. O’Reilly, Sebastopol (2019)

    Google Scholar 

  11. MongoDB, Inc.: Encryption at Rest - MongoDB Manual. Accessed 6 April 2020

    Google Scholar 

  12. MongoDB, Inc.: Users - MongoDB Manual. Accessed 6 April 2020

    Google Scholar 

  13. MongoDB, Inc.: TLS/SSL (Transport Encryption) - MongoDB Manual. Accessed 6 April 2020

    Google Scholar 

  14. Codd, E.F.: Further normalization of the data base relational model. In: Rustin, R. (ed.) Data Base Systems (Courant Computer Science Symposia 6). Prentice-Hall, Englewood Cliffs (1972)

    Google Scholar 

  15. Crawford, D.: Technical correspondence. Commun. ACM 36(10), 19 (1993)

    Article  Google Scholar 

  16. MongoDB, Inc. About Us - MongoDB. Accessed 9 April 2020

    Google Scholar 

  17. Bray,T.: RFC 7159 - The JavaScript Object Notation (JSON) Data Interchange Format. Accessed 15 April 2020

    Google Scholar 

  18. Bray, T.: RFC 8259 - The JavaScript Object Notation (JSON) Data Interchange Format. Accessed 15 April 2020

    Google Scholar 

  19. MongoDB, Inc.: Role-Based Access Control - MongoDB Manual. Accessed 6 April 2020

    Google Scholar 

  20. MongoDB, Inc.: Storage Engines - MongoDB Manual. Accessed 6 April 2020

    Google Scholar 

  21. MongoDB, Inc.: WiredTiger Storage Engine - MongoDB Manual. Accessed 6 April 2020

    Google Scholar 

  22. MongoDB, Inc.: Indexes - MongoDB Manual. Accessed 15 April 2020

    Google Scholar 

  23. MongoDB, Inc.: Replication - MongoDB Manual. Accessed 15 April 2020

    Google Scholar 

  24. MongoDB, Inc.: Sharding - MongoDB Manual, Accessed 15th April, 2020.

    Google Scholar 

  25. MongoDB, Inc.: Data Modeling Introduction - MongoDB Manual. Accessed 6 April 2020

    Google Scholar 

  26. MongoDB, Inc.: Normalized Data Models - MongoDB Manual. Accessed 16 April 2020

    Google Scholar 

  27. MongoDB, Inc.: Embedded Data Models - MongoDB Manual. Accessed 16 April 2020

    Google Scholar 

  28. MongoDB, Inc.: MongoDB Limits and Thresholds - MongoDB Manual. Accessed 6 April 2020

    Google Scholar 

  29. MongoDB, Inc.: Install MongoDB - MongoDB Manual. Accessed 18 May 2020

    Google Scholar 

Download references

Acknowledgements

The authors of this paper gratefully acknowledge the support of the UK Engineering and Physical Sciences Research Council (EPSRC) through grant references EP/J016942/1, EP/K003836/2 and EP/S001565/1. The authors would also like to thank Vattenfall and Eoghan Maguire for providing the data set used within this paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Daniel S. Brennan .

Editor information

Editors and Affiliations

Appendices

Appendix 1: Non-organic Basic Schema

Please note that the example below uses the MongoDB bsonType instead of the JSON

Appendix 2: Organic Basic Schema

Please note that the example below uses the MongoDB bsonType instead of the JSON

Appendix 3: Accepted Channel Objects Within the v1.0 Schema

Types

Units

Values

acceleration

m/s 2, g, v, other

int, double, object

velocity

m/s, v, other

int, double, object

displacement

mm, cm, m, km, other

int, double, object

angularAcceleration

degrees/s 2, radians/s 2, other

int, double, object

angularVelocity

degrees/s, radians/s, other

int, double, object

angularDisplacement

degrees, radians, other

int, double, object

tilt

degrees, radians, other

int, double, object

strain

nd, other

int, double, object

tension

fN, pN, nN, μN, mN, cN, dN, N, daN, hN, kN, MN, GN, TN, PN, other

int, double, object

load

fN, pN, nN, μN, mN, cN, dN, N, daN, hN, kN, MN, GN, TN, PN, other

int, double, object

structuralPotentialHydrogen

pH, other

int, double, object

temperature

C, F, K, other

int, double, object

humidity

%, other

int, double, object

speed

mph, ft/s, km/h, m/s, kn, other

int, double, object

direction

degrees, radians, other

int, double, object

pressure

fPa, pPa, nPa, μPa, mPa, cPa, dPa, Pa, daPa, hPa, kPa, MPa, GPa, TPa, PPa, at, atm, bar, psi, other

int, double, object

altitude

mm, cm, m, km, feet, other

int, double, object

pitch

degrees, radians, other

int, double, object

yaw

degrees, radians, other

int, double, object

roll

degrees, radians, other

int, double, object

pitchRate

degrees/s, radians/s, other

int, double, object

yawRate

degrees/s, radians/s, other

int, double, object

rollRate

degrees/s, radians/s, other

int, double, object

current

fA, pA, nA, μA, mA, cA, dA, A, daA, hA, kA, MA, GA, TA, PA, other

int, double, object

charge

fC, pC, nC, μC, mC, cC, dC, C, daC, hC, kC, MC, GC, TC, PC, other

int, double, object

power

fW, pW, nW, μW, mW, cW, dW, W, daW, hW, kW, MW, GW, TW, PW, other

int, double, object

voltage

fV, pV, nV, μV, mV, cV, dV, V, daV, hV, kV, MV, GV, TV, PV, other

int, double, object

resistance

fΩ, pΩ, nΩ, μ Ω, mΩ, cΩ, dΩ, Ω, daΩ, hΩ, kΩ, MΩ, GΩ, TΩ, PΩ, other

int, double, object

capacitance

fF, pF, nF, μF, mF, cF, dF, F, daF, hF, kF, MF, GF, TF, PF, other

int, double, object

inductance

fH, pH, nH, μH, mH, cH, dH, H, daH, hH, kH, MH, GH, TH, PH, other

int, double, object

frequency

fHz, pHz, nHz, μHz, mHz, cHz, dHz, Hz, daHz, hHz, kHz, MHz, GHz, THz, PHz, other

int, double, object

conductance

fS, pS, nS, μS, mS, cS, dS, S, daS, hS, kS, MS, GS, TS, PS, other

int, double, object

magneticFlux

fWb, pWb, nWb, μWb, mWb, cWb, dWb, Wb, daWb, hWb, kWb, MWb, GWb, TWb, PWb, other

int, double, object

magneticFieldStrength

fT, pT, nT, μT, mT, cT, dT, T, daT, hT, kT, MT, GT, TT, PT, other

int, double, object

integer

n/a

int

double

n/a

double

text

n/a

string

date

n/a

long

Appendix 4: PBSHM Schema Installation

An example python script for installing the PBSHM Schema into a collection.

Appendix 5: Single vs Multiple File Channel Data

A JSON example showing equal Channel Data on a single file vs multiple files.

Appendix 6: PBSHM Database Querying

An example python script for querying the PBSHM Database.

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Society for Experimental Mechanics, Inc

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Brennan, D.S., Wickramarachchi, C.T., Cross, E.J., Worden, K. (2022). Implementation of an Organic Database Structure for Population-Based Structural Health Monitoring. In: Grimmelsman, K. (eds) Dynamics of Civil Structures, Volume 2. Conference Proceedings of the Society for Experimental Mechanics Series. Springer, Cham. https://doi.org/10.1007/978-3-030-77143-0_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-77143-0_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-77142-3

  • Online ISBN: 978-3-030-77143-0

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics