Skip to main content

A Review of Crime Scene Investigations Through Augmented Reality

  • Conference paper
  • First Online:
Science and Technologies for Smart Cities (SmartCity 360 2021)

Abstract

This paper discussed the background of crime scene investigations and reviewed a novel Augmented Reality Learning Environment for using HoloLens in crime scene investigation. It clarified the concepts of augmented reality (AR), and virtual reality (VR). With the advancement of technology, forensic investigation is compelled to adapt to corresponding changes and use them to its benefit. In addition, it reviews the extant literature on the use of HoloLens in crime scene investigation. Through this review, the research questions are being formulated for future perspectives of crime scene investigations through Augmented Reality.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  • Acampora, G., Vitiello, A., Di Nunzio, C., Saliva, M., Garofano, L.: Towards automatic bloodstain pattern analysis through cognitive robots. In: 2015 IEEE International Conference on Systems, Man, and Cybernetics, Kowloon, China, 9–12 October (2015)

    Google Scholar 

  • Adamczyk, M., Sienilo, M., Sitnik, R., Wozniak, A.: Hierarchical, three-dimensional measurement system for crime scene scanning. J. Forensic Sci. 62(4), 889–899 (2017a)

    Google Scholar 

  • Adamczyk, M., et al.: Three-dimensional measurement system for crime scene documentation. In: Proceedings volume 10441. Counterterrorism: Crime Fighting, Forensics, and Surveillance Technologies, Warsaw, Poland, 5 October (2017b)

    Google Scholar 

  • Agosto, E., Ajmar, A., Boccardo, P., Tonolo, F.G., Lingua, A.: Crime scene reconstruction using a fully geomatic approach. Sensors 8(10), 6280–6302 (2008)

    Article  Google Scholar 

  • Albalooshi, Y., Eltabie, M.A.: The importance of bloodstain pattern analysis in the investigation of road traffic accidents: a case report. Arab J. Forensic Sci. 1 (2), 224–228 (2015)

    Google Scholar 

  • Al-Kandari, N.: A forensic study of unnatural deaths in Kuwait: Epidemiological, virtual autopsy and DNA investigations (2012). http://clok.uclan.ac.uk/6583/1/Al-Kandari%20Nadia%20Final%20e-Thesis%20%28Master%20Copy%29.pdf. Accessed 22 Feb 2020

  • Aron, J., Northfield, D.: AR goggles make crime scene investigation a desk job. Sch. Law Polic. Forensics (2017). http://eprints.staffs.ac.uk/3675/. Accessed 4 Feb 2020

  • Akman, O.: Robust augmented reality (2012). https://repository.tudelft.nl/islandora/object/uuid:3adeccef-19db-4a06-ab26-8636ac03f5c0/. Accessed 26 Dec 2019

  • Bahamon, J.C., Litvinov, M., Wringht, P., Gayle, R., Lippert, K., Young, M.: IC-CRIME snapshots: training crime scene photographers using procedural content generation in games. In: CHI Play, vol. 14, pp. 19–22 (2014)

    Google Scholar 

  • Benschop, C.C.G., et al.: Validation of SmartRank: a likelihood ratio software for searching national DNA databases with complex DNA profiles. Forensic Sci. Int. Genet. 29, 145–153 (2017)

    Article  Google Scholar 

  • Biwasaka, H., Saigusa, K., Aoki, Y.: The applicability of holography in forensic identification: a fusion of the traditional optical technique and digital technique. J. Forensic Sci. 50(2), 393–399 (2005)

    Article  Google Scholar 

  • Blom, L.: Impact of light on augmented reality (2018). http://www.diva-portal.se/smash/get/diva2%3A1272321/FULLTEXT01.pdf. Accessed 4 Feb 2020

  • Bohannon, P., Jakobsson, M., Srikwan, S.: Cryptographic approaches to privacy in forensic DNA databases. In: Third International Workshop on Practice and Theory in Public Key Cryptography, Melbourne, Australia, 18–20 January (2000)

    Google Scholar 

  • Bolliger, S.A., Thali, M.J.: Imaging and Virtual Autopsy: Looking Back and Forward. The Royal Society Publishing (2015). https://royalsocietypublishing.org/. https://doi.org/10.1098/rstb.2014.0253. Accessed 23 Feb 2020

  • Bostanci, E.: 3D reconstruction of crime scenes and design considerations for an interactive investigation tool. Int. J. Inf. Secur. Sci. 4(2) (2015)

    Google Scholar 

  • Brown, G., Prilla, M.: Evaluating pointing modes and frames of reference for remotely supporting an augmented reality user in a collaborative (virtual) environment: evaluation within the scope of a remote consultation session. In: MuC 2019 Proceedings of Mensch und Computer, pp. 713–717, September 2019

    Google Scholar 

  • Buck, U., Kneubuehl, B., Nather, S., Albertini, N., Schmidt, L., Thali, M.: 3D bloodstain pattern analysis: Ballistic reconstruction of the trajectories of blood drops and determination of the centres of origin of the bloodstains. Forensic Sci. Int. 206(1–3), 2–28 (2011)

    Google Scholar 

  • Buck, U., Naether, S., Rass, B., Jackowski, C., Thali, M.J.: Accident or homicide – virtual crime scene reconstruction using 3D methods. Forensic Sci. Int. 225(1–3), 75–84 (2013)

    Article  Google Scholar 

  • Cirulis, A.: Ultra wideband tracking potential for augmented reality environments. In: De Paolis, L., Bourdot, P. (eds.) AVR 2019. LNCS, vol. 11614, pp. 126–136. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-25999-0_11

  • Claes, P., et al.: Modeling 3D facial shape from DNA. PLoS Genet. 10(3), 1–14 (2014)

    Article  Google Scholar 

  • Cyrus, J., Kremarik, D., Moezzi, R., Koci, J., Petru, M.: HoloLens used for precise position tracking of the third party devices – autonomous vehicles. Communications 21, 20–27 (2019)

    Google Scholar 

  • Datcu, D., Lukosch, S.G.: Free-hands interaction in augmented reality. In: Proceedings of the 1st Symposium in Spatial User Interaction, Los Angeles, California, 20–21 July 2013

    Google Scholar 

  • Datcu, D., Lukosch, S.G., Lukosch, H.K.: Comparing presence, workload and situational awareness in a collaborative real worlds and augmented reality scenario. In: IEEE ISMAR Workshop on Collaboration in Merging Realities (CiMeR), Adelaide, Australia, 1 October 2014 (2014a)

    Google Scholar 

  • Datcu, D., Cidota, M., Lukosch, H., Lukosch, S.: On the usability of augmented reality for information exchange in teams from the security domain. In: IEEE Joint Intelligence and Security Informatics Conference (JISIC), The Hague, Netherlands, 24–25 September 2014 (2014b)

    Google Scholar 

  • Datcu, D., Lukosch, S.G., Lukosch, H.K.: A collaborative game to study presence and situational awareness in a physical and an augmented reality environment. J. Univ. Comput. Sci. 22(2), 247–270 (2016a)

    Google Scholar 

  • Datcu, D., Lukosch, S.G., Lukosch, H.K.: Handheld augmented reality for distributed collaborative crime scene investigation. In: Proceedings of the 19th International Conference on Supporting Group Work, Florida, USA, 13–16 November (2016b)

    Google Scholar 

  • Dath, C.: Crime scenes in virtual reality: a user-centered study (2017). https://kth.diva-portal.org/smash/get/diva2:1115566/FULLTEXT01.pdf. Accessed 19 Feb 2020

  • Dinis-Oliveira, R.J., Duarte, F.C., Marques, F.R.A., Santos, A., Magalhaes, T.: Collection of biological samples in forensic toxicology. Toxicol. Mech. Methods 20(7), 363–414 (2010)

    Article  Google Scholar 

  • Dinovo, E.C., Cravey, R.H.: Forensic toxicology in death investigation (2007). https://www.ncjrs.gov/pdffiles1/Digitization/44096NCJRS.pdf. Accessed 23 Feb 2020

  • Du Plooy, G.M.: Introduction to Communication. Juta & Co., Ltd., Kenwyn (1997)

    Google Scholar 

  • Ebert, L.C., Nguyen, T., Breitbeck, R.: The forensic holodeck: an immersive display for forensic crime scene reconstructions. Forensic Sci. Med. Pathol. 10(4), 623–626 (2014)

    Google Scholar 

  • Frumkin, D., Wasserstrom, A., Budowle, B., Davidson, A.: DNA methylation-based forensic tissue identification. Forensic Sci. Int.: Genet. 5(5), 517–524 (2011). ISSN 1872-4973. https://doi.org/10.1016/j.fsigen.2010.12.001

  • Favretto, D., Pascali, J.P., Tagliaro, F.: New challenges and innovation in forensic toxicology: focus on the ‘new psychoactive substances. J. Chromatogr. 1287, 84–95 (2013)

    Article  Google Scholar 

  • Frumkin, D., Wesserstrom, A., Davidson, A., Grafit, A.: Authentication of forensic DNA samples. Forensic Sci. Int. Genet. 4(1), 95–103 (2010)

    Article  Google Scholar 

  • Gaensslen, R.E., Harris, H., Lee, H.C.: Introduction to Forensic Science and Criminalistics. McGraw-Hill, New York (2008)

    Google Scholar 

  • Gee, A.P., Escamilla-Ambrosio, P.J., Webb, M., Mayol-Cuevas, W., Calway, A.: Augmented crime scenes: Virtual annotation of physical environments for forensic investigation. In: Proceedings of the 2nd ACM Workshop on Multimedia in Forensics, Security and Intelligence, Firenze, Italy, 29 October 2010 (2010)

    Google Scholar 

  • Gianelli, P.: Wrongful convictions and forensic science: the need to regulate crime labs. North Carol. Law Rev. 86, 163–187 (2007)

    Google Scholar 

  • Greely, H.T., Riordan, D.P., Garrison, N.A., Mountain, J.L.: Family ties: The use of DNA offender databases to catch offenders’ kin. Law Med. Ethics 34(2), 248–262 (2006)

    Article  Google Scholar 

  • Hazel, J.W., Clayton, E.W., Melin, B.A., Slobogin, C.: Is it time for a universal genetic forensic database? Science 362, 898–900 (2018)

    Article  Google Scholar 

  • Heinonen, E.: HoloLens research and demo application development. Metropolia University of Applied Sciences (2018)

    Google Scholar 

  • Inman, K., Rudin, N.: Principles and Practice of Criminalistics: The Profession of Forensic Science. CRC Press, Boca Raton (2001)

    Google Scholar 

  • Jahn, G., Newnham, C., van den Berg, N., Iraheta, M., Wells, J.: Holographic construction. In: Gengnagel, C., Baverel, O., Burry, J., Ramsgaard Thomsen, M., Weinzierl, S. (eds.) DMSB 2019, pp. 314–324. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29829-6_25

  • Joris, P., et al.: Hemo vision: an automated and virtual approach to bloodstain pattern analysis. Forensic Sci. Int. 251, 116–123 (2015)

    Article  Google Scholar 

  • Karger, B., Rand, S., Fracasso, T., Pfeiffer, H.: Bloodstain pattern analysis – casework experience. Forensic Sci. Int. 181(1–3), 15–20 (2008)

    Article  Google Scholar 

  • Kilgus, T., et al.: Mobile markerless augmented reality and its application in forensic medicine. Int. J. Comput. Assist. Radiol. Surg. 10(5), 573–586 (2014). https://doi.org/10.1007/s11548-014-1106-9

    Article  Google Scholar 

  • Kolkmeier, J., Harmsen, E., Glesselink, S., Reidsma, D., Theune, M., Heylen, D.: With a little help from a holographic friend: the open impress mixed reality telepresence toolkit for remote collaboration systems. In: VSRT 2018 proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, Article no. 26, pp. 1–11 (2018)

    Google Scholar 

  • Laan, N., de Bruin, K.G., Slenter, D., Wilhelm, J., Jermy, M., Bonn, D.: Bloodstain pattern analysis: implementation of a fluid dynamic model for position determination of victims. Sci. Rep. 5, 11461 (2015)

    Article  Google Scholar 

  • Ladwig, P., Geiger, C.: A literature review on collaboration in mixed reality. In: Auer, M., Langmann, R. (eds.) REV 2018. LNNS, vol. 47. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-95678-7_65

  • Lee, H.C., Pagliaro, E.M.: Forensic evidence and crime scene investigation. J. Forensic Investig. 1(2), 5–9 (2013)

    Google Scholar 

  • Lehr, P.: Surveillance and observation: the all-seeing eyes of big brother. In: Lehr, P. (ed.) Counter-Terrorism Technologies. Advanced Sciences and Technologies for Security Applications, pp. 115–129. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-90924-0_8

  • Liu, P., et al.: Real-time forensic DNA analysis at a crime scene using a portable microchip analyzer. Forensic Sci. Int. Genet. 2(4), 301–309 (2008)

    Google Scholar 

  • Lukosch, S., Billinghurst, M., Alem, L., Kiyowa, K.: Collaboration in augmented reality. Comput. Support. Coop. Work (CSCW) 24, 515–525 (2015a)

    Article  Google Scholar 

  • Lukosch, S., Lukosch, H., Datcu, D., Cidota, M.: On the spot information in augmented reality for teams in the security domain. In: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, Seoul, Republic of Korea, 18–23 April 2015 (2015b)

    Google Scholar 

  • Lukosch, S., Poelman, R., Akman, O., Jonker, P.: A novel gesture-based interface for crime scene investigation in mediated reality (2012). https://repository.tudelft.nl/islandora/object/uuid%3Ab9a2b407-a286-41d9-9781-956cd96b3c4e. Accessed 27 Dec 2019

  • Ma, M., Zheng, H., Lallie, H.: Virtual reality and 3D animation in forensic visualization. Forensic Sci. 55(5), 227–231 (2010)

    Google Scholar 

  • Murray, L.: Virtopsy: the future of forensics. Eng. Technol. 11(7–8), 50–53 (2016)

    Article  Google Scholar 

  • Norrgard, K.: Forensics, DNA fingerprinting. Nat. Educ. 1(1), 35 (2008)

    Google Scholar 

  • Osborne, N., Taylor, M.C., Zajac, R.: Bloodstain pattern analysis and contextual bias. In: Wiley Encyclopedia of Forensic Science. Wiley, Hoboken (2015)

    Google Scholar 

  • Panneerchelvam, S., Nozarmi, M.N.: Forensic DNA profiling and database. Malays. J. Med. Sci. 10(2), 20–26 (2003)

    Google Scholar 

  • Poelman, R., Akman, O., Lukosch, S., Jonker, P.: As if being there: mediated reality for crime scene investigation. In: Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work Pages, Washington, USA, 11–15 February 2012

    Google Scholar 

  • [OVC] Office for Victims of Crime: Understanding DNA evidence: A guide for victim service providers (2012). https://www.ncjrs.gov/pdffiles1/nij/bc000657.pdf. Accessed 4 Feb 2020

  • Pokupcic, K.: Blood as an important tool in criminal investigation. J. Forensic Sci. 3(2), 1–3 (2017)

    Google Scholar 

  • Prilla, M., Ruhmann, L.M.: An analysis tool for cooperative mixed reality scenarios. In: IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Munich, Germany, 29 April 2018

    Google Scholar 

  • Rajeev, S., Wan, Q., Yau, K., Panetta, K., Agaian, S.: Augmented reality-based vision-aid indoor navigation system in GPS denied environment. In: Proceedings Vol. 10993: Mobile multimedia/Image Processing, Security, and Applications 2019, Baltimore, Maryland, 13 May 2019

    Google Scholar 

  • Rice, R.: Augmented reality tools for enhanced forensics simulations and crime scene analysis. In: Kisiel, K.W. (ed.) Working Through Synthetic Worlds. CRC Press, Boca Raton (2012)

    Google Scholar 

  • Riedlinger, U., Oppermann, L., Prinz, W.: Tango vs. HoloLens: a comparison of collaborative indoor AR visualisation using hand-held and hands-free devices. Multimodal Technol. Interact. 3(23), 1–15 (2019)

    Google Scholar 

  • Richards, C.S., Simonsen, T.J., Abel, R.L., Hall, M., Schwyn, D.A., Wicklein, M.: Virtual forensic entomology: improving estimates of minimum post-mortem interval with 3D micro-computed tomography. Forensic Sci. Int. 220(1–3), 251–264 (2012)

    Article  Google Scholar 

  • Robey, D., Palmer, I.J., Chilton, N., Bramble, S.: From crime scene to computer screen: The use of virtual reality in crime scene investigation (2000). https://www.researchgate.net/publication/246248660_From_Crime_Scene_to_Computer_Screen_The_Use_of_Virtual_Reality_in_Crime_Scene_Investigation. Accessed 20 Feb 2020

  • Roman, J.K., Reid, S.E., Chalfin, A.J., Knight, C.R.: The DNA field experiment: a randomized trial of the cost-effectiveness of using DNA to solve property crimes. J. Exp. Criminol. 5, 345 (2009)

    Article  Google Scholar 

  • Roman-Santos, C.: Concerns associated with expanding DNA databases. Hastings Sci. Technol. Law J. 2(2), 267–300 (2010)

    Google Scholar 

  • Ruhmann, L., Prilla, M.: Joint search patterns in mixed reality (2018). https://dl.gi.de/handle/20.500.12116/16637. Accessed 3 Jan 2020

  • Ruhmann, L.M., Prilla, M., Brown, G.: Cooperative mixed reality: an analysis tool. In: Proceedings of the 2018 ACM Conference on Supporting Groupwork, Florida, USA, 7–10 January 2018

    Google Scholar 

  • Sandvik, K.: Crime scenes as augmented reality: models for enhancing places emotionally by means of narratives, fictions and virtual reality. In: Knudsen, B.T., Waade, A.M. (eds.) Re-Investing Authenticity: Tourism, Place and Emotion, pp. 138–154. Channel View Publications, Bristol (2010)

    Chapter  Google Scholar 

  • Sandvik, K.: The anatomy of the crime scene. In: Conference: Motion and Emotion Within Place (2009). https://www.forskningsdatabasen.dk/en/catalog/2398297568. Accessed 1 Feb 2020

  • Sandvik, K., Waade, A.M.: Crime scene as augmented reality on screen, online and offline. In: Working Paper No. 5 (2008). http://www.krimiforsk.aau.dk/uk/awpaper/KSAWcrimesceneas.w5letter.pdf. Accessed 26 Dec 2019

  • Sandvik, K.: Crime scenes as augmented reality. University of Copenhagen (2010) https://static-curis.ku.dk/portal/files/20472434/sandvik_-_crime_scenes_as_augmented_reality.pdf. Accessed 4 Feb 2020

  • Sauter, P.M.: Introduction to crime scene reconstruction using real-time interactive 3D technology (2019) https://pmsmicro.com/forensicscienceschapter_4d.pdf. Accessed 3 Feb 2020

  • Shen, A.R., Cipolla, G.J.: Toward automatic blood spatter analysis in crime scenes. In: 2006 IET Conference on Crime and Security, London, UK, 13–14 July 2006

    Google Scholar 

  • Spain, R., et al.: Me and my VE, part 5: applications in human factors research and practice. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 62, no. 1, pp. 2051–2055 (2018)

    Google Scholar 

  • Speicher, M., Cao, J., Yu, A., Zhang, H., Nebeling, M.: 360 anywhere: mobile ad-hoc collaboration in any environment using 360 video and augmented reality. In: Proceedings of the ACM on Human-Computer Interaction, vol. 2, no. 9 (2018)

    Google Scholar 

  • Streefkerk, J.W., Houben, M., van Amerongen, P., ter Haar, F., Dijk, J.: The ART of CSI: an augmented reality tool (ART) to annotate crime scenes in forensic investigation. In: Shumaker, R. (ed.) VAMR 2013. LNCS, vol. 8022, pp. 330–339. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39420-1_35

    Chapter  Google Scholar 

  • Teo, T., Lee, G.A., Billinghurst, M., Adcock, M.: 360 drops: mixed reality remote collaboration using 360 panoramas within the 3D scene, In: SA 2019 SIGGRAPH Asia 2019 Emerging Technologies (2019). https://doi.org/10.1145/3355049.3360517. Accessed 3 Jan 2020

  • Ticknor, B.: Virtual Reality and the Criminal Justice System: Exploring the Possibilities for Correctional Rehabilitation. The Rowman and Littlefield Publishing Group Inc., London (2018)

    Google Scholar 

  • Veremme, A., Lefevre, E., Morvan, G., Dupont, D., Jolly, D.: Evidential calibration process of multi-agent based system: an application to forensic entomology. Expert Syst. Appl. 39(3), 2361–2374 (2012)

    Article  Google Scholar 

  • Wang, J., et al.: Virtual reality and in integrated crime scene scanning for immersive and heterogeneous crime scene reconstruction. Forensic Sci. Int. 303, 109943 (2019)

    Article  Google Scholar 

  • Wassom, B.: Augmented Reality Law, Privacy, and Ethics: Law, Society, and Emerging AR Technologies. Syngress, Waltham, (2015)

    Google Scholar 

  • Werry, P.: Who Did It? South Pacific Press, Wellington (2011)

    Google Scholar 

  • Yen, K., Thali, M.J., Kneubuehl, B., Peschel, O., Zollinger, U., Dirnhofer, R.: Blood spatter patterns: Hands hold clues for the forensic reconstruction of the sequence of events. Am. J. Forensic Med. Pathol. 224(2), 132–140 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hoshang Kolivand .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Albeedan, M., Kolivand, H., Ho, E.S.L. (2022). A Review of Crime Scene Investigations Through Augmented Reality. In: Paiva, S., et al. Science and Technologies for Smart Cities. SmartCity 360 2021. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 442. Springer, Cham. https://doi.org/10.1007/978-3-031-06371-8_36

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-06371-8_36

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-06370-1

  • Online ISBN: 978-3-031-06371-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics