Abstract
This paper discussed the background of crime scene investigations and reviewed a novel Augmented Reality Learning Environment for using HoloLens in crime scene investigation. It clarified the concepts of augmented reality (AR), and virtual reality (VR). With the advancement of technology, forensic investigation is compelled to adapt to corresponding changes and use them to its benefit. In addition, it reviews the extant literature on the use of HoloLens in crime scene investigation. Through this review, the research questions are being formulated for future perspectives of crime scene investigations through Augmented Reality.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Acampora, G., Vitiello, A., Di Nunzio, C., Saliva, M., Garofano, L.: Towards automatic bloodstain pattern analysis through cognitive robots. In: 2015 IEEE International Conference on Systems, Man, and Cybernetics, Kowloon, China, 9–12 October (2015)
Adamczyk, M., Sienilo, M., Sitnik, R., Wozniak, A.: Hierarchical, three-dimensional measurement system for crime scene scanning. J. Forensic Sci. 62(4), 889–899 (2017a)
Adamczyk, M., et al.: Three-dimensional measurement system for crime scene documentation. In: Proceedings volume 10441. Counterterrorism: Crime Fighting, Forensics, and Surveillance Technologies, Warsaw, Poland, 5 October (2017b)
Agosto, E., Ajmar, A., Boccardo, P., Tonolo, F.G., Lingua, A.: Crime scene reconstruction using a fully geomatic approach. Sensors 8(10), 6280–6302 (2008)
Albalooshi, Y., Eltabie, M.A.: The importance of bloodstain pattern analysis in the investigation of road traffic accidents: a case report. Arab J. Forensic Sci. 1 (2), 224–228 (2015)
Al-Kandari, N.: A forensic study of unnatural deaths in Kuwait: Epidemiological, virtual autopsy and DNA investigations (2012). http://clok.uclan.ac.uk/6583/1/Al-Kandari%20Nadia%20Final%20e-Thesis%20%28Master%20Copy%29.pdf. Accessed 22 Feb 2020
Aron, J., Northfield, D.: AR goggles make crime scene investigation a desk job. Sch. Law Polic. Forensics (2017). http://eprints.staffs.ac.uk/3675/. Accessed 4 Feb 2020
Akman, O.: Robust augmented reality (2012). https://repository.tudelft.nl/islandora/object/uuid:3adeccef-19db-4a06-ab26-8636ac03f5c0/. Accessed 26 Dec 2019
Bahamon, J.C., Litvinov, M., Wringht, P., Gayle, R., Lippert, K., Young, M.: IC-CRIME snapshots: training crime scene photographers using procedural content generation in games. In: CHI Play, vol. 14, pp. 19–22 (2014)
Benschop, C.C.G., et al.: Validation of SmartRank: a likelihood ratio software for searching national DNA databases with complex DNA profiles. Forensic Sci. Int. Genet. 29, 145–153 (2017)
Biwasaka, H., Saigusa, K., Aoki, Y.: The applicability of holography in forensic identification: a fusion of the traditional optical technique and digital technique. J. Forensic Sci. 50(2), 393–399 (2005)
Blom, L.: Impact of light on augmented reality (2018). http://www.diva-portal.se/smash/get/diva2%3A1272321/FULLTEXT01.pdf. Accessed 4 Feb 2020
Bohannon, P., Jakobsson, M., Srikwan, S.: Cryptographic approaches to privacy in forensic DNA databases. In: Third International Workshop on Practice and Theory in Public Key Cryptography, Melbourne, Australia, 18–20 January (2000)
Bolliger, S.A., Thali, M.J.: Imaging and Virtual Autopsy: Looking Back and Forward. The Royal Society Publishing (2015). https://royalsocietypublishing.org/. https://doi.org/10.1098/rstb.2014.0253. Accessed 23 Feb 2020
Bostanci, E.: 3D reconstruction of crime scenes and design considerations for an interactive investigation tool. Int. J. Inf. Secur. Sci. 4(2) (2015)
Brown, G., Prilla, M.: Evaluating pointing modes and frames of reference for remotely supporting an augmented reality user in a collaborative (virtual) environment: evaluation within the scope of a remote consultation session. In: MuC 2019 Proceedings of Mensch und Computer, pp. 713–717, September 2019
Buck, U., Kneubuehl, B., Nather, S., Albertini, N., Schmidt, L., Thali, M.: 3D bloodstain pattern analysis: Ballistic reconstruction of the trajectories of blood drops and determination of the centres of origin of the bloodstains. Forensic Sci. Int. 206(1–3), 2–28 (2011)
Buck, U., Naether, S., Rass, B., Jackowski, C., Thali, M.J.: Accident or homicide – virtual crime scene reconstruction using 3D methods. Forensic Sci. Int. 225(1–3), 75–84 (2013)
Cirulis, A.: Ultra wideband tracking potential for augmented reality environments. In: De Paolis, L., Bourdot, P. (eds.) AVR 2019. LNCS, vol. 11614, pp. 126–136. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-25999-0_11
Claes, P., et al.: Modeling 3D facial shape from DNA. PLoS Genet. 10(3), 1–14 (2014)
Cyrus, J., Kremarik, D., Moezzi, R., Koci, J., Petru, M.: HoloLens used for precise position tracking of the third party devices – autonomous vehicles. Communications 21, 20–27 (2019)
Datcu, D., Lukosch, S.G.: Free-hands interaction in augmented reality. In: Proceedings of the 1st Symposium in Spatial User Interaction, Los Angeles, California, 20–21 July 2013
Datcu, D., Lukosch, S.G., Lukosch, H.K.: Comparing presence, workload and situational awareness in a collaborative real worlds and augmented reality scenario. In: IEEE ISMAR Workshop on Collaboration in Merging Realities (CiMeR), Adelaide, Australia, 1 October 2014 (2014a)
Datcu, D., Cidota, M., Lukosch, H., Lukosch, S.: On the usability of augmented reality for information exchange in teams from the security domain. In: IEEE Joint Intelligence and Security Informatics Conference (JISIC), The Hague, Netherlands, 24–25 September 2014 (2014b)
Datcu, D., Lukosch, S.G., Lukosch, H.K.: A collaborative game to study presence and situational awareness in a physical and an augmented reality environment. J. Univ. Comput. Sci. 22(2), 247–270 (2016a)
Datcu, D., Lukosch, S.G., Lukosch, H.K.: Handheld augmented reality for distributed collaborative crime scene investigation. In: Proceedings of the 19th International Conference on Supporting Group Work, Florida, USA, 13–16 November (2016b)
Dath, C.: Crime scenes in virtual reality: a user-centered study (2017). https://kth.diva-portal.org/smash/get/diva2:1115566/FULLTEXT01.pdf. Accessed 19 Feb 2020
Dinis-Oliveira, R.J., Duarte, F.C., Marques, F.R.A., Santos, A., Magalhaes, T.: Collection of biological samples in forensic toxicology. Toxicol. Mech. Methods 20(7), 363–414 (2010)
Dinovo, E.C., Cravey, R.H.: Forensic toxicology in death investigation (2007). https://www.ncjrs.gov/pdffiles1/Digitization/44096NCJRS.pdf. Accessed 23 Feb 2020
Du Plooy, G.M.: Introduction to Communication. Juta & Co., Ltd., Kenwyn (1997)
Ebert, L.C., Nguyen, T., Breitbeck, R.: The forensic holodeck: an immersive display for forensic crime scene reconstructions. Forensic Sci. Med. Pathol. 10(4), 623–626 (2014)
Frumkin, D., Wasserstrom, A., Budowle, B., Davidson, A.: DNA methylation-based forensic tissue identification. Forensic Sci. Int.: Genet. 5(5), 517–524 (2011). ISSN 1872-4973. https://doi.org/10.1016/j.fsigen.2010.12.001
Favretto, D., Pascali, J.P., Tagliaro, F.: New challenges and innovation in forensic toxicology: focus on the ‘new psychoactive substances. J. Chromatogr. 1287, 84–95 (2013)
Frumkin, D., Wesserstrom, A., Davidson, A., Grafit, A.: Authentication of forensic DNA samples. Forensic Sci. Int. Genet. 4(1), 95–103 (2010)
Gaensslen, R.E., Harris, H., Lee, H.C.: Introduction to Forensic Science and Criminalistics. McGraw-Hill, New York (2008)
Gee, A.P., Escamilla-Ambrosio, P.J., Webb, M., Mayol-Cuevas, W., Calway, A.: Augmented crime scenes: Virtual annotation of physical environments for forensic investigation. In: Proceedings of the 2nd ACM Workshop on Multimedia in Forensics, Security and Intelligence, Firenze, Italy, 29 October 2010 (2010)
Gianelli, P.: Wrongful convictions and forensic science: the need to regulate crime labs. North Carol. Law Rev. 86, 163–187 (2007)
Greely, H.T., Riordan, D.P., Garrison, N.A., Mountain, J.L.: Family ties: The use of DNA offender databases to catch offenders’ kin. Law Med. Ethics 34(2), 248–262 (2006)
Hazel, J.W., Clayton, E.W., Melin, B.A., Slobogin, C.: Is it time for a universal genetic forensic database? Science 362, 898–900 (2018)
Heinonen, E.: HoloLens research and demo application development. Metropolia University of Applied Sciences (2018)
Inman, K., Rudin, N.: Principles and Practice of Criminalistics: The Profession of Forensic Science. CRC Press, Boca Raton (2001)
Jahn, G., Newnham, C., van den Berg, N., Iraheta, M., Wells, J.: Holographic construction. In: Gengnagel, C., Baverel, O., Burry, J., Ramsgaard Thomsen, M., Weinzierl, S. (eds.) DMSB 2019, pp. 314–324. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29829-6_25
Joris, P., et al.: Hemo vision: an automated and virtual approach to bloodstain pattern analysis. Forensic Sci. Int. 251, 116–123 (2015)
Karger, B., Rand, S., Fracasso, T., Pfeiffer, H.: Bloodstain pattern analysis – casework experience. Forensic Sci. Int. 181(1–3), 15–20 (2008)
Kilgus, T., et al.: Mobile markerless augmented reality and its application in forensic medicine. Int. J. Comput. Assist. Radiol. Surg. 10(5), 573–586 (2014). https://doi.org/10.1007/s11548-014-1106-9
Kolkmeier, J., Harmsen, E., Glesselink, S., Reidsma, D., Theune, M., Heylen, D.: With a little help from a holographic friend: the open impress mixed reality telepresence toolkit for remote collaboration systems. In: VSRT 2018 proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, Article no. 26, pp. 1–11 (2018)
Laan, N., de Bruin, K.G., Slenter, D., Wilhelm, J., Jermy, M., Bonn, D.: Bloodstain pattern analysis: implementation of a fluid dynamic model for position determination of victims. Sci. Rep. 5, 11461 (2015)
Ladwig, P., Geiger, C.: A literature review on collaboration in mixed reality. In: Auer, M., Langmann, R. (eds.) REV 2018. LNNS, vol. 47. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-95678-7_65
Lee, H.C., Pagliaro, E.M.: Forensic evidence and crime scene investigation. J. Forensic Investig. 1(2), 5–9 (2013)
Lehr, P.: Surveillance and observation: the all-seeing eyes of big brother. In: Lehr, P. (ed.) Counter-Terrorism Technologies. Advanced Sciences and Technologies for Security Applications, pp. 115–129. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-90924-0_8
Liu, P., et al.: Real-time forensic DNA analysis at a crime scene using a portable microchip analyzer. Forensic Sci. Int. Genet. 2(4), 301–309 (2008)
Lukosch, S., Billinghurst, M., Alem, L., Kiyowa, K.: Collaboration in augmented reality. Comput. Support. Coop. Work (CSCW) 24, 515–525 (2015a)
Lukosch, S., Lukosch, H., Datcu, D., Cidota, M.: On the spot information in augmented reality for teams in the security domain. In: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, Seoul, Republic of Korea, 18–23 April 2015 (2015b)
Lukosch, S., Poelman, R., Akman, O., Jonker, P.: A novel gesture-based interface for crime scene investigation in mediated reality (2012). https://repository.tudelft.nl/islandora/object/uuid%3Ab9a2b407-a286-41d9-9781-956cd96b3c4e. Accessed 27 Dec 2019
Ma, M., Zheng, H., Lallie, H.: Virtual reality and 3D animation in forensic visualization. Forensic Sci. 55(5), 227–231 (2010)
Murray, L.: Virtopsy: the future of forensics. Eng. Technol. 11(7–8), 50–53 (2016)
Norrgard, K.: Forensics, DNA fingerprinting. Nat. Educ. 1(1), 35 (2008)
Osborne, N., Taylor, M.C., Zajac, R.: Bloodstain pattern analysis and contextual bias. In: Wiley Encyclopedia of Forensic Science. Wiley, Hoboken (2015)
Panneerchelvam, S., Nozarmi, M.N.: Forensic DNA profiling and database. Malays. J. Med. Sci. 10(2), 20–26 (2003)
Poelman, R., Akman, O., Lukosch, S., Jonker, P.: As if being there: mediated reality for crime scene investigation. In: Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work Pages, Washington, USA, 11–15 February 2012
[OVC] Office for Victims of Crime: Understanding DNA evidence: A guide for victim service providers (2012). https://www.ncjrs.gov/pdffiles1/nij/bc000657.pdf. Accessed 4 Feb 2020
Pokupcic, K.: Blood as an important tool in criminal investigation. J. Forensic Sci. 3(2), 1–3 (2017)
Prilla, M., Ruhmann, L.M.: An analysis tool for cooperative mixed reality scenarios. In: IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Munich, Germany, 29 April 2018
Rajeev, S., Wan, Q., Yau, K., Panetta, K., Agaian, S.: Augmented reality-based vision-aid indoor navigation system in GPS denied environment. In: Proceedings Vol. 10993: Mobile multimedia/Image Processing, Security, and Applications 2019, Baltimore, Maryland, 13 May 2019
Rice, R.: Augmented reality tools for enhanced forensics simulations and crime scene analysis. In: Kisiel, K.W. (ed.) Working Through Synthetic Worlds. CRC Press, Boca Raton (2012)
Riedlinger, U., Oppermann, L., Prinz, W.: Tango vs. HoloLens: a comparison of collaborative indoor AR visualisation using hand-held and hands-free devices. Multimodal Technol. Interact. 3(23), 1–15 (2019)
Richards, C.S., Simonsen, T.J., Abel, R.L., Hall, M., Schwyn, D.A., Wicklein, M.: Virtual forensic entomology: improving estimates of minimum post-mortem interval with 3D micro-computed tomography. Forensic Sci. Int. 220(1–3), 251–264 (2012)
Robey, D., Palmer, I.J., Chilton, N., Bramble, S.: From crime scene to computer screen: The use of virtual reality in crime scene investigation (2000). https://www.researchgate.net/publication/246248660_From_Crime_Scene_to_Computer_Screen_The_Use_of_Virtual_Reality_in_Crime_Scene_Investigation. Accessed 20 Feb 2020
Roman, J.K., Reid, S.E., Chalfin, A.J., Knight, C.R.: The DNA field experiment: a randomized trial of the cost-effectiveness of using DNA to solve property crimes. J. Exp. Criminol. 5, 345 (2009)
Roman-Santos, C.: Concerns associated with expanding DNA databases. Hastings Sci. Technol. Law J. 2(2), 267–300 (2010)
Ruhmann, L., Prilla, M.: Joint search patterns in mixed reality (2018). https://dl.gi.de/handle/20.500.12116/16637. Accessed 3 Jan 2020
Ruhmann, L.M., Prilla, M., Brown, G.: Cooperative mixed reality: an analysis tool. In: Proceedings of the 2018 ACM Conference on Supporting Groupwork, Florida, USA, 7–10 January 2018
Sandvik, K.: Crime scenes as augmented reality: models for enhancing places emotionally by means of narratives, fictions and virtual reality. In: Knudsen, B.T., Waade, A.M. (eds.) Re-Investing Authenticity: Tourism, Place and Emotion, pp. 138–154. Channel View Publications, Bristol (2010)
Sandvik, K.: The anatomy of the crime scene. In: Conference: Motion and Emotion Within Place (2009). https://www.forskningsdatabasen.dk/en/catalog/2398297568. Accessed 1 Feb 2020
Sandvik, K., Waade, A.M.: Crime scene as augmented reality on screen, online and offline. In: Working Paper No. 5 (2008). http://www.krimiforsk.aau.dk/uk/awpaper/KSAWcrimesceneas.w5letter.pdf. Accessed 26 Dec 2019
Sandvik, K.: Crime scenes as augmented reality. University of Copenhagen (2010) https://static-curis.ku.dk/portal/files/20472434/sandvik_-_crime_scenes_as_augmented_reality.pdf. Accessed 4 Feb 2020
Sauter, P.M.: Introduction to crime scene reconstruction using real-time interactive 3D technology (2019) https://pmsmicro.com/forensicscienceschapter_4d.pdf. Accessed 3 Feb 2020
Shen, A.R., Cipolla, G.J.: Toward automatic blood spatter analysis in crime scenes. In: 2006 IET Conference on Crime and Security, London, UK, 13–14 July 2006
Spain, R., et al.: Me and my VE, part 5: applications in human factors research and practice. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 62, no. 1, pp. 2051–2055 (2018)
Speicher, M., Cao, J., Yu, A., Zhang, H., Nebeling, M.: 360 anywhere: mobile ad-hoc collaboration in any environment using 360 video and augmented reality. In: Proceedings of the ACM on Human-Computer Interaction, vol. 2, no. 9 (2018)
Streefkerk, J.W., Houben, M., van Amerongen, P., ter Haar, F., Dijk, J.: The ART of CSI: an augmented reality tool (ART) to annotate crime scenes in forensic investigation. In: Shumaker, R. (ed.) VAMR 2013. LNCS, vol. 8022, pp. 330–339. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39420-1_35
Teo, T., Lee, G.A., Billinghurst, M., Adcock, M.: 360 drops: mixed reality remote collaboration using 360 panoramas within the 3D scene, In: SA 2019 SIGGRAPH Asia 2019 Emerging Technologies (2019). https://doi.org/10.1145/3355049.3360517. Accessed 3 Jan 2020
Ticknor, B.: Virtual Reality and the Criminal Justice System: Exploring the Possibilities for Correctional Rehabilitation. The Rowman and Littlefield Publishing Group Inc., London (2018)
Veremme, A., Lefevre, E., Morvan, G., Dupont, D., Jolly, D.: Evidential calibration process of multi-agent based system: an application to forensic entomology. Expert Syst. Appl. 39(3), 2361–2374 (2012)
Wang, J., et al.: Virtual reality and in integrated crime scene scanning for immersive and heterogeneous crime scene reconstruction. Forensic Sci. Int. 303, 109943 (2019)
Wassom, B.: Augmented Reality Law, Privacy, and Ethics: Law, Society, and Emerging AR Technologies. Syngress, Waltham, (2015)
Werry, P.: Who Did It? South Pacific Press, Wellington (2011)
Yen, K., Thali, M.J., Kneubuehl, B., Peschel, O., Zollinger, U., Dirnhofer, R.: Blood spatter patterns: Hands hold clues for the forensic reconstruction of the sequence of events. Am. J. Forensic Med. Pathol. 224(2), 132–140 (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Albeedan, M., Kolivand, H., Ho, E.S.L. (2022). A Review of Crime Scene Investigations Through Augmented Reality. In: Paiva, S., et al. Science and Technologies for Smart Cities. SmartCity 360 2021. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 442. Springer, Cham. https://doi.org/10.1007/978-3-031-06371-8_36
Download citation
DOI: https://doi.org/10.1007/978-3-031-06371-8_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-06370-1
Online ISBN: 978-3-031-06371-8
eBook Packages: Computer ScienceComputer Science (R0)