We identified 101 articles related the broad application of virtual reality in dentistry and oral & maxillofacial surgery. These were subdivided as follows; Eight systematic reviews [7,8,9,10,11,12,13], (Table 1), 4 expert reviews, 9 case reports, 5 retrospective surveys, 2 historical perspectives, 13 manuscripts on virtual education and training, 5 on haptic technology, 4 on augmented reality, 10 on image fusion, 41 articles on the prediction planning for orthognathic surgery and maxillofacial reconstruction. The results will be presented under two main categories, clinical applications and surgical training.
Technological advances in virtual and augmented reality are enabling the application of the methods in dentistry, oral and maxillofacial surgery is the primary area of application, dental implantology and orthognathic surgery are the most frequent application . Most of the publications were on the assessment of the accuracy of virtual planning for orthognathic surgery . Three-dimensional virtual surgery and mandibular reconstruction after cancer resection and reconstruction were the main applications of virtual reality . Virtual planes for mandibular and maxillary reconstruction can be achieved with an excellent match. This was demonstrated on 30 cases of complex head and neck reconstruction including the planes of the resection, the length of the segmental defect and the distance between the transplanted segments and the remaining bone. There was excellent match between the virtual plans and the achieved results .
In a series of case reports the virtual surgical planning and hardware fabrication for open reduction and internal fixation of atrophic edentulous mandibular fractures were demonstrated [18,19,20].
In dental implantology, the accurate placement of dental implants is essential to meet the required functional and aesthetic demands . Virtual reality has been extensively applied using the preoperative CBCT to determine the implant size, position, direction and proximity to vital structures. Various software packages are available for the virtual planning of dental implants . The 3D virtual planning is then transferred onto the surgical field via either the static guide or the dynamic navigated approach .. The static transfer of the surgical plan is based on the virtual designing followed by fabrication of a surgical guide using computer-aided-design/computer-aided-manufacturing (CAD/CAM) to facilitate the insertion of dental implants. Various types of surgical guides are available based on the type of support, bony, mucosal or dental. A remarkable accuracy can be achieved with the sleeve-in-sleeve template is used in which multiple sleeves are applied and fixed to the surrounding bone to improve the precision of insertion of dental implants . Various static guiding systems are available based on the CAD/CAM technology which includes EasyGuide, GPIS, Impla 3D, InVivoDental, Implant 3D, Nobel Bioguide and VIP (Implant Logic System) .
On the other hand, the dynamic navigation allows the real time adjustment of the direction of dental implant during surgery based on the virtual preoperative planning.
One of the main advantages of the dynamic navigation is the operator flexibility of changing the implant position to avoid compromised bony foundation and anatomical structures that may have not be detected during the presurgical planning phase. A high level of accuracy has been reported with the image guide implantology (IGI) system with an overall navigation error of 0.35 mm (and a mean angular deviation of less than 4 degrees . However, it must be emphasised that the technology requires an expensive hard ware, significant learning curve and a rigorous intra-operative referencing and orientation process. Moreover, a disrupted surgical procedure may be encountered due to sensors being blocked during the navigation process.
No doubt, the virtual computerized implant dentistry has opened a new horizon in the management of complex cases where the anatomy of the jaw bones has been altered due to trauma or pathology. It improved the accuracy of implant placement where minimally invasive surgery is required in those who suffer from blood dsycrasias and radiation related bone damage.
Navigation within a virtual environment has been successfully used for the during orthognathic surgical , and for the repositioning of the maxilla to correct facial asymmetry . The accuracy of the method was evaluated on 15 patients and ranged from 0.9 to 2 mm. An overview on the indication and the application of computer assisted navigation in oral and maxillofacial surgery was carried out on 104 cases, including 37 zygomatico-orbital maxillary fractures, 27 unilateral TMJ ankylosis, 29 craniofacial fibrous dysplasia, 9 mandibular hypertrophy, 3 bone tumours, two foreign body cases . All the surgeries were performed under the guidance of the navigation system based on the preoperative simulation and superimposing the procedure in real time. The accuracy of the navigation system was assessed by measuring the discrepancies between the achieved results and the virtual plans. The mean error was 1.4 mm, it was concluded that navigation surgery is useful as it improved the accuracy of the performed procedure and reduced operation risks.
The application of augmented reality was mainly in dental implant placement and orthognathic surgery. A novel augmented reality system for displaying alveolar nerve bundles in maxillofacial surgery was recently developed. A novel approach based on fiducial markers within an occlusal splint was used to establish a relationship between the virtual image and the real object. The systems promise a broad clinical application . The application of augmented reality system for oral and maxillofacial surgery was investigated . The three-dimensional virtual image of osseous structures was projected into the patient’s body. This helped the surgeons to avoid important structure inside the bone during surgery. Surgical procedures including hole drilling, screw fixation were performed and guided by the augmented reality, the overall precision of the system was within 1 mm.
The application of augmented reality for dental implantology was recently tested in two cases . The study explored the feasibility of a virtual display of the implant position, using specific glasses, on surgical field for surgical navigation in augmented reality. The two virtual environments did not affect the accuracy of the surgical procedure. However, this prove of consent study promises a wider application in maxillofacial surgery.
For an immersive virtual experience, the user wears a head-mounted displays or goggles to engage his visual senses, headphones to engage his auditory senses, and gloves to engage his tactile sense. Rapid advances in technology and research led to the introduction of commercially available high quality immersive virtual reality devices including Oculus Rift (Te 2015) , Google Daydream (Google 2017) , Gear VR (Samsung, 2015) , Goggle Cardboard (Goggle, 2015a)  and HTC Vive (Corp 2015) . Among these Google Daydream, Gear VR and Google Cardboard headsets can create a portable virtual reality environment as they work with smartphones. These lead physicians to explore the potential of immersive spherical videos in medical education.
The addition of haptic technology which provides the operator with tactile feedback of the touched or held digital object on the computer screen, has augmented virtual reality and created a more realistic environment for clinical training. Most of the haptic technology applications in immersive virtual environment were carried out on experimental models . A haptic-assisted craniomaxillofacial surgery planning system was applied for the restoration of skeletal anatomy in complex trauma cases . A virtual model was derived from the patient CT data. The developed system combined stereo visualization with six degrees of freedom, high fidelity haptic feedback that enabled the analysis, planning, testing options for restoring bony segmental defects. The system has the potential to be a powerful tool in oral and maxillofacial surgical planning. The literature showed that most of the application of surgical navigation was in orthognathic surgery to improve the accuracy of guiding the osteotomy segment of the jaw bones according to the pre-planned position .
Virtual reality has been utilised to improve the delivery of education and the quality of training in dentistry and in oral & maxillofacial surgery . Voxel Man Simulator was used for virtual apicoectomy procedure and found that out of 53 dental students who undertook virtual apicoectomy, 51 were positive regarding the impact of virtual simulation as an additional modality in dental education. The trainees indicated that the integrated force feedback (e.g. simulation of haptic pressure), spatial 3D perception, and image resolution of the simulator were key features for virtual training of the dental surgical procedures. Trainees also developed the ability to self-assess their performance which is a valuable skill in surgery which is essential for the refinement of surgical technique. This study also proposed that application of virtual surgery using the 3D reconstruction of patient’s anatomy might help surgeons to plan complex surgical procedures .
Recently, the impact of virtual reality as a training tool for surgical procedures was evaluated in a cross-sectional study to validate a novel virtual simulator for orbital reconstruction, and a training tool in oral and maxillofacial surgery . A novel virtual reality approach based on haptic technology was introduced and validated for computer aided cephalometry. Twenty-one dental surgeons performed a range of case studies using haptic-enabled digital cephalometric analysis. They proved that by providing a sense of touch the errors in cephalometric analysis has been reduced and the landmarking became more feasible and more intuitive .
The applicability of using 3D visualisation in dental training was also reported where a haptic dental injection was developed for inferior alveolar nerve block injection as shown in Fig. 1, they also developed a virtual training system (VR-MFS) with advanced haptic feedback and immersive workbench . In addition to drilling, this system allowed cutting and milling aspects of the bones. 3D stereoscopic visualisation on an immersive workbench provided visual, tactile and aural feedback bringing it close to reality. Le Fort 1 maxillary surgery was simulated in this system; the cutting and drilling trajectories and were compared with a preoperative plan for evaluation. The study found that expert surgeons’ trajectories were close to the plan when compared to the novices. Though the experts believed that VR-MFS could be used for skill development, they pointed out that the system lacked realistic simulation that is required for effective training.
The implementation of web-based virtual patient simulation program to teach dental students oral surgery has been investigated. Virtual reality has improved students’ knowledge and proved to be effective in teaching clinical reasoning and patient evaluation .
Recently, the use and the clinical application of virtual reality in pre-clinical dental education was reviewed. Four educational thematic areas were identified which included the simulation hardware, the realism of virtual simulation, scoring system for the assessment of virtual reality and the validation of the emerged systems. Four types of simulators have been used for dental education which included desktop pcs, haptic desktops, and dental skill trainers and digitally enhanced phantom heads. It was clear there were no established educational standards for dental simulators. Most of the available dental simulators have not been validated .
On the other hand, a stereoscopic 3D videos using immersive reality was developed (Fig. 2) and its impact on improving the non-surgical skills among trainees was investigated . Based on the 3D computer-generated model of the operating room the trainees can navigate, explore and interact with the digital images of the patient’s data. A Leap Motion sensor tracks the trainee’s hands (Fig. 2) to provide a multi-sensory interactive learning experience. The users were able to choose a specific application and zoom in on certain items within a surgical menu. Through specific gestures the trainees can interact with the anatomy of the maxillofacial region and select the most appropriate surgical instrument to perform certain surgical procedure. The developed programme tests the trainees’ knowledge through a quiz scene. The efficacy of VR Surgery in training novices was assessed. A single-blind prospective randomised controlled trial confirmed that the group of the trainees who used VR Surgery performed better than the control group.
Virtual reality has been utilised to create a learning environment for training in maxillofacial emergencies to improve knowledge and confidence of junior trainees . The pilot studies showed improved in the two examined domains, further was recommended by the investigators. Following the same theme of virtual surgical simulation, the feasibility of tree-structure architectonic model to simplify virtual orthognathic surgical was explored . This was tested on a group of patients who require orthognathic surgery. The operators were immersed in the virtual environment and tactile feedback was perceived which augmented the training opportunities .
The importance of virtual reality in standardizing clinical education to facilitate learning and practicing has been highlighted. The methods encouraged the students to learn by themselves which can reduce faculty time significantly. CDS-100 simulator, designed by EPED Inc. has been shown to be effective computerised tool as it provided 3D real time accurate feedback for endodontic and prosthetic applications. The objective structured clinical examination (OSCE) can be easily incorporated. The authors highlighted the importance of the real time navigation technology in dentistry and emphasised the need for high quality medical images for accurate implementation of the technology .
It has been recently highlighted that the current customized augmented reality systems have not been fully validated by independent teams, they provide good results in simple experimental models. The superimposition of digital images is easier on bony structures, therefore, the application of this innovation in oral & maxillofacial surgery is readily achievable and prepare the way for a wider application .