We are among the many that believe that artificial intelligence will not replace practitioners and is most valuable as an adjunct in diagnostic radiology. We suggest a different approach to utilizing the technology, which may help even radiologists who may be averse to adopting AI. A novel method of leveraging AI combines computer vision and natural language processing to ambiently function in the background, monitoring for critical care gaps. This AI Quality workflow uses a visual classifier to predict the likelihood of a finding of interest, such as a lung nodule, and then leverages natural language processing to review a radiologist’s report, identifying discrepancies between imaging and documentation. Comparing artificial intelligence predictions with natural language processing report extractions with artificial intelligence in the background of computer-aided detection decisions may offer numerous potential benefits, including streamlined workflow, improved detection quality, an alternative approach to thinking of AI, and possibly even indemnity against malpractice. Here we consider early indications of the potential of artificial intelligence as the ultimate quality assurance for radiologists.