Background

Within medical care a patient’s medical record is the main source of patient information. How this medical record is organized varies. A problem-oriented approach is one way of organizing a medical record. Nowadays a medical record is mostly an Electronic Health Record (EHR).

One of the core elements of an EHR (Electronic Health Record) is the problem list. The problem list can be defined as “a list of current and active diagnoses as well as past diagnoses relevant to the current care of the patient” [1]. Opinions differ on what problems should be on the problem list. Therefore it is important to define a policy for maintaining the problem list but such a policy is often hard to implement [2]. The problem list is the centerpiece of the problem-oriented medical record (POMR), also called problem-oriented record (POR). The POMR – a structured organization of patient information per presented medical problem [3] – was described at the end of the sixties by Dr. Lawrence Weed [4] to aid dealing with the multiplicity of patient problems. Observations, assessments and healthcare plans are grouped by patient problem. Writing progress notes in the subjective-objective-assessment-plan (SOAP) format can structure the data even further.

There is no clear or widely supported standard in the problem-oriented way of working. Therefore implementation can be difficult. Besides the lack of a standard there are further limitations to the POMR and many modern EHR systems lack functionality. This was already described in the nineties [5]. However the POMR fits in the trend of care becoming more patient-centered. A problem-oriented approach is also useful because patients can relate easily to the problems on the problem list and assess and respond to them [6]. In the Netherlands the intention is to come to a nationwide “model” for a POMR. To learn from previous initiatives and implementation projects where the POMR and/or problem list played an important role we conducted this systematic literature review. Prior to the digital era, paper records presented a flat list of medical problems to the healthcare professional without the features that are possible with current technology. In modern EHRs structured problem lists can be used for clinical decision support, registries, linking data to problems, order management, population health, and potentially other innovative functionality in the future, thereby providing a new incentive to the implementation and use of the POMR. The success of these new uses of the POMR will depend, in addition to many other variables, on the EHR functionality and how it is implemented.

Here, we present a systematic review to identify the determinants that influence the implementation and use of a problem-oriented approach in EHRs.

The objective of this study is to extract determinants of the implementation and use of problem list to support the POMR from recent literature, and thereby support institutions in a successful implementation and use of the POMR.

Methods

Collecting literature

A literature search was conducted on 12 May 2014 in Embase.com, Medline (OvidSP), Web of Science, Cochrane, PubMed publisher and Google Scholar to find articles from which determinants for the successful implementation and use of a problem list to support the POMR could be extracted. The basic search string was made in Embase.com, the search strings for the other databases were derived from the Embase.com search string. On 1 June 2015 the search was repeated in the databases Embase.com, Medline (OvidSP), Web of Science, Scopus, PsychINFO, Cinahl, Cochrane, PubMed publisher and Google Scholar.

The final search string used in Embase.com was: ((‘medical record’/exp OR ‘medical documentation’/de OR (((medical* OR electronic* OR patient* OR health* OR dental* OR personal* OR hospital* OR nurs* OR psychiatr* OR computer*) NEAR/3 (record* OR documentat*)) OR ehr OR emr OR ehrs OR emrs):ab, ti) AND ((problem* NEAR/3 (‘oriented’ OR ‘orientated’ OR ‘orientation’))):ab, ti OR (CPOMR OR POMR OR (problem-oriented NEXT/3 (record* OR approach* OR system* OR report* OR method*)) OR (problem NEXT/3 (list OR lists OR summar*)) OR problemlist*):ab, ti).

The final search strings for the other databases can be found in the Additional file 1.

Literature review

Articles were included in two stages. One reviewer (SMJS) made the first selection based on title and abstract, then two reviewers (SMJS, FC) made the selection on full text by first reviewing the full texts individually and secondly discussing all of the individually included articles in face-to-face meetings. If the two reviewers did not agree on a specific inclusion/exclusion of an article, JH made the final decision.

Inclusion/exclusion criteria

We chose a ten-year period and excluded articles published prior to 2004 because we wanted to focus on recent developments in the use of the POMR. Saturation of determinants was expected to occur within the selected ten-year period. We therefore started both the inclusion/exclusion of articles and the literature analysis with the most recently published articles. The literature analysis was conducted simultaneously with the full text review.

From the retrieved abstracts SMJS removed all articles not written in English, all articles using animal models and all conference abstracts. SMJS then removed articles the title and abstract of which showed that the article did not include some sort of medical record and problem or problem list. When such exclusion could not be certain from the title and abstract the full text was analyzed. These criteria are also summarized in Table 1.

Table 1 Summary of inclusion/exclusion criteria used on articles in the two rounds of selection, abstract and full-text based
Full size table

In the full text review we (SMJS and FC) excluded articles focusing only on a technical description of POMR models as technical models are intrinsically related to vendors or specific software. Also, articles were excluded the main subject of which was not the POMR or in which the POMR was merely mentioned as a way to organize medical records without focusing on the use or implementation of the POMR. Thirdly, articles published in 2010 and before 2010 were excluded. This is because the literature analysis showed a saturation of determinants in articles published in 2012 and neither were further determinants found in 2011.

Literature analysis

The literature analysis was conducted, starting with the most recent articles until saturation of determinants occurred. In order to extract the determinants SMJS first selected quotes which made a statement about the POMR. After that the quotes were categorized by content. These categorized quotes led to generic determinants, independent of specific vendor or system. FC and JH agreed on the categorization of the quotes and the determinants formulated.

Results

The systematic literature search of 12 May 2014 resulted in 3338 unique articles. Of these 3338 articles SMJS included 297 based on title and abstract. The full text review of these 297 articles led to the inclusion of 33 articles. The literature analysis of these 33 articles showed a saturation of determinants to a total of 12 (see Table 2) in articles published between 2012 and 2014. Articles published in 2011 were then added to the literature analysis to make sure that none of the determinants was overlooked. Articles published in 2011 did not result in extra determinants. Therefore all articles published in 2010 and before were excluded. During the literature analysis we excluded one more article, as the main subject of the article proved not to be about the use of the medical record after all.

Table 2 Determinants with definition and extracted statements of importance
Full size table

On 1 June 2015 the systematic literature search was repeated. It resulted in 4298 unique articles unique in that search. The selection procedure used in the 12 May 2014 search was repeated and led to the inclusion of 5 more articles. None of these articles were found in any of the databases that were added in the 2015 search. This repeated search did not result in any more determinants. The total result of both searches was 38 included articles: 11 from 2011, 7 from 2012, 12 from 2013 and 8 from 2014.

These 38 articles led to 12 generic determinants. In Table 2 these determinants are shown in alphabetical order. In general determinants are rarely perfectly distinct and show considerable overlap. This is also the case with our determinants. For example, usability and functionality cannot be distinguished completely as they are interdependent. Still, the distinction is big enough for these determinants to both be relevant. Our determinants are defined in more detail by relevant statements relating to the determinants in the articles.

Discussion

The POMR is patient centered and enables clinicians to have a holistic and integral view of the patient. The POMR can give a quick overview of the most important current and past medical issues the patient has. So far there is no international standardized way of working for a POMR or the use of a problem list. Therefore there is a great variety of the use of the problem list within medical practice from no use at all to hospital wide use. Using POMR or even just the problem list on paper is not an easy task to accomplish and can be very cumbersome. Nowadays, computers and other electronic devices are used in every aspect of the medical practice. This technology could be a turning point in the use and the rediscovery of the clinical relevance of the POMR. Our systematic review is therefore timely indicating which determinants play a role in the use, design and implementation of the electronic POMR. From the literature we distilled 12 determinants that influence the use and implementation of the problem list to support the POMR. The determinants are all vendor independent. When these determinants are given adequate attention, they can contribute to a successful implementation of the POMR.

Clinical reasoning [2, 7–17]

The POMR supports daily clinical practice and clinical reasoning. The Problem list should be the integrating part of the medical record. All data such as observations, assessments and plans (diagnostics, treatments and information to patients) must be associated with a problem on the problem list. Furthermore, all data must be easily retrievable with the option for different views depending on the context.

Complete and accurate problem list [2, 6, 7, 9, 11–15, 17–31]

It is important that healthcare professionals can rely on the content of the problem list. Starting with clear and agreed upon guidelines stating what is a problem to put on the list and how to keep the status of the problem up-to-date. The multi-disciplinary use is an important issue that should be covered by guidelines. These guidelines should be made within the organization the POMR is implemented in, as it is important to match the use of POMR to the size, complexity and previous situation of the organization.

Data structure/content [6, 8–14, 18, 19, 22]

Coded entries to the problem list can attribute to semantic interoperability. Various terminology systems can be used, also in combination, but internationally SNOMED CT is to be preferred. Free text should be an option to indicate that there is a problem when it comes to a hard or impossible observation to code. Also nuances, context or clinical status such as ruled in or ruled out can be of crucial importance. Forced coding without the possibility to add free text can make definitive diagnosis imprecise.

Efficiency [2, 7, 8, 11, 12, 14, 16, 22, 32]

One of the main concerns of clinicians is that new systems require a different way of working. Functionality integration into clinical practice, training of the clinicians, accurate and up-to-date problem lists, and system support can all increase the efficiency and effectiveness of the use of the POMR.

Functionality [2, 6, 8, 10, 12, 13, 15, 18, 21, 24–27, 31–37]

The EHR is an enabler for the POMR in the computer era. Linking problems, interventions, notes, supporting the clinicians with the huge amount of data in EHR’s, context depending views of all data, functions for maintainability i.e. scan function to avoid redundancy may be presented to support the clinicians. Systems should be able to handle free text and misspelled entries with an autosuggest function so coded lists will be used more and more efficient. Clinical decision support is one of the other key functionalities why the digital POMR could succeed. With the enormous growth of knowledge, it is impossible to know everything.

Interoperability [2, 6, 11, 18, 22, 28, 37]

Closely related to data structure/content, efficiency and accuracy. The problem list is an important communication tool. Problems should be recorded unambiguously and only once to prevent miscommunication and redundancy.

Multi-disciplinary [2, 7, 10, 12, 14, 17–19, 21–23, 27, 36, 37]

With all medical disciplines working together with the patient at the center the problem list should also be multi-disciplinary. A multi-disciplinary list creates a holistic view of the patient and supports patient-centered care. Clear guidelines for the use of the problem list are essential especially in a multidisciplinary setting. The problem list can be used to coordinate care and communicate effectively about the patient among the care team but also with the patient. Use of standardized language is a key element of multi-disciplinary work and problem list use.

Overview of patient information [8, 10–16, 18, 21, 25, 27, 36]

Is of vital importance to be quickly and fully informed about what is going on with the patient, especially as many clinicians work under time pressure in daily clinical practice. The problem list should support overview and not increase fragmentation of patient information. Linking data to one or more problems contributes to overview. Filters are important such as chronologically, source and problem oriented. The problem list can function as an index to the patient medical record.

Quality of care [6–15, 18, 19, 21, 22, 25, 27, 29, 31, 33, 36, 37]

As quality of life for the subject of care i.e., the patient is the main goal for health care providers. The POMR is an enabler to improve quality of care. It enables clinicians to organize and structure data. Problems can be viewed one by one but also in a more multi-disciplinary holistic way. The POMR will also contribute to transparency and accountability. Viewing possibilities and even corrective options for the patient will also contribute to higher quality of care.

System support [2, 11, 12, 14–16, 18, 20, 21, 25, 26, 28, 29, 31, 33–35, 37–39]

As an assistant to give suggestions for diagnosis or treatment as a form of clinical decision support. This is a helpful feature to increase the use of the problem list, but the system should not automatically add problems without the interference of a clinician. Autosuggest and related terms can increase the efficiency of the use of the coded lists. When clinicians experience those features they would be more prone to use coded problem lists. Natural language processing could be helpful, although it depends on how far this is developed and the language in which the NLP is developed.

Training of staff [12, 14, 17, 25, 40–42]

Both experience in medicine as experience in EHR and problem lists, increase the correct use of the list. When implementing the POMR, make sure proper training is given and training is maintained throughout the years using the POMR. Without proper training, monitoring and feedback clinicians can simply fall back to old habits and use the list incorrectly. Incorrect use of the problem list undermines the reliability of the list and therefore clinicians will use the problem list less. This can become a vicious circle.

Usability [2, 6, 8, 12, 13, 17, 18, 25, 31, 32, 39]

Besides functionality usability is of utmost importance. Functions of a system can be very advanced and extensive but if the user interface is not intuitive and easy to use and without useful and fast feedback it will be time consuming with the risk that people do not use it. Encoded libraries should be fast and be able to identify synonyms and misspelled entries. The use of best practice advice options can improve the usability substantially.

Looking at the determinants we can distinguish two main subjects: the system in which the POMR is integrated and the organization with its users in which the system is used. Both the system and the organization should be well prepared for using the POMR. Functionality, usability, system support, overview of patient information, interoperability, supporting clinical reasoning and data structure/content can be designed, naturally while designing the system the maturity of the organization and associated policies has to be taken into account. The organization needs to be ready and willing to use the POMR. More specifically, willing to integrate the problem list into daily routine, using it multi-disciplinary, discussing it with the patient, be sufficiently trained and follow the guidelines on using the problem list. This requires a sociotechnical approach and is equally important for successful implementing a POMR. All the determinants have to be taken into account, but the weight given to each of the determinants depends on the organization the POMR and problem list is used and implemented in. Therefore we did not distinguish important and slightly less important determinants.

Conclusion

This study shows that there is more to a successful implementation of a problem list to support the POMR than the technical software and hardware associated with electronic patient records. Both the technical and organizational aspects should be taken into account while implementing a problem list or POMR. The statements defining our determinants in more detail can be of use here.

The successful implementation and use of a problem list to support the POMR are related to 12 vendor independent determinants. All these determinants taken into account together appear to be a critical success factor for a successful implementation. We have not assigned weight to our determinants as their relative importance depends on various factors and should be determined within the organization the implementation is planned for.

Limitations

This research has its limitations. Firstly, we wanted to focus on the latest insights and performed a systematic literature search, and analyzed the articles of the last five years. As saturation occurred within these five years we are confident that we managed to gain the latest insight in the use of a problem list and the POMR. Still, there is always a chance of there having been relevant older articles.

Secondly, as some determinants are closely related, describing them separately may come across as somewhat unnatural. Despite these limitations the results of this systematic review can contribute to a better implementation and use of a problem list and the POMR.

Further research

Further research is required to establish the predictive quality of our determinants. Studies of the use of a problem list to support the POMR in daily clinical practice over several years are rare, especially generalizable studies combining qualitative and quantitative evaluation. Also the linking of data to items on a problem list is hardly scientifically described. Further research needs to focus on the use of the POMR and the determinants. It would be advisable to develop a scorecard to objectify the relevance of a determinant in a successful implementation of the POMR.

Abbreviations

EHR, electronic health record; POMR, problem-oriented medical record; SNOMED, systematized nomenclature of medicine; ICD 9–10, international classification of diseases and related health problems