In pursuit of transparency, and at least somewhat in response to the multiple lobbying scandals, in 2010 the Conservative–Liberal Democrat coalition established in the Ministerial Code a new requirement that British Government departments disclose quarterly lists of the external groups who met with government ministers. Each department uploads its own lists in its own format. The name of the organization or individual, the quarter in which they met with the minister or permanent secretary, and the purpose of the meeting must be reported, though the purpose is often listed as “general discussion” or similarly vague language. No additional information is required, though more information exists: minutes are generally kept, and the meetings are audio-recorded and frequently transcribed. The government argued that making available the minutes of meetings between all outside interests and government ministers would be costly and time-consuming.
Quarterly reports are filed online at www.gov.uk under the heading “transparency data,” along with tens of thousands of other government documents that might relate to transparency (e.g., salary disclosure data, hospitality and gifts, departmental spending). Thus, to get to ministerial meetings data, one has to search manually using either a keyword search (“meet*”) or by browsing the publication database by department and time period. While the data are arranged quarterly, they are not updated nearly as often as every quarter. Further, the published records are disclosed in different formats and with varying titles: For our period of analysis from the first quarter of 2011 up to and including the fourth quarter of 2015 there were 234 PDFs, 700 comma-separated value files, 52 MS Excel worksheets, 23 MS Word documents, six Open Document spreadsheets, 24 Open Document texts, and six rich text files. Some reports contained only meetings with external groups, others combined these with gifts, hospitality, and overseas travel reports; some reports separately reported meetings of individual ministers or secretaries, others synthesized all meetings of a department’s senior staff in one document; occasionally data from more than one quarter were included in a single document. As a result of these challenges, the meetings data are seldom analyzed (exceptions are Dommett et al. 2017 and Transparency International 2015).Footnote 9
Focusing specifically on the evaluation of the usability of transparency data for member of the public (one of the CPI’s stringency criteria mentioned before), we follow Piotrowski and Liao (2012), who identify a set of criteria—accuracy, accessibility, completeness, understandability, timeliness, and low cost—which can be applied to any government transparency data. Following Holman and Luneburg (2012), we add as another criterion whether the provided data are searchable, so that comprehensive, comparative, and specially targeted database queries are possible. We now evaluate the ministerial meetings data according to these usability criteria.
Accuracy
(preciseness, factuality) The meetings data offer little information about the meetings other than the broad “purpose of the meeting.” Among the most commonly stated purposes are generic descriptions such as “trade and investment,” “energy issues,” or “tax matters.” And some are even less precise: More than 2500 entries refer to “general discussions,” another 2500 to “introductory” meetings, 1050 to “catch-up” meetings, around 450 to “regular meetings,” around 250 to “general meetings,” and around 550 to either “routine meeting,” “talk meeting,” or “roundtable discussion.” In an additional 200 cases, the purpose of the meeting is not reported at all. A total of 10% of our acquired reports fail to offer any policy-specific information about what was discussed in any of the meetings listed.
Another problematic aspect is the frequent disclosure of individuals’ names without any indication of organizational affiliation. In a random sample of 5% of the groups listed in the meetings data, we identified 53 such cases (5.2%). Examples include Jacqueline Gold, CEO of the multinational retail company Ann Summers; Jin Liqun, who was helping the government to establish the Asian Infrastructure Investment Bank; and Michael Hintze, founder and chief executive of CQS, a credit asset management firm. While most of these individuals have some level of prominence, ordinary citizens cannot be expected to recognize their names and link them to the organizations they represent. The vague descriptions of the purpose of meetings and the omission of organizations’ names suggest they are what Piotrowski and Liao (2012) would label “intentional concealment.”
Accessibility
Online access to the meetings data is public and open; no registration is necessary. All files can be accessed via either the general gov.uk website or the publications section of the individual department websites. All files can be downloaded in the format provided by the source. Files provided in the .csv format can also be previewed in-browser.
Completeness
By the middle of 2016, 92.6% of the 877 required quarterly reports were available for the years 2011–2015. (The “877” is a function of 20 quarters x 44 department positions, minus three quarters during which the office of the Deputy Prime Minister no longer existed.) The data cover only the top two of the three tiers of government ministers (the Secretaries of State and the Ministers of State; only the Foreign and Commonwealth Office and the Department for International Development also consistently reported meetings by their Parliamentary Under-Secretaries of State) plus the top level of the Civil Service (the Permanent Secretaries). However, the 5000 senior civil servants at the next levels do not have to report their meetings, nor do Special Advisers to ministers (their political staff). One department, Export Finance, had not published any meeting disclosures by mid-2016. The incomplete data provided and nondisclosure of meetings with other levels of government suggest a substantial shortfall in fulfilling Piotrowski and Liao’s (2012) specification that “all necessary parts” be published.
Understandability
All meetings disclosures are arranged and written in a way that makes them easily understandable. For the most part, the reports eschew technical language and the use of uncommon acronyms. Filers could possibly argue that the use of generic statements of the meetings’ purposes increases their understandability for the lay public; however, their lack of accuracy and completeness is better described as a hindrance to transparency and open government.
Timeliness
As mentioned above, our data collection during the third and fourth quarters of 2016 revealed that 7.4% of quarterly reports from the years 2011 to 2015 were still not available online. Moreover, almost 30% of reports about the first quarter of 2016 and 21% of reports about the fourth quarter of 2015 had not yet been uploaded, which indicates a failure on the part of departments to provide their transparency information in a timely manner.
Free or low cost
Apart from acquisition costs and internet access fees, access to the quarterly meetings reports is free of charge.
Searchability
The biggest usability obstacle is the lack of a complete and searchable database of ministerial meetings with external groups. Meeting reports are found in the publications database at gov.uk; they do not have their own site. This means users have to search and sift through a very large database of different document types to reach the meetings data. To give but one example: a keyword search for “BAE Systems” Inc., a company that has met with department officials 383 times between 2011 and 2015, with the filter “transparency data” for publication type at www.gov.uk/government/publications, yields 309 results, including documents about transactions, departmental spending, and contracts. And users still may not have a comprehensive set of what is available, since there is no website dedicated to meetings disclosure. It is also not possible to do a reliable targeted search for either external groups or Ministers/Secretaries. Considerable time and skill are required to collect, synthesize, and clean the disparate data.
Based on these criteria, the usability of the Ministerial Meetings data for citizens at large can be categorized as low. In Piotrowski and Liao’s four-quadrant typology of the relationship between transparency and usability (2012, 86), we would assign the UK to the “overload” designation “in which government information is disclosed in large amounts, but without sufficient attention to information usability” (Piotrowski and Liao 2012, 88).