DASA ROUNDING POLICY STATUS: AUTHOR: OWNER: FINAL HOB DASA(WDS) DASA EXECUTIVE COMMITTEE ISSUE DATE: 7th May 2009 REVISED: 21st July 2010 Why do we need a policy? 1. Rounding is desirable both as a means of disclosure control and to improve the clarity of outputs and convey appropriate levels of precision to users. Rounding needs to be implemented across DASA in a coherent and consistent way. Reasons for rounding 2. Rounding is DASA’s preferred method of disclosure control in published statistics. Rounding of small numbers preserves anonymity of data subjects in aggregate tables. See the DASA policy on Disclosure and Confidentiality for more details. 3. Rounding can also improve the clarity of tabulated data. In most cases, the extra detail provided by unrounded figures is not needed, and may obscure the main features of the data. 4. Rounding figures makes them less precise, but not less accurate. Less precision can be an advantage, as unrounded figures may mislead users as the accuracy of the figures. Minor corrections to the underlying data are more likely to affect unrounded figures than rounded ones. Excel Formula 5. The Excel 2003 formula for rounding to the nearest 5 is =IF(AND(A1<>0,ABS(A1)<5),"~",MROUND(A1,SIGN(A1)*5)) 6. The Excel 2003 formula for rounding to the nearest 10 with numbers ending in 5 being rounded to the nearest multiple of 20 is =IF(MOD(ABS(A1),10)=5,MROUND(A1,SIGN(A1)*20),MROUND(A1,SIGN(A1)*10)) What is DASA’s policy? 7. The appropriate rounding scheme will depend on the type of statistics. Rounding policies for DASA’s main data types are set out below. 8. The rounding policies have been agreed following discussion with subject matter experts, and taking into account disclosure, precision, specific business 1 requirements and practical implementation issues. The different rounding schemes for different data types reflect the fact that these issues are different for each data type. If further information is required on the reasons behind the different policies, you should contact HOB DASA WDS for details. Manpower Statistics 9. Manpower statistics are considered to be statistics relating to service or civilian personnel that are not specifically health related. 10. Manpower statistics should normally be rounded to the nearest 10, with numbers ending in ‘5’ being rounded to the nearest multiple of 20 to prevent systematic bias. 11. In cases where outputs involve small numbers, figures can be rounded to 5 at the discretion of the Head of Branch. However care should be taken that such data are consistent with previously published figures. 12. Data that are considered non-sensitive and are already in the public domain (including data on rank and sex for senior officers such as published in TSP 9 may be published unrounded in DASA outputs. 13. If a customer (whether internal or external) has a genuine need for unrounded figures for statistical, research or legal purposes only, then it may be possible to provide unrounded figures providing the customer signs a written agreement that states what the data may be used for, and committing not to pass on the unrounded figures to anyone else. All such cases should be discussed with Head of DASA PSA. Suggested wording for such an agreement is provided at Annex A. 14. Unrounded figures should not be provided (even to internal customers) except in situations covered by 12 and 13 above. 15. Forecast data should also be rounded where possible. Health Statistics 16. Health statistics are considered to be medical and casualty statistics, and also statistics on war pensions, the Armed Forces Compensation Scheme, and on health and safety. 17. Medical information and operational casualty figures should normally be published unrounded, as exact numbers are often required for research purposes. However, to prevent disclosure any numbers less than 5 should be shown as ‘~’. For cases where there is only 1 cell in a row or column that is less than 5, the next smallest number should also be suppressed so that numbers cannot simply be derived from totals. 18. Non-medical information such as war pensions, AFCS and Health and Safety statistics should be rounded to the nearest 5. 2 19. There is a risk associated with this rounding policy in that the possibility of being able to derive numbers less than 5 by comparing different outputs, and thus potentially being able to derive information about individuals, cannot be ruled out. However it is considered that the risk of this happening is sufficiently small to be acceptable. Financial Statistics 20. Financial statistics encompass a range of information such as defence expenditure, contracts statistics, trade statistics, and industry and employment statistics. 21. There are a number of areas of the Department that publish financial data, and in most cases DASA is not the data owner. For many types of financial data, panMOD disclosure policies are already in place or are being set up. 22. Financial statistics published by DASA should be rounded according to MOD policy and best practice. More detail on this can be found at Annex B. Equipment Statistics 23. There are no disclosure issues under the Data Protection Act for equipment data, so the issue of rounding largely comes down to deciding the appropriate level of precision for the figures – taking account of data quality and security implications. 24. Equipment statistics should normally be rounded to 10, but may be left unrounded or rounded to 5 when dealing with small numbers if there is a requirement for more precise figures. Statistics may also be rounded to 100 or 1000 when dealing with consistently large numbers. Where figures are published on a regular basis a consistent rounding policy, which may be to leave them unrounded, should be agreed at the outset and adhered to from then on. 25. In some cases it may be inappropriate to publish unrounded figures even if there is a business requirement for them, due to security or data quality concerns – this should be considered when deciding on a rounding scheme. Survey Statistics 26. There is often a business requirement to publish results of MOD surveys unrounded, due to small population sizes and the types of analyses that the numbers support. It is difficult to apply an overall rounding policy to survey data as different surveys are based on different sample sizes and different populations, and will thus have different disclosure issues. 27. Rounding policies for surveys should be agreed on a case by case basis. Where results of a particular survey are published on a regular basis, a consistent rounding policy should be applied. Numbers should typically be rounded to 5 or 10 unless there is a business reason to publish unrounded figures. 3 28. Survey outputs should be checked for potential disclosure issues, and where there is concern small numbers should be concealed. Examples of cases where there is potential for disclosure may include: a. Surveys where the sample population is easily identifiable b. Cases where the output includes very small numbers 29. Any branch publishing survey results has a responsibility to decide on a rounding policy for that survey and ensure that there is no risk of disclosure if publishing unrounded numbers. Survey reports should include mention of the agreed rounding policy and any measures that were taken to prevent disclosure. Search and Rescue Statistics 30. This section on Search and Rescue statistics was added in version 1.1 of this policy published in July 2010. Search and Rescue statistics were excluded from the original version of this policy as at the time of publication search and rescue statistics were due to be ceased. 31. Search and Rescue statistics should be published unrounded. There is no disclosure risk as they do not involve personal data, and the data are validated at source so there are no concerns over inaccuracy of the figures. The primary customers for the statistics are internal MOD customers who have a requirement for unrounded data for management information purposes – many of the statistics published include small numbers which would be largely obscured by rounding. Other Statistics 32. Statistics not covered by any of the above categories should normally be rounded to 10 with numbers ending in 5 being rounded to 20. 33. If the statistics in question involve particularly large numbers, then it may be appropriate to round to a larger number. 34. If there is a requirement to publish unrounded figures, this may be possible depending on the nature of the data, but you should with check HOB WDS first. 35. You should aim to use the same rounding scheme for all outputs involving that data type. Percentages 36. Percentages should be based on unrounded numbers. 37. In cases where percentages are based on particularly small numbers, showing percentages based on unrounded numbers may present a disclosure risk. If it is possible to derive from a percentage the exact number of people covered by that percentage and that number is less than 5, you should take measures to prevent this. This may involve showing the percentages to less significant figures, hiding percentages based on small numbers (though you should make sure it is not 4 possible to derive these percentages from the sum of the rest), or concealing the total population size that the percentages are based on. 38. The number of significant figures that percentages should be shown to will depend on the circumstances. However in most cases it will be appropriate to use 0 or 1 decimal places. Consistency 39. When publishing statistics that are already available from another source, figures should be rounded consistently with the other source where it is known that the appropriate level of precision of the figures from the other source have been given professional consideration. If it is felt that statistics published by another source are being incorrectly rounded, DASA statisticians should consider contacting the publisher and providing advice on rounding best practice. Implementation 40. The policy takes effect immediately, and should be applied to all new outputs. It is recognised that in some cases where regular publications are non-compliant with the policy, branches may require some time to amend their processes – where there is a risk of disclosure or breach of confidentiality this should be done immediately, but otherwise branches should ensure that regular processes are amended within 3 months of the policy being formally approved. 41. It is the responsibility of Heads of Branches to ensure that their branch’s outputs are compliant with the policy, and that their staff understand the policy and the principles of rounding. 42. A PowerPoint presentation will be made available alongside this policy, which can be used as a quick reference guide and included in staff induction processes. 43. Customers seeking rounding advice should be advised to follow the appropriate rounding policy for the data type they are dealing with. The MOD FOI Guidance Note on Statistical Data includes a paragraph on rounding which suggests that numbers should typically be rounded to 10, and recommends that people seek advice from DASA. 44. HOB DASA(WDS) has overall responsibility for this policy, and should be consulted if there is any confusion over any part of it, or if there is uncertainty as to how a particular output should be rounded. 5 Annex A – Wording to be used when providing unrounded manpower statistics to internal customers The following wording should be used when providing unrounded manpower statistics to internal customers for statistical or research purposes: These unrounded data are being passed to you to be used for statistical purposes only within the Ministry of Defence, in accordance with the Data Protection Act 1998: Section 33. Since they may lead to the identification of individuals, you may not publish them, nor use them in response to a Freedom of Information Act enquiry, nor in a reply to a Parliamentary Question, nor otherwise pass them to a third party. You may not use the data for anything other than a statistical purpose: you may not process these data to support measures or decisions with respect to particular individuals. For data to use in respect of legal proceedings, please contact DASA directly. 6 Annex B: Rounding Policy for Defence related expenditure data and statistics This guide outlines the suggested rounding conventions for the type of data and statistical outputs which appear in UKDS Chapter 1 and other outputs produced internally and externally by DASA DESA-DEA. This is not an exhaustive guide and it is advised that if you are not a ‘subject matter expert’ in this area that you seek advice from Head of DASA DESA-DEA before proceeding. All published numerical output should be reviewed as they are published to decide whether the appropriate degree of rounding has been applied, having regard for the considerations of clarity and precision as outlined in the main DASA Rounding Policy. Data /Statistics type Departmental Resources MOD Chart of Accounts data – RDEL and CDEL categories MOD Chart of Accounts data – Resource Account Code level MOD R&D expenditure Industry & Employment Estimates of MOD expenditure within UK industry groupings (SIC code level) Rounding recommendation – Internal publication Rounding recommendation – External publication Rationale Linked UKDS 2008 tables To nearest £1M, Inclusive of non-recoverable VAT at current prices As Internal 1.1,1.2,1.3,1.4,1.5,1.6,1.7 Depending on RAC, seek advice from CFAT,DP&A or lead policy sponsor via DASA-DESA-DEA As Internal Precedent set elsewhere as data appears at this level of accuracy and precision in published MOD accounts which is audited by NAO. Level of disclosure and rounding for some RACs will depend on national security issues. To nearest £1M, Inclusive of non-recoverable VAT As Internal To nearest £10M, exclusive of VAT at current prices As Internal Level of accuracy and precision is governed by the published MOD accounts which are audited by NAO. Rounding convention follows that set by ONS in their GERD R&D survey Level of rounding reflects concerns with quality, coverage and definitional uncertainties with the underlying contracts data at SIC level. Individual components are rounded independently which mean that sum totals may not add up exactly. 7 1.1,1.2,1.3,1.4,1.5,1.6,1.7 1.8 1.9/1.9a Estimated National defence related employment estimates Estimated Regional defence related employment estimates To the nearest 5,000 FTE To the nearest 1,000 FTE As Internal Level of rounding reflects concerns with quality, coverage and definitional uncertainties with the underlying data from the Annual Business Inquiry and internal contracts data. Individual components are rounded independently which mean that sum totals may not add up exactly. Level of rounding reflects concerns with quality, coverage and definitional uncertainties with the underlying contracts data at region/location level As Internal 1.10 1.11,1.11a,1.11b Individual components are rounded independently which mean that sum totals may not add up exactly. Estimated regional direct MOD expenditure – Equipment & Non Equipment To nearest £10M, exclusive of VAT at current prices Rounding as Internal. Considered release on case by case basis Level of rounding reflects concerns with quality, coverage and definitional uncertainties with the underlying contracts data at region/location level. Not published in UKDS Individual components are rounded independently which mean that sum totals may not add up exactly. Trade Defence Exports & Import Deliveries Balance of To nearest £1M, at current prices To nearest £1M, exclusive of As Internal Precedent set elsewhere as data appears at this level of accuracy and precision in published in the Annual Report on Strategic Arms Control. Level of accuracy and precision previously agreed at Defence Trade Statistics Working Group Precedent set elsewhere as data appears at As Internal 8 1.13,1.14 1.15 Payments: Trade in Services International Defence International Defence expenditure MOD Operations and Peacekeeping costs Defence Contracts Contract values Annual payments by contractor Annual payments by contract number VAT at current prices this level of accuracy and precision in published in ONS publication ‘The Pink Book’. To the nearest million currency unit As Internal Reproduced from secondary source data – follows published rounding conventions. 1.20,1.21,1.22 To nearest £1M, Inclusive of non-recoverable VAT at current prices As Internal Precedent set elsewhere as data appears at this level of accuracy and precision in published MOD accounts which is audited by NAO. 1.19 To nearest £10M, exclusive of VAT at current prices Not published externally without prior consultation with DCD. If published externally, level of rounding agreed with DCD beforehand. Not published externally without prior consultation with DCD. If published externally, level of rounding agreed with DCD beforehand. No external publication due to statutory exemptions which relate to commercial and market sensitivities Not published in UKDS To nearest £1M, exclusive of VAT at current prices To nearest £1M, exclusive of VAT at current prices Not published externally without prior consultation 9 Internal - Level of rounding reflects concerns with quality, the underlying contracts data at contract value level No external publication due to statutory exemptions which relate to commercial and market sensitivities Published at payment banding level in UKDS table1.18/1.18a Internal - Level of rounding reflects concerns with quality, the underlying contracts data at payment level Not published in UKDS No external publication due to statutory exemptions which relate to commercial and Annual individual contract payments at SIC level To nearest £10M, exclusive of VAT at current prices with DCD. If published externally, level of rounding agreed with DCD beforehand. market sensitivities Not published externally with prior consultation with DCD. If published externally, level of rounding agreed with DCD beforehand. No external publication due to statutory exemptions which relate to commercial and market sensitivities 10 Internal - Level of rounding reflects concerns with quality, the underlying contracts data at contract number level Internal - Level of rounding reflects concerns with quality, coverage and definitional uncertainties with the underlying contracts data at SIC level. Not published in UKDS