Challenges in Administrative Data Management
Explore common issues in administrative data such as compliance, quality assurance, and collection issues impacting statistical divisions. Learn about solutions to improve data quality and accuracy in administrative records.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
Issues in Administrative Data Michael Biddington, UN ESCAP Statistics Division, Biddington@un.org Statistics Division http://www.unescap.org/our-work/statistics
Introduction 1. Issues with admin data 2. Quality Assurance 3. Solutions 4. Coverage (ABS) 5. Resources Statistics Division http://www.unescap.org/our-work/statistics 2
Common Issues Collection Issues compliance Legislation Differences in definitions of variables Stability of Data Metadata availability System Timeliness Political issues Large Volumes of Data Linking of records Confidentiality and consent Statistics Division http://www.unescap.org/our-work/statistics
SBR Admin data issues Births and Deaths Duplicates on the Register Units are not updated or deathed Data Items and Metadata Conceptual differences in the administrative collection to statistical concepts. Definitions are not the same across the collections or not readily available Database Systems and Business Rules Systems and business rules for derived items are calculated differently Statistics Division http://www.unescap.org/our-work/statistics
SBR Admin data issues Clerical Processing and Maintenance Industry coding might be clerical or system based/ auto- coded. Update of stock information is irregular Extracts and Reports Understanding the conceptual basis eg Output specifications may exclude some units eg cancelled units or inactive units. Consistent time based snapshots vs ad-hoc generation of outputs. Admin data is a complex process Statistics Division http://www.unescap.org/our-work/statistics
SBR Admin data issues These impacts can be seen; Admin record data errors Missing information Incorrect information Clerical coding/processing quality Validation of data entry/updates Quality of business process logic for derivations Statistics Division http://www.unescap.org/our-work/statistics
Quality Assurance 1. Know the data Understand the administrative process of the data supplier. Collection forms / process Purpose of collection Collection cycle (tax, billing etc) Engage with the provider Statistics Division http://www.unescap.org/our-work/statistics
Quality Assurance 2. Analyse Unit Record Changes All data should be reviewed in detail Focus on units with changes Check errors Detailed management information Validate data Micro level Macro level Statistics Division http://www.unescap.org/our-work/statistics
Quality Assurance 3. Clearance Processes Quality gates Quality measures Times series Counts Aggregates Clearance meetings Statistics Division http://www.unescap.org/our-work/statistics
Quality Assurance 4. Profiling Is a quality assurance process Focus on the important units Collect your own data (Forms / Calls) Resource intensive Statistics Division http://www.unescap.org/our-work/statistics
Possible Solutions Editing and transformation Collect your own data Outlier the results Data imputation Data integration Influencing the collection Statistics Division http://www.unescap.org/our-work/statistics
Long term solutions The number one solution is to influence the collection process Political support Collaboration Justify and convince Influence the key maintenance statistical priorities and updating of that information. Priorities around stratification variables Statistics Division http://www.unescap.org/our-work/statistics
Coverage What you want to measure? The economy Many solutions: Cover all establishments Cover all Legal Entities Household surveys ABS example Statistics Division http://www.unescap.org/our-work/statistics
Households Other Institutional units ABR 9.6m Newly-registered ABNs Households providing dwellings ABSBR 6.9m ACTIVE UNITS 4.9m Non- business ABNs COMMON FRAME 2.2m Cancelled ABNs Non-profiled units Household production for own final use Long-term non-remitters Profiled units EG Professional gambling TAU EN Does not withhold Income Tax Not registered for Goods & Services Tax Out of scope Foreign entities Households providing services NON-OBSERVED ECONOMY Subsistence Illegal activity Barter trade Backyard production SNA Production Boundary
Resources Using Administrative and Secondary Sources for Official Statistics: A Handbook of Principles and Practices (UN ECE) ABS Cat No 1522.0 Quality Management of Statistical Outputs Produced from Administrative Data Statistics Division http://www.unescap.org/our-work/statistics
Q&A Thank you! Statistics Division http://www.unescap.org/our-work/statistics
