Enhancing Energy Statistics through Administrative Data Utilization

Use of Administrative Data in EIAs Data Program For 10thMeeting of the Oslo Group on Energy Statistics May 12, 2016 | Aguascalientes, Aguascalientes, Mexico By Stephen Harvey, Assistant Administrator for Energy Statistics U.S. Energy Information Administration www.eia.gov Independent Statistics & Analysis

U.S. Energy Information Administration (EIA) Stephen Harvey, U.S. Energy Information Administration Aguascalientes, Mexico, May 12, 2016 2

What EIA does Statistical and analytical agency within the U.S. Department of Energy Collect, analyze, and disseminate independent and impartial energy information Committed to promoting: Sound policymaking Efficient markets Public understanding of energy and its interaction with the economy and the environment By law, EIA data, analyses, and forecasts are independent of approval by any other officer or employee of the U.S. government Stephen Harvey, U.S. Energy Information Administration Aguascalientes, Mexico, May 12, 2016 3

Selected EIA strategic data objectives Maintain an integrated, comprehensive data program Improve the data planning and development process Establish and implement standard, reusable processes Evaluate and implement improvements on a regular basis Improve the survey respondent experience through Effective communications Clear definitions and instructions Facilitated submissions through technology Protect the confidentiality of data entrusted to EIA Stephen Harvey, U.S. Energy Information Administration Aguascalientes, Mexico, May 12, 2016 4

Federal Policy Regarding the Use of Administrative Data in Official U.S. Statistics Stephen Harvey, U.S. Energy Information Administration Aguascalientes, Mexico, May 12, 2016 5

U.S. statistical policy promotes the increased use of administrative data Definition: ..administrative, regulatory, law enforcement, adjudicatory, financial, or other data collected for other than statistical purposes. The increased use of administrative data for statistical purposes can generate a range of benefits. Most notably, individuals, businesses, and institutions will benefit through agencies' use of existing information that would otherwise need to be collected from them again through costly and duplicative surveys. Stephen Harvey, U.S. Energy Information Administration Aguascalientes, Mexico, May 12, 2016 6

Four goals of U.S. policy regarding use of administrative data Strengthen the federal statistical programs by increasing the utility of and access to administrative data. Promote collaboration between agencies on expanding use of administrative data, while protecting privacy and respecting confidentiality parameters. Establish best practices and a model for inter-agency data sharing for statistical purposes. Identify and monitor barriers that may impede agencies sharing administrative data. Office of Management and Budget (OMB) Memorandum M-14-06 Guidance for Providing and Using Administrative Data for Statistical Purposes, February 14, 2014, https://www.whitehouse.gov/sites/default/files/omb/memoranda/2014/m-14-06.pdf Stephen Harvey, U.S. Energy Information Administration Aguascalientes, Mexico, May 12, 2016 7

EIA Program Innovation and Calculated Use of Administrative Data Stephen Harvey, U.S. Energy Information Administration Aguascalientes, Mexico, May 12, 2016 8

EIA already makes extensive use of administrative data Fill data gaps Review quality of survey results Calculate non-sample estimates Provide inputs to models At least 62 administrative datasets used for data publications and models likely undocumented uses of administrative data in analyst-driven quality reviews Stephen Harvey, U.S. Energy Information Administration Aguascalientes, Mexico, May 12, 2016 9

Important areas where EIA uses administrative data Imports and exports of energy Buildings lists for consumption survey sampling Oil and natural gas production in certain areas State-level breakouts of energy production and use Energy transportation by rail Financial operations of energy companies National Oceanic and Atmospheric Administration local weather data Stephen Harvey, U.S. Energy Information Administration Aguascalientes, Mexico, May 12, 2016 10

Administrative data may not meet all needs: EIA s oil production experience Modeled oil and gas production based on tax data reported by the state of Oklahoma Comparison of Oklahoma Monthly Crude Oil Production Estimates, 2015 Thousand b/d 500 Survey estimate Data lagged, with delays in posting volumes for near months 450 400 350 EIA estimate based on administrative data Model estimated how lagged data was likely to be based on past trends 300 250 Oklahoma administrative data 200 150 In 2015, EIA began surveying oil and gas companies directly 100 50 Materially changed assessment of Oklahoma estimates 0 Jan Feb Mar Apr May Jun Jul Aug Sep 2015 EIA-914 Estimate State Data derived from well-level figures ALR Estimate Stephen Harvey, U.S. Energy Information Administration Aguascalientes, Mexico, May 12, 2016 11

Recent coordination promises significant enhancement of petroleum supply balances Near-real-time petroleum export data promises significant improvement in EIA petroleum balance reports EIA summarizes the previous week s petroleum complex supply balances every Wednesday, including oil supply, refinery production, imports, and exports Many elements surveyed, but weekly oil production and petroleum product exports are estimated Agreement with U.S. Customs and Border Protection now permits EIA analysts to see near-real-time export data Working with OMB and the U.S. Census Bureau (publishes official U.S. export data) to reach agreement to incorporate estimates based on this data into the weekly balances Stephen Harvey, U.S. Energy Information Administration Aguascalientes, Mexico, May 12, 2016 12

For more information U.S. Energy Information Administration | www.eia.gov Short-Term Energy Outlook | www.eia.gov/steo Annual Energy Outlook | www.eia.gov/aeo Monthly Energy Review | www.eia.gov/mer EIA Information Center InfoCtr@eia.gov (202) 586-8800 24-hour automated information line about EIA and frequently asked questions. Stephen Harvey, U.S. Energy Information Administration Aguascalientes, Mexico, May 12, 2016 13