
Earth Observation System Data and Information System Metrics Report
Explore the metrics report for Fiscal Year 2012 from the Earth Observation System Data and Information System (EOSDIS), highlighting data management functions, web activities, and statistics collected from the Distributed Active Archive Centers (DAACs). Gain insights into the performance of EOSDIS and its components during this period.
Download Presentation

Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
EOSDIS FY2012 Annual Metrics Report Prepared By: Hyo Duck Chang Adnet, Inc. Brian Krupp Adnet, Inc. Lalit Wanchoo Adnet, Inc. February 2013
Preface The Earth Sciences Data and Information System (ESDIS) Project (Code 423) prepared the following report on metrics from across the Earth Observation System Data and Information System (EOSDIS). The 12 Distributed Active Archive Centers (DAACs) of EOSDIS support different scientific disciplines and provide an individualized set of products and services to their science community and the public. Although discipline oriented, the DAACs engage in common data management functions of ingest, archive and distribution, as well as describing their data and services on web sites. Metrics are collected on a daily basis from each DAAC. The ESDIS Project collects these metrics in a tool called the ESDIS Metrics System (EMS). DAAC analysts can view their detailed metrics to assess internal performance and trends. The ESDIS Project combines these metrics, not for comparisons between the DAACs, but as a system level view of EOSDIS performance. This report provides snapshots of metrics as the combination of the individual DAACs and as a system. During FY2012, additional metrics were collected in the EMS. OBPG has provided its distribution metrics to the EMS since May 2012 and the OBPG metrics used in this report are obtained from the EMS for June - September 2012 and the OBPG website for October 2011 - May 2012. Two other new sources are LPDAAC DEM and LPDAAC LTA providing the ASTER GDEM metrics. Format changes made to FY2012 are: 1) addition of a Land Atmosphere Near Real-time Capability for EOS (LANCE) summary table and 2) inclusion of the CALIPSO metrics in ASDC. Previously the CALIPSO metrics were presented in a separate spreadsheet. In keeping with previous years, and in order to support trend comparisons, the metrics data are presented on a fiscal year basis, not by calendar year. These reports are posted online with metrics as far back as 1996. Each report includes some historical trend information. If you have any questions or comments, please contact Jeanne Behnke at (301) 614-5326 or jeanne.behnke@nasa.gov or Kevin Murphy at (301) 614-5580 or kevin.j.murphy@nasa.gov. February 2013 FY2012 Annual Report 2
Introduction This report presents statistics on data metrics and web activities at the EOSDIS DAACs during Fiscal Year 2012 (October 1, 2011 through September 30, 2012) from the Earth Science Data and Information System (ESDIS) Metrics System (EMS). EMS supports the ESDIS project management by collecting and organizing various metrics from the Earth Observing System (EOS) Data and Information System (DIS) DAACs and other sources. The EMS collects and presents data on the usage of products and services delivered via the Internet or managed in EOSDIS archives. EMS consists of a Data Metrics component and a Web Metrics component. The Data Metrics component provides statistics on data ingest, archive and distribution plus data users profile information. The Web Metrics component provides statistics on web site visits, views and visitors with a variety of related parameters. This report contains tables and graphs of FY2012 statistics and comparisons to previous years. Values for previous fiscal years are produced from EMS unless noted otherwise. Summary tables, text, graphs, and more detailed statistics tables are also included. As before, metrics for the Near Real-Time (NRT) products are presented in a separate spreadsheet and their metrics are not used in the distribution trend analyses presented in this report. A separate summary table, called LANCE Summary, for NRT products is added to the FY2012 Report. Beginning in FY2012, the CALIPSO metrics are included in the ASDC tables and their metrics were used in the trend analyses. All bots-related distributions (downloads by Internet search engines for indexing purposes) are excluded in the ASF metrics. Definitions for terms used in this report can be found in the Definitions worksheet. February 2013 FY2012 Annual Report 3
EOSDIS Summary EOSDIS FY2012 Metrics (Oct. 1, 2011 to Sept. 30, 2012) Unique Data Sets Distinct Users of EOSDIS Data and Services Web Site Visits Average Archive Growth Total Archive Volume End User Distribution Products End User Average Distribution Volume 6,886 1.5 M 2.6 M 5.4 TB/day 7.4 PB 636 M 17.1 TB/day Unique Data Sets: Total number of unique data sets distributed in the fiscal year. Distinct Users of EOSDIS Data and Services: Total unique users across EOSDIS Data Users and Web Visitors, per DAAC and summed (does not include LANCE Web Visitors) Web Site Visits: Sum of web visits for DAACs and LANCE data providers where a visit represents a user session not broken by more than 30 minutes and a duration of at least one minute Average Archive Growth: Sum across reporting DAACs of the data volume added to the individual archives divided by the days in the year Total Archive Volume: Sum across reporting DAACs of the data volumes in the archive as of end of the fiscal year End User Distribution Products: Total number of products distributed from all reporting DAACs and LANCE data providers End User Average Distribution Volume: Sum across reporting DAACs and LANCE data providers of the data volume distributed for the fiscal year divided by the days in the year February 2013 FY2012 Annual Report 4
Land Atmosphere Near Real-time Capability for EOS (LANCE) Summary LANCE FY2012 Metrics (Oct. 1, 2011 to Sept. 30, 2012) Unique Data Sets Distinct Registered LANCE Users Web Site Visits Average Production Growth Total Production Volume End User Distribution Products End User Average Distribution Volume 197 879 0.6 M 2.2 TB/day 0.03 PB 66 M 2.3 TB/day Unique Data Sets: Total number of unique data sets distributed in the fiscal year Distinct Registered LANCE Users: Total number of unique LANCE users who registered and retrieved NRT products from all LANCE data providers, excluding the unregistered users who downloaded imagery products from the MODIS Rapid Response System Web Site Visits: Sum of web visits for LANCE data providers where a visit represents a user session not broken by more than 30 minutes and a duration of at least one minute Average Production Growth: Sum of the NRT data volume generated by all LANCE providers divided by the days in the year, including the NRT and NRT2 processing streams Total Production Volume: Two weeks worth of production volume of the NRT/NRT2 data products, calculated by multiplying Average Production Growth by 14 (days) assuming the deletion of the NRT/NRT2 products two weeks after production End User Distribution Products: Total number of products distributed from all reporting LANCE data providers End User Average Distribution Volume: Sum across reporting LANCE data providers of the data volume distributed for the fiscal year divided by the days in the year February 2013 February 2013 FY2012 Annual Report FY2012 Annual Report 5
Data Metrics Distribution By Data Center Volume by Domain Products by Domain Top 20 Countries Top 10 Products Unique Product Count Ingest Archive Total Archive Data Users Distinct Users Repeat Users Top 20 Countries Foreign Distribution Near Real-time Products Production Distribution February 2013 FY2012 Annual Report 6
Ingest Ingest is the amount of data coming into a DAAC over a period of time and includes all product levels. For this report, the data is presented as the amount of data entered into each DAAC during FY2012. The sum of all DAACs is the total ingest for EOSDIS. OBPG and ORNL are unable to provide ingest metrics at this time. DAAC Volume (TBs) Files (Millions) ASDC ASF CDDIS GESDISC GHRC LPDAAC MODAPS NSIDC PODAAC SEDAC Total 322.3 135.2 0.6 96.4 0.7 69.3 51.6 15.4 13.6 0.4 705.5 11.0 0.0 9.3 4.9 0.5 6.4 0.5 2.5 0.8 0.0 35.9 February 2013 FY2012 Annual Report 7
Archive This table shows the amount of data added to the archive over a period of time and includes all products levels. Archive metrics for OBPG and NSIDC V0 are not available at this time. DAAC Volume (TBs) Files (Millions) ASDC ASF CDDIS GESDISC GHRC LPDAAC MODAPS NSIDC ORNL PODAAC SEDAC Total 321.8 1,103.8 10.7 5.2 7.0 8.7 0.1 6.3 39.8 2.5 0.0 0.8 0.0 81.2 0.5 138.8 0.7 69.3 294.0 15.4 0.0 13.6 0.4 1,958.4 February 2013 FY2012 Annual Report 8
Total Archive Size The Total Archive Size describes the EOSDIS archive at the end of FY2012. This includes all data (including ancillary) but not data marked for deletion. DAAC Volume (TBs) Files (Millions) ASDC * ASF CDDIS ** GESDISC GHRC LPDAAC MODAPS NSIDC ORNL *** PODAAC SEDAC Total 2,167.0 2,654.9 93.9 12.4 92.6 53.4 0.5 55.7 69.0 20.2 0.3 2.9 0.0 400.9 6.7 515.7 7.1 954.2 1,159.7 63.9 0.6 41.5 3.3 7,574.6 * ASDC archive size is based on the archive values for LaRC ANGe and LaRC ECS provided by John Kusterer of ASDC ** CDDIS archive size was derived from the archive values (6.98 TB, 95,704,005 files) as of 1/30/2013 provided by CDDIS *** Archive values were provided by B. McMurry of ORNL on 2/15/2013 February 2013 FY2012 Annual Report 9
Distribution By DAAC Distribution presents the amount of data successfully distributed to Public Users. Distribution by DAAC ASDC ASF CDDIS GESDISC GHRC LPDAAC MODAPS NSIDC OBPG* ORNL PO.DAAC SEDAC Total Products (Millions) Total Volume (TBs) 10.63 0.85 120.03 168.68 0.79 70.59 95.25 24.34 16.77 6.71 54.07 1.60 570.28 643.93 188.18 37.52 1,327.66 7.28 1,200.87 1,289.79 168.34 370.49 10.16 161.62 1.47 5,407.31 * OBPG data for October 2011 May 2012 were taken from the OBPG Website February 2013 FY2012 Annual Report 10
Volume Distributed By Domain Volume Distribution presents the volume of data successfully distributed to Public Users by Domain. Total Volume Distributed ASDC ASF CDDIS GESDISC GHRC LP DAAC MODAPS NSIDC OBPG* ORNL PO.DAAC SEDAC Total Foreign US COM US EDU US GOV US ORG US Other Unknown Total Volume (TBs) * OBPG data for October 2011 May 2012 were taken from the OBPG Website 217.28 96.57 214.16 85.09 1.28 8.34 21.22 50.12 3.35 6.94 104.54 0.03 19.14 4.06 29.48 1.35 2.14 3.61 0.19 0.41 0.35 451.81 49.11 380.19 410.48 0.58 32.90 2.59 5.31 0.11 1.15 0.50 0.00 0.21 0.00 350.02 146.50 253.82 157.03 4.54 26.49 262.48 471.35 7.68 254.09 437.35 0.19 114.54 4.58 33.06 21.65 48.68 25.33 2.96 1.42 35.24 83.83 3.39 35.72 18.37 0.05 5.80 223.33 7.35 0.57 1.14 0.34 0.00 0.55 0.20 75.14 14.37 8.51 28.65 0.00 33.73 1.22 0.74 0.25 0.12 0.07 0.01 0.24 0.04 1,775.49 344.89 1,206.66 1,271.36 9.82 243.77 555.32 643.93 188.18 37.52 1,327.66 7.28 1,200.87 1,289.79 168.34 370.49 10.16 161.62 1.47 5,407.31 February 2013 FY2012 Annual Report 11
Product Distribution By Domain Product Distribution presents the number of products successfully distributed to Public Users by Domain. Total Products Distributed ASDC ASF CDDIS GESDISC GHRC LP DAAC MODAPS NSIDC OBPG* ORNL PO.DAAC SEDAC Total Foreign US COM US EDU US GOV US ORG US Other Unknown 3.05 2.16 2.68 1.45 0.01 0.12 1.15 0.21 0.09 0.14 0.27 0.01 0.10 0.02 92.02 4.62 5.85 15.13 0.86 0.90 0.64 66.76 7.98 53.91 29.47 0.29 8.59 1.68 0.37 0.04 0.31 0.06 0.00 0.01 0.01 23.05 8.02 11.99 8.67 0.15 0.67 18.04 37.73 1.57 19.64 29.83 0.00 6.22 0.25 9.44 3.22 3.92 4.42 0.09 0.45 2.81 3.23 0.07 0.59 0.31 0.00 0.23 12.34 5.17 0.19 1.02 0.03 0.00 0.13 0.16 17.97 7.55 3.62 10.48 0.00 13.28 1.16 0.72 0.42 0.08 0.03 0.01 0.30 0.04 259.72 35.94 103.75 100.14 1.41 31.01 38.31 Total Products (Millions) 10.63 0.85 120.03 168.68 0.79 70.59 95.25 24.34 16.77 6.71 54.07 1.60 570.28 * OBPG data for October 2011 May 2012 were taken from the OBPG Website February 2013 FY2012 Annual Report 12
Data Distribution - Top 20 Countries Ranking 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Country Volume (GBs) 3,150,341 366,820 272,329 247,060 147,341 Ranking 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Country Products 272,259,607 47,267,742 30,739,527 24,362,117 21,638,657 16,916,209 11,853,117 11,834,954 8,799,981 7,438,249 6,532,542 6,361,126 5,299,869 5,145,079 5,117,246 5,002,920 4,661,897 3,763,390 3,599,019 2,918,581 USA CHINA FRANCE JAPAN GERMANY KOREA, SOUTH UNITED KINGDOM BELGIUM CANADA AUSTRALIA TAIWAN RUSSIA DENMARK BRAZIL ITALY NETHERLANDS SPAIN INDIA AUSTRIA SWEDEN USA CHINA JAPAN GERMANY FRANCE UNITED KINGDOM INDONESIA KOREA, SOUTH CANADA BRAZIL BELGIUM RUSSIA ITALY AUSTRALIA SPAIN PORTUGAL INDIA CZECH REPUBLIC DENMARK TAIWAN 96,254 90,779 89,321 77,963 35,438 28,502 27,878 27,199 26,642 25,753 25,284 25,239 23,145 20,045 15,235 * Some products are inherently larger than other files in size and therefore may skew the results. ** When counting # of products, metadata files are excluded. February 2013 FY2012 Annual Report 13
Distribution of Unique Data Products Tables below show the number of unique data products distributed to public users during FY2012. In counting unique products, metadata were excluded. NRT products are not included. ASDC 815 ASF 41 CDDIS GESDISC 212 GHRC 221 LP DAAC MODAPS 243 NSIDC 372 OBPG * 65 ORNL 1,072 PO DAAC SEDAC 572 Total 6,689 2,248 646 182 * OBPG data for October 2011 May 2012 are not included since no product information is available. February 2013 FY2012 Annual Report 14
Data Distribution - Top 10 Products Top 10 Products Distributed By Volume* Product Description GBs Files ** 2,840,487 3,239,713 446,346 5,252,525 3,030,734 1,410,663 3,199,439 5,325,785 11,973,896 1,332,332 1 2 3 4 5 6 7 8 9 10 MYD021KM MOD09GA CAL_LID_L1-VALSTAGE1-V3 CALIPSO Lidar Level 1B profile data (CAL_LID_L1-ValStage1-V3) AIRIBRAD AIRS/Aqua infrared geolocated radiances MOD021KM Level 1B Calibrated Radiances - 1km MOD13Q1 MODIS/Terra Vegetation Indices 16-Day L3 Global 250m SIN Grid MOD09A1 MODIS/Terra Surface Reflectance 8-Day L3 Global 500m SIN Grid MYD03 Geolocation - 1km MAT1NXSLV MERRA 2D IAU Diagnostic, Single Level Meteorology, Time Average 1-hourly (2/3x1/2L1) MOD09GQ MODIS/Terra Surface Reflectance Daily L2G Global 250m SIN Grid Level 1B Calibrated Radiances - 1km MODIS/Terra Surface Reflectance Daily L2G Global 1km and 500m SIN Grid 238,001.11 215,509.78 199,404.97 188,918.54 187,906.68 162,792.37 156,108.68 119,162.63 95,156.49 94,676.79 Top 10 Products Distributed By File Count ** Product Description Files** 29,844,606 17,669,010 17,276,942 16,172,906 13,195,856 13,095,069 12,975,075 12,242,371 11,973,896 11,513,184 GBs 11,780.85 65.00 27,756.79 18,844.10 15,827.18 89,816.26 17,416.08 18,612.65 95,156.49 4,025.55 1 2 3 4 5 6 7 8 9 10 GNSS_DAILY_D GNSS_IGSTROP TRMM_3B42 MOD04_L2 MYD04_L2 MAI3CPASM AIRX2RET NLDAS_FORA0125_H MAT1NXSLV GPS_IGUORB GNSS Daily Compact Observation Data GNSS Final Troposphere Zenith Path Delay Product TRMM 3B42 3-Hour 0.25deg x 0.25deg and Other-GPI Calibration Rainfall Level 2 Aerosol Level 2 Aerosol MERRA 3D IAU State, Meteorology Instantaneous 3-hourly (p-coord, 1.25x1.25L42) AIRS/Aqua FINAL Level 2 Products (Without HSB) NLDAS Primary Forcing Data L4 Hourly 0.125 x 0.125 degree V002 MERRA 2D IAU Diagnostic, Single Level Meteorology, Time Average 1-hourly (2/3x1/2L1) GPS Ultra-Rapid Combined Orbit Solution Product * Some products are inherently larger than other files in size and therefore may skew the results. ** When counting # of files, metadata files are excluded. February 2013 FY2012 Annual Report 15
Distinct Data Users Distinct Data Users presents the number of distinct public users who received data product files. Distinct Data Users By Domain Foreign US COM US EDU US GOV US ORG US Other Unknown Total Distinct Data Users ASDC ASF CDDIS GES DISC GHRC LP DAAC MODAPS NSIDC OBPG * ORNL PO.DAAC SEDAC Total 1,209 1,263 516 368 1,477 455 396 109 64,030 7,691 1,849 1,303 129 4,464 2,771 55,750 14,497 7,272 2,497 200 5,105 2,530 1,902 480 325 131 17,596 9,180 3,569 8,111 131 1,059 371 24,197 2,114 2,061 986 7,078 2,941 1,979 650 4,789 313 307 15,884 3,484 2,603 402 12,321 2,367 1,181 533 111,167 35,017 6,691 317,400 79,802 28,749 15,792 1,149 26,678 13,861 74 6 246 144 628 460 12 30 19 25 324 108 4 28 82 782 498 61 11 168 55 1,018 351 1,518 611 1,259 510 10,705 5,893 3,417 2,894 82,237 87,851 3,065 40,017 30,755 14,010 5,879 24,563 18,182 170,561 483,431 * Does not include OBPG data for October 2011 May 2012 February 2013 FY2012 Annual Report 16
Repeat Data Users Repeat users are distinct Public users* who received data on more than one day in the fiscal year. Repeat Data Users By Domain Foreign US COM US EDU US GOV US ORG US Other Unknown Total Repeat Data Users * Does not include OBPG data for October 2011 May 2012 ASDC ASF CDDIS GES DISC GHRC LP DAAC MODAPS NSIDC OBPG * ORNL PO.DAAC SEDAC Total 508 753 220 185 347 122 139 52 15 91 37 15,714 3,532 642 608 13,595 4,048 2,302 1,161 334 102 103 43 4,798 3,098 1,093 2,635 7,722 1,225 854 506 1,545 838 569 277 1,398 108 142 2,692 674 472 2,870 914 374 218 11,350 3,292 757 212 102 2,657 1,077 62,873 18,706 7,667 6,041 392 7,659 3,021 45 4 106 61 99 6 192 106 4 89 59 1 49 286 84 11 351 98 50 155 132 2 18 7 2,126 791 1,282 477 25 5 370 146 1,695 803 23,502 22,924 613 12,043 10,767 3,566 1,864 4,241 4,894 19,447 106,359 February 2013 FY2012 Annual Report 17
Data Users - Top 20 Countries Ranking 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Country Users USA CHINA GERMANY FRANCE UNITED KINGDOM INDIA CANADA RUSSIA BRAZIL JAPAN AUSTRALIA SPAIN ITALY GUATEMALA INDONESIA IRAN NETHERLANDS POLAND MEXICO ARGENTINA 141,916 38,854 19,180 19,161 18,022 16,236 13,399 12,262 12,037 8,633 8,239 6,826 6,680 5,650 5,019 4,878 4,344 4,263 4,244 3,694 February 2013 FY2012 Annual Report 18
Foreign Distribution Distribution metrics for foreign public users are compared. Statistics are based on country information provided by the 12 EOSDIS DAACs. Foreign Country # of Users EU * 100,712 Canada 13,399 China ** 38,854 Japan 8,633 Other Foreign Countries 143,881 Unknown *** 13,784 # of Products (1000s) Vol (TBs) 105,801 8,800 47,268 30,740 66,883 27,398 747.75 76.14 358.22 241.27 345.52 360.08 * EU includes 27 European Union member countries. ** China includes only People s Republic of China and does not include Taiwan or Hong Kong. *** This represents the data users whose countries are unknown February 2013 FY2012 Annual Report 19
Production of Near Real-Time Products Near Real-Time (NRT) production represents the amount of data generated by the Land Atmosphere Near Real-time Capability for EOS (LANCE) data providers, including the two identical processing systems, NRT and NRT2. LANCE Provider AMSR-E NRT GESDISC NRT/NRT2 GESDISC NRT/NRT2 MODAPS NRT/NRT2 MODAPS NRT/NRT2 OMI NRT/NRT2 Total Instrument AMSR-E AIRS/AMSU-A MLS MODIS - Aqua MODIS - Terra OMI Volume (TB) Files (Millions) 0.03 16.81 0.38 381.17 385.74 6.47 790.61 0.00 1.61 0.42 5.94 5.76 0.07 13.79 Volume and file count include the data products deleted from archive February 2013 February 2013 FY2012 Annual Report FY2012 Annual Report 20 20
Distribution of Near Real-Time Products Near Real-time (NRT) Distribution provides the amount of data successfully distributed to registered users of the Land Atmosphere Near Real-time Capability for EOS (LANCE). LANCE provides access to near real-time data (<3 hours from observation) from MODIS, AMSR-E, AIRS, MLS and OMI instruments. Metrics for distribution volume, numbers of files distributed and users are presented. # of # of Instrument # of Products # of Files * Vol (GB) Registered Users Unregistered Users *** AIRS/AMSU-A AMSR-E ** MLS MODIS - Aqua MODIS - Terra OMI NRT Total 11 11 1,866,538 10,058 576,334 21,941,762 41,477,351 86,430 65,958,473 15,547.68 253.14 104.12 369,915.29 465,381.47 2,629.18 853,830.88 103 24 38 299 394 21 879 4 84 80 517,937 633,423 7 197 1,151,360 * Excludes metadata ** Includes the NRT products from GHRC and MODAPS *** Represents the number of unique IP hosts/e-mail addresses used to retrieve products from the Rapid Response System February 2013 February 2013 FY2012 Annual Report FY2012 Annual Report 21 21
Web Metrics Visitors and Visits Repeat Visitors Top 20 Domains Top 20 Countries LANCE Web Metrics February 2013 FY2012 Annual Report 22
Web Visitors and Visits EOSIDS web activity is measured by the number of Visits made, the number of pages Viewed and the number of distinct Visitors. Visits, Views, and Visitors count visits greater than or equal to 1 minute. Visits of at least one minute are considered to represent significant work accomplished, and many of the shorter visits are of less than a second. Data came from 11 DAACs (all DAACs on Slide # 16 except OBPG provide web metrics). # Unique Visitors 182,397 111,843 89,974 108,176 121,612 120,915 110,493 101,058 91,201 97,323 110,937 112,364 Month # Visits # Views Oct-11 Nov-11 Dec-11 Jan-12 Feb-12 Mar-12 Apr-12 May-12 Jun-12 Jul-12 Aug-12 Sep-12 230,705 157,371 127,924 153,552 173,827 177,227 163,265 152,320 142,353 156,729 173,619 165,028 2,266,709 1,935,419 1,617,810 1,818,955 2,159,762 2,120,751 2,096,160 1,962,906 1,955,975 2,003,694 1,910,171 1,872,823 FY2012 1,973,920 23,721,135 February 2013 FY2012 Annual Report 23
Repeat Web Visitors EOSDIS Web Visitors are characterized by the number of visits they make and how frequently they return. Visitors counted in the table below are those that stayed for one minute or more. Repeat Visitors are counted from the start of the Fiscal Year. FY2012 Web Visitors for Visits of one minute or more Total Visitors 220,609 # of Visits 2 3 4 5-6 7-9 10 - 14 15 - 24 25 - 49 50 - 99 100+ All DAACs 117,649 39,876 19,222 17,921 11,042 7,087 4,470 2,350 768 224 February 2013 FY2012 Annual Report 24
Top 20 Domains By # of Web Visitors The FY2012 Top 20 Domains for visits >= 1 minute is sorted by the # of Visitors. Data came from 11 DAACs (all DAACs on Slide # 16 except OBPG provide web metrics). All statistics are based on domains resolved by NetInsight, using host information. Percent Visitors Percent Visits Percent Views Domain Domain Ranking Visitors Visits Views 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Unresolved Network (.net) Commercial (.com) United States Educational Russian Federation Italy Australia Germany Canada Japan United States Government Argentina United Kingdom France India Brazil Mexico Spain Netherlands Organization (.org) 341,323 276,020 117,153 46,790 31,973 27,149 20,946 18,376 18,204 16,439 15,853 15,467 14,109 13,852 13,262 12,895 11,663 11,256 10,124 6,004 8.30% 6.70% 2.80% 1.10% 0.80% 0.70% 0.50% 0.40% 0.40% 0.40% 0.40% 0.40% 0.30% 0.30% 0.30% 0.30% 0.30% 0.30% 0.20% 0.10% 567,490 396,805 185,245 98,769 50,902 37,428 33,496 30,057 33,839 39,102 65,175 26,549 25,711 24,501 23,525 19,141 16,112 17,495 23,177 11,167 7.60% 7,061,242 5.30% 3,868,671 2.50% 1,708,251 1.30% 1,793,510 0.70% 0.50% 0.50% 0.40% 0.50% 0.50% 0.90% 1,390,811 0.40% 0.30% 0.30% 0.30% 0.30% 0.20% 0.20% 0.30% 0.20% 22.40% 12.30% 5.40% 5.70% 1.70% 1.40% 1.10% 1.20% 1.10% 1.70% 4.40% 1.00% 1.20% 0.90% 1.50% 1.20% 0.60% 0.90% 0.90% 0.80% 545,937 428,058 352,567 391,382 354,673 525,597 316,049 363,136 294,367 485,312 372,272 194,785 292,360 280,756 243,225 February 2013 FY2012 Annual Report 25
Top 20 Countries By # Web Visits The FY2012 Top 20 Countries for visits >= 1 minute is sorted by the # of Visits. Data came from 11 DAACs (all DAACs on Slide # 18 except OBPG provide web metrics). All statistics are based on country information resolved by NetInsight. Percent Visitors 1.20% 1.60% 0.60% 0.50% 0.20% 0.30% 0.20% 0.20% 0.20% 0.30% 0.10% 0.10% 0.20% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% Percent Visits 1.30% 1,329,338 1.40% 1,168,422 0.50% 0.50% 0.20% 0.20% 0.20% 0.20% 0.20% 0.20% 0.10% 0.10% 0.20% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% Percent Views 4.20% 3.70% 2.00% 1.00% 0.90% 0.80% 0.50% 0.50% 0.50% 0.40% 0.40% 0.40% 0.40% 0.30% 0.30% 0.30% 0.30% 0.20% 0.20% 0.20% Country Country Ranking Visitors Visits Views China United States India Russian Federation Korea, Republic of Canada Iran Italy Spain Great Britain Japan Indonesia Australia Germany Malaysia Brazil Chile Pakistan Peru Thailand 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 48,443 64,630 23,522 19,330 7,298 10,532 7,328 9,565 8,011 10,927 2,533 5,179 7,288 4,814 4,135 3,516 2,701 3,817 3,221 3,243 97,686 103,508 38,445 33,741 15,715 18,524 12,131 13,648 14,161 15,956 6,671 7,515 12,647 9,456 6,401 7,099 4,610 4,936 5,341 5,552 639,602 329,321 282,111 246,670 162,946 154,270 149,732 134,298 122,462 120,840 115,652 106,883 99,023 96,213 81,927 76,900 75,141 71,549 February 2013 FY2012 Annual Report 26
LANCE Web Metrics LANCE web activity is measured by number of visits made, the number of pages viewed and the number of distinct visitors for the LANCE website. The number of hosts counts the distinct IP addresses of the visitors. Repeat visitors is a count of those visitors who made at least two visits since the start of web activity measurements or in the fiscal year. Web metrics are presented for visits of one minute or greater. Visits of at least one minute are considered to represent significant work accomplished, and many of the shorter visits are of less than a second. # Unique Visitors 30,412 27,792 22,390 30,370 39,127 34,690 31,455 25,294 26,583 31,973 32,581 24,017 Month # Visits # Views Oct-11 Nov-11 Dec-11 Jan-12 Feb-12 Mar-12 Apr-12 May-12 Jun-12 Jul-12 Aug-12 Sep-12 47,159 43,428 35,531 47,783 61,780 57,351 53,487 44,372 47,452 58,188 55,807 40,133 512,159 490,060 417,321 570,141 714,987 645,190 617,357 500,589 520,033 637,084 548,885 408,721 FY2012 592,471 6,582,527 325,462 February 2013 February 2013 FY2012 Annual Report FY2012 Annual Report 27 27
Total Users and Trends Total Users Data Volume Distribution Trend Data Product Distribution Trend Top 10 Products Trend FY2011-FY2012 Known U.S. - Foreign Product Distribution Trend Web Trends (Visits and Visitors) February 2013 FY2012 Annual Report 28
Total Users Total Users is an estimate formed by combining the distinct Data Users and distinct Web Visitors, removing the overlap. The common element for these counts is the IP address (Host); therefore, the comparison is made without using the additional details provided by the Data User email address or the Web Visitor browser. Not being able to compare the users directly likely results in an undercount. Web Visitors included in the count are for those visitors with visits of one minute or longer. To minimize the undercount, the final Total Users value includes the total Web Visitors (IP address plus browser), plus the distinct Data Users (counted by IP Address). Distinct Web Visitor (1 min+) (by Host IP) 78,989 5,347 3,586 86,007 3,972 136,167 270,366 277,999 Distinct Data User Distinct Web Visitor (1 min+) Dual Users (Data and Web) % of Data Users using the web DAAC Data Users Only ASDC ASF CDDIS GES DISC GHRC LP DAAC MODAPS NSIDC OBPG ORNL PO.DAAC SEDAC Total 3,417 2,894 82,237 87,851 3,065 40,017 30,755 14,010 5,879 24,563 18,182 170,561 483,431 92,221 6,496 4,091 103,365 4,340 152,083 305,306 314,427 2,925 1,569 80,367 53,933 2,283 33,063 17,366 7,869 5,879 19,815 16,019 138,401 379,489 492 1,325 1,870 33,918 782 6,954 13,389 6,141 14.4% 45.8% 2.3% 38.6% 25.5% 17.4% 43.5% 43.8% 13,389 16,911 100,092 1,112,721 12,063 13,923 91,182 979,601 4,748 2,163 32,160 103,942 19.3% 11.9% 18.9% 21.5% Total distinct users of data and services 1,492,210 February 2013 FY2012 Annual Report 29
Data Volume Distribution Trend The Volume Distribution Trend presents distributed volume counts from EMS by DAAC. OBPG distribution metrics from the Ocean Color web site are included beginning in FY2004. CDDIS data became available in FY2009. Volume Distributed (TBs) FY00 FY01 FY02 FY03 FY04 FY05 FY06 FY07 FY08 FY09 FY10 FY11 FY12 Total Volume (TBs) ASDC ASF CDDIS GESDISC GHRC LP DAAC MODAPS NSIDC OBPG * ORNL PO.DAAC SEDAC Total 6.32 30.38 62.53 107.90 147.01 127.37 204.70 225.24 167.14 187.92 232.71 195.51 643.93 0.01 0.14 0.05 1.36 2.35 2.31 1.88 2.16 16.50 41.98 2.66 103.11 188.18 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 9.20 17.43 35.76 37.52 20.99 45.37 82.97 185.02 278.13 361.22 493.29 192.65 302.80 487.32 698.68 1,042.45 1,327.66 0.63 1.00 1.25 6.49 7.70 7.56 9.10 8.01 12.08 8.63 12.41 5.94 7.28 8.69 25.71 171.32 110.43 209.82 224.27 329.00 431.40 448.12 538.94 952.71 1,178.55 1,200.87 0.00 0.00 0.00 0.00 0.00 0.00 18.48 564.21 813.94 866.75 1,287.38 1,578.39 1,289.79 0.24 0.40 1.36 4.20 15.91 27.11 55.69 69.54 81.32 120.00 140.17 185.14 168.34 0.00 0.00 0.00 0.00 2.90 8.69 23.71 36.01 59.61 73.96 173.85 282.98 370.49 0.01 0.02 0.47 1.21 1.23 1.90 0.95 1.17 0.74 2.86 4.99 7.16 10.16 1.85 2.73 4.92 28.08 37.49 31.37 36.55 14.06 62.17 91.35 104.92 111.83 161.62 0.08 0.12 0.17 0.22 0.16 0.17 0.16 0.08 0.06 0.32 1.43 2.88 1.47 38.82 105.87 325.03 444.90 702.68 791.97 1,173.50 1,544.53 1,964.48 2,429.21 3,629.34 4,729.70 5,407.31 2,338.65 362.69 99.91 5,518.55 88.07 5,829.82 6,418.95 869.40 1,032.18 32.87 688.94 7.31 23,287.34 February 2013 FY2012 Annual Report 30
Data Product Distribution Trend The Product Distribution Trend presents distributed product counts from EMS by DAAC. OBPG distribution metrics from the Ocean Color web site are included beginning in FY2004. CDDIS data became available in FY2009. Products Distributed (Millions) FY00 FY01 FY02 FY03 FY04 FY05 FY06 FY07 FY08 FY09 FY10 FY11 FY12 Total Products ASDC ASF CDDIS GESDISC GHRC LPDAAC MODAPS NSIDC OBPG * ORNL PO.DAAC SEDAC 0.22 0.97 3.68 4.15 6.77 5.70 7.78 7.32 3.57 5.11 4.41 5.04 10.63 0.00 0.00 0.00 0.03 0.06 0.06 0.04 0.05 0.30 0.47 0.10 0.37 0.85 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 37.06 52.60 112.33 120.03 2.34 2.64 5.28 10.92 15.67 26.55 41.41 30.98 38.75 54.50 84.22 133.84 168.68 0.97 1.03 1.42 4.68 3.40 3.58 4.05 9.29 10.18 5.68 0.66 0.72 0.79 0.62 1.24 4.63 3.72 8.90 15.08 11.93 24.32 16.76 38.83 51.95 63.97 70.59 0.00 0.00 0.00 0.00 0.00 0.00 1.67 33.36 47.74 47.21 79.76 98.77 95.25 0.13 0.25 0.40 0.86 0.96 1.80 4.69 8.13 10.73 17.25 22.90 20.18 24.34 0.00 0.00 0.00 0.00 0.29 1.71 4.91 7.04 10.67 8.66 12.43 20.54 16.77 0.01 0.03 0.09 0.11 0.42 0.49 0.36 1.22 0.40 7.70 49.88 3.19 6.71 1.05 2.08 3.55 10.45 10.30 12.83 13.48 5.71 16.49 31.72 50.33 38.27 54.07 0.19 0.26 0.26 0.30 0.25 0.26 0.32 0.11 0.07 0.49 3.57 4.16 1.60 5.52 8.49 19.31 35.21 47.03 68.06 90.64 127.54 155.66 254.66 412.80 501.38 570.28 Total Products (Millions) 65.35 2.33 322.01 615.77 46.45 312.53 403.74 112.61 83.01 70.61 250.35 11.84 2,296.58 February 2013 FY2012 Annual Report 31
Top 10 Products Trend by Volume FY2011 FY2012 FY2011 Top 10 Products Distributed By Volume* Ranking 1 2 3 4 5 6 7 8 9 10 Product Description GBs Files 3,739,321 5,482,610 MOD021KM MOD09GA AIRIBRAD MYD021KM MOD09GQ MOD03 MYD03 MOD13Q1 MOD09A1 MOD02HKM Level 1B Calibrated Radiances - 1km MODIS/Terra Surface Reflectance Daily L2G Global 1km and 500m SIN Grid AIRS/Aqua infrared geolocated radiances Level 1B Calibrated Radiances - 1km MODIS/Terra Surface Reflectance Daily L2G Global 250m SIN Grid Geolocation - 1km Geolocation - 1km MODIS/Terra Vegetation Indices 16-Day L3 Global 250m SIN Grid MODIS/Terra Surface Reflectance 8-Day L3 Global 500m SIN Grid Level 1B Calibrated Radiances - 500m 343,592.10 331,656.08 272,501.05 10,548,705 261,833.43 177,308.16 154,674.88 152,307.74 137,804.76 93,398.45 89,697.63 2,993,917 2,216,940 6,401,390 5,983,657 1,063,894 1,946,396 685,511 FY2012 Top 10 Products Distributed By Volume* Ranking 1 2 3 4 5 6 7 8 9 10 Product Description GBs Files 2,840,487 3,239,713 446,346 5,252,525 3,030,734 1,410,663 3,199,439 5,325,785 MYD021KM MOD09GA CAL_LID_L1-VALSTAGE1-V3 AIRIBRAD MOD021KM MOD13Q1 MOD09A1 MYD03 MAT1NXSLV MOD09GQ Level 1B Calibrated Radiances - 1km MODIS/Terra Surface Reflectance Daily L2G Global 1km and 500m SIN Grid CALIPSO Lidar Level 1B profile data (CAL_LID_L1-ValStage1-V3) AIRS/Aqua infrared geolocated radiances Level 1B Calibrated Radiances - 1km MODIS/Terra Vegetation Indices 16-Day L3 Global 250m SIN Grid MODIS/Terra Surface Reflectance 8-Day L3 Global 500m SIN Grid Geolocation - 1km MERRA 2D IAU Diagnostic, Single Level Meteorology, Time Average 1-hourly (2/3x1/2L1) MODIS/Terra Surface Reflectance Daily L2G Global 250m SIN Grid 238,001.11 215,509.78 199,404.97 188,918.54 187,906.68 162,792.37 156,108.68 119,162.63 95,156.49 11,973,896 94,676.79 1,332,332 *Some products are inherently larger than other files in size and therefore may skew the results. February 2013 FY2012 Annual Report 32
Top 10 Products Trend by # of Files FY2011 FY2012 FY2011 Top 10 Products Distributed By #Files Ranking 1 2 3 4 5 6 7 8 9 10 Product Description Files** 24,961,658 22,823,601 19,239,372 13,794,053 13,136,109 11,539,969 10,548,705 272,356.18 8,812,313 8,470,895 8,022,077 GBs 106.91 9,062.93 22,705.28 46,353.12 21,111.94 13,665.43 GNSS_IGSTROP GNSS_DAILY_D MOD04_L2 MOD05_L2 AIRX2RET MYD04_L2 AIRIBRAD TRMM_3B42 GPS_ACORB 248 GNSS Final Troposphere Zenith Path Delay Product GNSS Daily Compact Observation Data Level 2 Aerosol Level 2 Total Precipitable Water Vapor Test Results AIRS/Aqua FINAL Level 2 Products (Without HSB) Level 2 Aerosol AIRS/Aqua infrared geolocated radiances TRMM 3B42 3-Hour 0.25deg x 0.25deg and Other-GPI Calibration Rainfall GPS AC Orbit Solution Product GHRSST Level 2P USA NASA MODIS Aqua 11 micron SST 11,632.24 1,340.71 18,781.63 FY2012 Top 10 Products Distributed By #Files Ranking 1 2 3 4 5 6 7 8 9 10 Product Description Files** 29,844,606 17,669,010 17,276,942 16,172,906 13,195,856 13,095,069 12,975,075 12,242,371 GBs 11,780.85 65.00 27,756.79 18,844.10 15,827.18 89,816.26 17,416.08 18,612.65 95,156.49 4,025.55 GNSS_DAILY_D GNSS_IGSTROP TRMM_3B42 MOD04_L2 MYD04_L2 MAI3CPASM AIRX2RET NLDAS_FORA0125_HNLDAS Primary Forcing Data L4 Hourly 0.125 x 0.125 degree V002 MAT1NXSLV MERRA 2D IAU Diagnostic, Single Level Meteorology, Time Average 1-hourly (2/3x1/2L1) 11,973,896 GPS_IGUORB GPS Ultra-Rapid Combined Orbit Solution Product GNSS Daily Compact Observation Data GNSS Final Troposphere Zenith Path Delay Product TRMM 3B42 3-Hour 0.25deg x 0.25deg and Other-GPI Calibration Rainfall Level 2 Aerosol Level 2 Aerosol MERRA 3D IAU State, Meteorology Instantaneous 3-hourly (p-coord, 1.25x1.25L42) AIRS/Aqua FINAL Level 2 Products (Without HSB) 11,513,184 ** When counting # of files, metadata files are not included. February 2013 FY2012 Annual Report 33
Known U.S. Foreign Product Distribution Trend Product Trend Foreign U.S. FY2007 35,960,845 65,563,006 FY2008 56,769,710 69,857,119 FY2009 120,843,195 113,052,619 FY2010 152,842,193 242,093,094 FY2011 189,496,476 262,304,205 FY2012 259,717,671 272,259,607 Note: Metrics do not include product distribution where the destination country could not be determined. Also excluded are the ocean products from OBPG for October 2011 May 2012 since no country information was available. February 2013 FY2012 Annual Report 34
Web Trends Web metrics data for EOSDIS became available as of FY2007. Data for FY2007 is complete for 7 DAACs and FY2008 is complete for 8 DAACs. Since FY2009, 11 DAACs provided web metrics. These metrics are for visits of one minute or more. Fiscal Year FY2007 FY2008 FY2009 FY2010 FY2011 FY2012 Views Visits Visitors Repeat Visitors 7,599,722 8,263,283 11,463,765 13,654,146 18,617,279 23,721,135 707,365 827,714 1,079,317 1,108,858 1,318,598 1,973,920 443,079 523,416 702,058 718,944 855,976 1,248,743 77,731 91,801 116,886 205,378 150,076 339,566 February 2013 FY2012 Annual Report 35
Definitions (1 of 3) EMS Term Definition EOSDIS element serving as a source of metrics information for describing the ingest, archive and distribution of EOSDIS science data; web activity metrics are also collected. For the EOSDIS annual reporting, metrics from individual data providers at a single site are combined (e.g., NSIDC = NSIDCECS + NSIDCV0). Metrics describing the ingest, archive and distribution of EOSDIS science data at EOSDIS DAACs. This EOSDIS Annual Report presents data metrics from EOSDIS DAACs. Most metrics can be found in the EMS HTMLDB interface (http://ops1.ems.eosdis.nasa.gov: 8000/pls/apex/f?p=111). Metrics from other sources are noted in the report where applicable. Metrics describing the web activity at EOSDIS DAAC web sites and EOSDIS related web sites. This EOSDIS Annual Report presents web metrics by EOSDIS DAACs. These metrics can be found in the EMS NetInsight interface (https://ops-ni.ems.eosdis.nasa.gov/NetInsight/index.html) Designates the type of business or organization accessing EOSDIS. The domain is determined from the IP address and country. Data Provider Data Metrics Web Metrics Domain EMS Data File Term Definition Ingest is the amount of data coming into a DAAC over a period of time and includes all product levels. Ingest Archive is the amount of data added to the archive over a period of time and includes all products levels. Archive The Total Archive Size describes the EOSDIS archive at the end of the fiscal year. This includes all data (including ancillary) but not data marked for deletion. Any individual requesting data as defined by an IP address plus email, within the time period. The number of distinct (i.e., counted once) users receiving science data or metadata during the report period. The smallest unit of data inventoried and distributed to users; typically, a granule is a single data file, though some granules may include multiple files. EMS counts individual files as distinct products. This is roughly equivalent to counting EOS granules, although in the case of some EOS instrument data, a granule may contain more than one file. If so, the files are counted as individual products. In counting unique products, A product having two different version numbers was considered two unique data products. The number of files successfully delivered to Public users. This count excludes METADATA file types. If the file type does not distinguish a file as a metadata or a science file, i.e., it is encoded as n/a, then the default process is to count the file as a science data product. Total Archive Size Data User Distinct Users Granule Product Number of Products Delivered Volume of Products Delivered The volume of data (in GBs) successfully delivered to Public users. This includes all file types, including METADATA. February 2013 FY2012 Annual Report 36
Definitions (2 of 3) February 2013 FY2012 Annual Report 37
Definitions (3 of 3) Report Term Stage 1 Stage 2 Stage 3 Definition Metrics data directly from the EMS tools, presented by data provider as available. Metrics data grouped by DAAC , augmented with external data, includes all twelve DAACs. Metrics data presented by the major contributing DAACs, often accompanied by a graphic. February 2013 FY2012 Annual Report 38