
EOSDIS FY2011 Annual Metrics Report Overview
Explore the Earth Sciences Data and Information System (ESDIS) project's comprehensive report on metrics from the Earth Observation System Data and Information System (EOSDIS) during Fiscal Year 2011. Gain insights into data centers, metrics collection, system performance, and more. Contact for further details.
Download Presentation

Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
EOSDIS FY2011 Annual Metrics Report Prepared By: Hyo Duck Chang Adnet, Inc. Brian Krupp Adnet, Inc. Lalit Wanchoo Adnet, Inc. February 2012
Preface The Earth Sciences Data and Information System (ESDIS) Project (Code 423) is pleased to present the following report on metrics from across the Earth Observation System Data and Information System (EOSDIS). The 12 Data Centers of EOSDIS support different scientific disciplines and provide an individualized set of products and services to their science community and the public. Although discipline oriented, the data centers engage in common data management functions of ingest, archive and distribution, as well as describing their data and services on web sites. Metrics are collected on a daily basis from each data center. The ESDIS Project collects these metrics in a tool called the ESDIS Metrics System (EMS). Data center analysts can view their detailed metrics to assess internal performance and trends. The ESDIS Project combines these metrics, not for comparisons between the data centers, but as a system level view of EOSDIS performance. This report provides snapshots of metrics as the combination of the individual data centers and from a purely system perspective. During FY2011, it was observed that ASF distribution included a large number of the bots-distributions (downloads by Internet search engines for indexing purposes) and those bots distributions were excluded in the ASF metrics. ASF also made changes to its reporting during FY2011. These changes and the migration of historical data to the new operating system contribute to a significant increase in archive volume. Updates for Ingest and Archive were not available for this report; however, the report includes an estimate of the Total Archive showing a significant increase. New for FY2011 is the CDDIS archive information which became available in December 2010. In keeping with previous years, and in order to support trend comparisons, the metrics data are presented on a fiscal year basis, not by calendar year. If you have any questions or comments please contact Jeanne Behnke at (301) 614-5326 or jeanne.behnke@nasa.gov or Kevin Murphy at (301) 614-5580 or kevin.j.murphy@nasa.gov. February 2012 FY2011 Annual Report 2
Introduction This report presents statistics on data metrics and web activities at the EOSDIS data centers during Fiscal Year 2011 (October 1, 2010 through September 30, 2011) from the Earth Science Data and Information System (ESDIS) Metrics System (EMS). EMS supports the ESDIS project management by collecting and organizing various metrics from the Earth Observing System (EOS) Data and Information System (DIS) Data Centers and other Data Providers. The EMS collects and presents data on the usage of products and services delivered via the Internet or managed in EOSDIS archives. EMS consists of a Data Metrics component and a Web Metrics component. The Data Metrics component provides statistics on data ingest, archive and distribution plus data users profile information collected from Data Providers. The Web Metrics component provides statistics on web site visits, views and visitors with a variety of related parameters. This report contains tables and graphs of FY2011 statistics and comparisons to previous years. Values for previous fiscal years are produced from EMS unless noted otherwise. Summary tables, text, graphs, and more detailed statistics tables are also included. As for FY2010, this year's report has separate metrics for the Near-Real Time (NRT) and CALIPSO products. It is important to note that metrics for the NRT and CALIPSO products are not used in the distribution trend analyses presented in this report. It is also important to note that all bots-related distributions (downloads by Internet search engines for indexing purposes) are excluded in the ASF metrics. Definitions for terms used in this report can be found in the Definitions worksheet. February 2012 FY2011 Annual Report 3
Summary EOSDIS Metrics (Oct. 1, 2010 to Sept. 30, 2011) Unique Data Sets Distinct Users of EOSDIS Data and Services Web Site Visits Average Archive Growth Total Archive Volume End User Distribution Products End User Average Distribution Volume > 5,000 > 1.2 M > 1.3 M 1.7 TB/day 5.8 PB > 501 M 13 TB/day Unique Data Sets: Total number of unique data sets distributed in the fiscal year. Distinct Users of EOSDIS Data and Services: Total unique users across EOSDIS Data Users and Web Visitors, per data center and summed Web Site Visits: Sum of web visits for data centers where a visit represents a user session not broken by more than 30 minutes and a duration of at least one minute Average Archive Growth: Sum across reporting data centers of the data volume added to the individual archives divided by the days in the year Total Archive Volume: Sum across reporting data centers of the data volumes in the archive as of end of the fiscal year End User Distribution Products: Total number of products distributed from all reporting data centers End User Average Distribution Volume: Sum across reporting data centers of the data volume distributed for the fiscal year divided by the days in the year February 2012 FY2011 Annual Report 4
Data Metrics Distribution By Data Center Volume by Domain Products by Domain Near Real-time Products CALIPSO Products Top 20 Countries Top 10 Products Unique Product Count Ingest Archive Total Archive Data Users Distinct Users Repeat Users Top 20 Countries Foreign Distribution February 2012 FY2011 Annual Report 5
Ingest Ingest is the amount of data coming into a data center over a period of time and includes all product levels. For this report, the data is presented as the amount of data entered into each data center during FY2011. The sum of all data centers is the total ingest for EOSDIS. OBPG and ORNL do not provide ingest metrics. Data Center Volume (TBs) Files (Millions) ASDC CDDIS GESDISC GHRC LPDAAC MODAPS NSIDC PODAAC SEDAC Total 246.1 0.5 140.2 3.2 89.8 50.4 6.5 0.1 0.1 536.8 11.7 14.7 9.6 0.8 7.3 0.2 2.0 0.1 0.0 46.5 Note: ASF ingest data for FY2011 is not considered accurate as of the publication of this report and is excluded in the report. February 2012 FY2011 Annual Report 6
Archive Archive is the amount of data added to the archive over a period of time and includes all products levels. Archive metrics for CDDIS, OBPG and NSIDC V0 are not available at this time. Data Center Volume (TBs) Files (Millions) ASDC CDDIS GESDISC GHRC LPDAAC MODAPS NSIDC ORNL PODAAC SEDAC Total 246.1 0.4 134.9 0.8 89.6 136.3 6.5 0.4 3.3 0.2 618.3 11.4 6.0 13.1 0.1 7.3 5.1 1.9 0.2 0.2 0.0 45.4 Note: ASF archive data for FY2011 is not considered accurate as of the publication of this report and is excluded in the report. February 2012 FY2011 Annual Report 7
Total Archive Size The Total Archive Size describes the EOSDIS archive at the end of FY2011. This includes all data (including ancillary) but not data marked for deletion. Data Center ASDC * ASF ** CDDIS *** GESDISC GHRC LPDAAC MODAPS NSIDC ORNL PODAAC SEDAC Total Volume (TBs) Files (Millions) 1,780.1 1,801.6 84.1 8.6 73.4 46.4 0.4 49.8 29.7 18.0 0.1 2.6 0.0 313.1 6.0 422.2 6.4 899.0 882.1 64.4 0.0 36.2 2.9 5,900.9 * Archive values were provided by ASDC ** In FY2011, ASF changed the method of managing their archive. Data for this report is based on a February 21, 2012 e-mail from ASF staff. *** CDDIS archive size was derived from the archive values (6.22 TB, 78,635,159 files) as of 3/6/2012 given by CDDIS February 2012 FY2011 Annual Report 8
Distribution By Data Center Distribution presents the amount of data successfully distributed to Public Users. Distribution by Data Center ASF CDDIS GESDISC GHRC ASDC LPDAAC MODAPS NSIDC ORNL PO.DAAC SEDAC OBPG* Total Products (Millions) Total Volume (TBs) 0.37 112.33 133.84 0.72 5.04 63.97 98.77 20.18 3.19 38.27 4.16 20.54 501.38 103.11 35.76 1,042.45 5.94 195.51 1,178.55 1,578.39 185.14 7.16 111.83 2.88 282.98 4,729.70 * OBPG data taken from the Ocean Color Website February 2012 FY2011 Annual Report 9
Volume Distributed By Domain Volume Distribution presents the volume of data successfully distributed to Public Users by Domain. Total Volume Distributed ASF CDDIS GES DISC GHRC ASDC LP DAAC MODAPS NSIDC ORNL PO.DAAC SEDAC OBPG* Total Foreign US COM US EDU US GOV US ORG US Other Unknown Total Volume (TBs) 23.97 7.67 11.29 44.91 6.22 9.00 0.05 23.42 1.12 3.57 3.02 0.04 3.97 0.62 287.85 29.54 402.79 283.63 0.42 37.44 0.78 2.07 0.90 1.55 1.00 0.00 0.41 0.00 50.58 23.29 67.26 43.35 1.81 1.81 7.41 308.12 147.40 218.28 175.49 2.88 9.73 316.65 524.28 19.44 238.23 640.57 1.35 80.39 74.14 36.95 11.67 36.22 55.63 0.45 14.12 30.09 4.63 1.03 0.98 0.09 0.03 0.19 0.21 32.07 11.69 5.30 60.65 0.01 1.66 0.45 0.65 0.29 0.10 0.04 0.04 0.12 1.64 1,294.59 254.04 985.56 1,308.39 13.25 158.84 715.02 282.98 103.11 35.76 1,042.45 5.94 195.51 1,178.55 1,578.39 185.14 7.16 111.83 2.88 282.98 4,729.70 * OBPG data taken from the Ocean Color Website February 2012 FY2011 Annual Report 10
Product Distribution By Domain Product Distribution presents the number of products successfully distributed to Public Users by Domain. Total Products Distributed ASF CDDIS GES DISC GHRC ASDC LP DAAC MODAPS NSIDC ORNL PO.DAAC SEDAC OBPG* Total Foreign US COM US EDU US GOV US ORG US Other Unknown 0.06 0.03 0.07 0.16 0.01 0.04 0.00 70.05 5.30 14.21 11.72 0.20 9.63 1.23 43.14 5.53 56.51 23.00 0.11 5.31 0.24 0.13 0.27 0.19 0.09 0.00 0.04 0.00 1.52 1.39 1.36 0.46 0.02 0.02 0.28 16.69 8.10 10.47 5.07 0.10 0.28 23.25 29.61 2.86 9.80 49.98 0.07 4.62 1.82 8.29 2.05 3.36 3.66 0.06 1.03 1.74 2.11 0.25 0.74 0.01 0.00 0.08 0.00 15.65 7.43 1.72 12.79 0.00 0.29 0.39 2.24 0.96 0.33 0.07 0.10 0.35 0.09 189.50 34.18 98.76 107.01 0.66 21.69 49.58 20.54 Total Products (Millions) 0.37 112.33 133.84 0.72 5.04 63.97 98.77 20.18 3.19 38.27 4.16 20.54 501.38 * OBPG data taken from the Ocean Color Website February 2012 FY2011 Annual Report 11
Distribution of NRT Products Near Real-time (NRT) Distribution provides the amount of data successfully distributed to registered users of the Land Atmosphere Near Real-time Capability for EOS (LANCE). LANCE provides access to near real-time data (<3 hours from observation) from MODIS, AMSR-E, AIRS, MLS and OMI instruments. Metrics for distribution volume, numbers of files distributed and users are presented. Instrument # of Files * AIRS 1,897,618 AMSR-E ** 622,533 MLS 706,949 MODIS - Aqua 8,339,935 MODIS - Terra 10,513,558 OMI 24,519 NRT Total 22,105,112 Vol (GB) 17,332.30 8,994.93 # of Users 180 150 46 282 459 19 1,136 73.31 209,529.29 250,491.22 848.32 487,269.37 * Excludes metadata ** Includes the NRT products from GHRC and MODAPS February 2012 FY2011 Annual Report 12
Distribution of CALIPSO Products Although not an EOSDIS supported mission, the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) is an Earth science mission with data available through the Atmospheric Sciences Data Center (ASDC) at NASA Langley Research Center. The tables below provide distribution statistics particular to CALIPSO. These statistics are not included in the EOSDIS totals. Mission CALIPSO CALIPSO CALIPSO Instrument # of Files * 5,257,467 97,464 20,742 5,375,673 Vol (GB) 428,704.44 1,410.41 1,197.66 431,312.51 # of Users CALIOP Imaging Infrared Radiometer Wide Field Camera Total for CALIPSO 712 49 34 795 * Excludes metadata February 2012 FY2011 Annual Report 13
Data Distribution - Top 20 Countries Top 20 Countries by Volume Distributed* Top 20 Countries by Products Distributed** Volume (GBs) 2,785,372.12 250,755.55 230,745.14 179,275.07 113,162.79 100,567.63 66,391.89 61,891.73 43,545.47 32,962.43 29,854.47 19,095.37 17,684.46 17,614.21 15,412.79 13,821.47 13,577.79 12,726.01 12,503.90 9,706.44 Ranking 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Country Ranking 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Country Products 262,304,205 36,596,717 20,729,525 17,921,477 17,699,172 13,830,813 9,376,378 7,286,217 6,724,334 5,468,391 5,165,030 4,187,838 4,018,868 3,641,005 3,411,238 3,134,903 2,898,931 2,803,106 2,717,576 1,824,900 United States Japan China France Germany Belgium United Kingdom Canada Korea, Republic of Italy Australia Denmark Spain Russian Federation Switzerland Brazil Sweden India Netherlands Taiwan United States China Japan United Kingdom France Germany Russian Federation Belgium Korea, Republic of Canada Australia Denmark Taiwan Brazil Czech Republic Italy India Spain Finland Portugal * Some products are inherently larger than other files in size and therefore may skew the results. ** When counting # of files, metadata files are not included. February 2012 FY2011 Annual Report 14
Distribution of Unique Data Products Tables below show the number of unique data products distributed to public users during FY2011. In counting unique products, metadata were excluded. Also excluded are the NRT and CALIPSO products. DAAC ASF 35 CDDIS GES DISC GHRC 188 1,625 ASDC 598 LP DAAC MODAPS 244 NSIDC 329 ORNL 956 PO DAAC SEDAC 198 Total 5,046 # of Products * 179 510 184 * OBPG is not included since no product information is available. February 2012 FY2011 Annual Report 15
Data Distribution - Top 10 Products Top 10 Products Distributed By Volume* Product Description GBs Files ** 3,739,321 5,482,610 10,548,705 2,993,917 2,216,940 6,401,390 5,983,657 1,063,894 1,946,396 685,511 1 2 3 4 5 6 7 8 9 10 MOD021KM MOD09GA AIRIBRAD MYD021KM MOD09GQ MOD03 MYD03 MOD13Q1 MOD09A1 MOD02HKM Level 1B Calibrated Radiances - 1km MODIS/Terra Surface Reflectance Daily L2G Global 1km and 500m SIN Grid AIRS/Aqua infrared geolocated radiances Level 1B Calibrated Radiances - 1km MODIS/Terra Surface Reflectance Daily L2G Global 250m SIN Grid Geolocation - 1km Geolocation - 1km MODIS/Terra Vegetation Indices 16-Day L3 Global 250m SIN Grid MODIS/Terra Surface Reflectance 8-Day L3 Global 500m SIN Grid Level 1B Calibrated Radiances - 500m 343,592.10 331,656.08 272,501.05 261,833.43 177,308.16 154,674.88 152,307.74 137,804.76 93,398.45 89,697.63 Top 10 Products Distributed By File Count ** Product Description Files** 24,961,658 22,823,601 19,239,372 13,794,053 13,136,109 11,539,969 10,548,705 8,812,313 8,470,895 8,022,077 GBs 106.91 9,062.93 22,705.28 46,353.12 21,429.57 22,705.28 272,501.05 11,640.00 1,340.71 18,781.63 1 2 3 4 5 6 7 8 9 10 GNSS_IGSTROP GNSS_DAILY_D MOD04_L2 MOD05_L2 AIRX2RET MYD04_L2 AIRIBRAD TRMM_3B42 GPS_ACORB 248 GNSS Final Troposphere Zenith Path Delay Product GNSS Daily Compact Observation Data Level 2 Aerosol Level 2 Total Precipitable Water Vapor Test Results AIRS/Aqua FINAL Level 2 Products (Without HSB) Level 2 Aerosol AIRS/Aqua infrared geolocated radiances TRMM 3B42 3-Hour 0.25deg x 0.25deg and Other-GPI Calibration Rainfall GPS AC Orbit Solution Product GHRSST Level 2P USA NASA MODIS Aqua 11 micron SST * Some products are inherently larger than other files in size and therefore may skew the results. ** When counting # of files, metadata files are excluded. February 2012 FY2011 Annual Report 16
Distinct Data Users Distinct Data Users presents the number of distinct public users* who received data product files. Domain Foreign US COM US EDU US GOV US ORG US Other Unknown Total Distinct Data Users ASF CDDIS 46,502 8,946 1,752 2,068 GES DISC 45,917 17,137 6,612 2,955 GHRC ASDC LP DAAC MODAPS 18,223 2,806 1,572 1,171 NSIDC ORNL PO.DAAC 12,176 3,372 1,233 SEDAC 109,458 46,630 7,892 1,569 Total 259,941 93,234 26,209 11,163 1,675 24,282 10,428 1,410 442 281 119 1,676 945 263 170 839 886 388 321 12 25 19 9,848 6,761 2,677 783 158 710 203 5,074 2,657 1,567 720 8,818 2,652 1,972 373 914 48 16 249 46 177 254 8 51 78 618 233 43 913 310 830 3,221 1,184 4,583 1,563 174 42 1,069 1,250 1,250 781 11,470 4,797 2,563 63,850 79,021 3,278 2,490 21,140 26,142 10,947 15,081 19,774 182,646 426,932 * Does not include OBPG users February 2012 FY2011 Annual Report 17
Repeat Data Users Repeat users are distinct Public users* who received data on more than one day in the fiscal year. Domain Foreign US COM US EDU US GOV US ORG US Other Unknown Total Repeat Data Users ASF CDDIS GES DISC GHRC ASDC LP DAAC MODAPS NSIDC ORNL PO.DAAC SEDAC Total 27,378 11,780 4,059 3,132 282 41 84 41 7,255 2,711 399 790 5,854 2,567 1,335 822 146 242 34 31 191 366 119 122 2,270 1,651 699 260 3,267 1,049 398 376 784 373 321 192 25 61 52 740 343 152 44 1,346 787 142 186 5,243 1,650 376 268 114 1,026 326 6 54 971 136 39 658 149 0 3 39 171 60 14 219 104 3 3 300 49 1 19 5 10 7 66 11 107 63 3,357 914 504 12,316 11,424 477 818 5,150 5,427 1,808 1,359 2,634 9,003 50,920 * Does not include OBPG users February 2012 FY2011 Annual Report 18
Data Users - Top 20 Countries Top 20 Countries by Number of Users Ranking 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Country Users United States China Germany France India United Kingdom Canada Brazil Australia Japan Russian Federation Spain Italy Guatemala Netherlands Poland Mexico Argentina Korea, South Indonesia 147,290 31,055 16,598 15,292 14,418 13,574 12,768 11,005 8,603 8,333 8,009 6,082 5,213 4,359 4,053 3,893 3,856 3,105 3,027 2,926 February 2012 FY2011 Annual Report 19
Foreign Distribution Distribution metrics for foreign public users are compared. Statistics are based on country information provided by 11 EOSDIS data centers. Foreign Country # of Users # of Products (1000s) Vol (TBs) EU * Canada China ** Japan Other 84,295 12,768 31,055 8,333 124,888 80,296 5,468 36,597 20,730 75,447 559.42 60.44 225.34 244.88 636.56 * EU includes 27 European Union member countries. ** China includes only People s Republic of China and does not include Taiwan or Hong Kong. February 2012 FY2011 Annual Report 20
Web Metrics Visitors and Visits Repeat Visitors Top 20 Domains Top 20 Countries February 2012 FY2011 Annual Report 21
Web Visitors and Visits EOSIDS web activity is measured by the number of Visits made, the number of pages Viewed and the number of distinct Visitors. Visits, Views, and Visitors count visits greater than or equal to 1 minute. Visits of at least one minute are considered to represent significant work accomplished, and many of the shorter visits are of less than a second. Data came from 11 data centers (these data centers are listed in Slide #17). # Unique Visitors Month # Visits # Views Oct-10 Nov-10 Dec-10 Jan-11 Feb-11 Mar-11 Apr-11 May-11 Jun-11 Jul-11 Aug-11 Sep-11 100,301 105,524 92,837 104,367 102,068 115,056 95,034 97,987 106,544 127,412 131,119 140,349 1,332,916 1,226,515 1,060,497 1,439,586 1,237,396 1,506,356 1,268,212 1,213,470 1,357,824 1,565,944 3,736,007 1,672,556 73,518 77,284 68,649 76,230 74,981 84,067 67,533 69,780 72,688 80,248 86,023 99,091 FY2011 1,318,598 18,617,279 February 2012 FY2011 Annual Report 22
Repeat Web Visitors EOSDIS Web Visitors are characterized by the number of visits they make and how frequently they return. Visitors counted in the table below are those that stayed for one minute or more. Repeat Visitors are counted from the start of the Fiscal Year. FY2011 Web Visitors for Visits of one minute or more Total Visitors 150,076 # of Visits 2 3 4 5-6 7-9 10 - 14 15 - 24 25 - 49 50 - 99 100+ All DAACs 81,344 27,036 13,202 12,151 7,145 4,469 2,775 1,416 428 110 February 2012 FY2011 Annual Report 23
Top 20 Domains By # of Web Visitors The FY2011 Top 20 Domains for visits >= 1 minute is sorted by the # of Visitors. Data came from 11 data center s (these data centers are listed in Slide #17). All statistics are based on domains resolved by NetInsight, using host information. Percent Visitors Percent Visits Percent Views Domain Domain Ranking Visitors Visits Views 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Unresolved Network (.net) Commercial (.com) United States Educational United States Government Australia Canada Germany United Kingdom Japan India Italy Argentina France Netherlands Brazil Russia Organization (.org) Mexico United States (.us) 233,363 194,492 88,597 41,865 14,170 17,148 14,525 12,674 11,781 9,817 11,092 11,732 9,644 8,528 6,849 8,615 6,376 6,062 7,002 5,405 7.10% 5.90% 2.70% 1.30% 0.40% 0.50% 0.40% 0.40% 0.40% 0.30% 0.30% 0.40% 0.30% 0.30% 0.20% 0.30% 0.20% 0.20% 0.20% 0.20% 388,840 265,157 127,288 85,447 52,367 24,961 23,564 21,346 20,966 20,454 18,712 17,432 16,690 15,032 15,028 13,098 12,121 10,890 9,345 9,050 6.70% 5,467,502 4.60% 2,524,447 2.20% 1,381,945 1.50% 2,428,571 0.90% 1,768,690 0.40% 0.40% 0.40% 0.40% 0.40% 0.30% 0.30% 0.30% 0.30% 0.30% 0.20% 0.20% 0.20% 0.20% 0.20% 22.30% 10.30% 5.60% 9.90% 7.20% 1.00% 1.00% 1.20% 1.10% 1.10% 1.20% 0.80% 0.90% 0.90% 0.60% 1.00% 0.70% 0.60% 0.50% 0.40% 246,252 252,792 282,440 264,451 270,359 299,357 203,529 220,485 215,659 158,504 236,287 176,388 141,736 123,695 97,948 February 2012 FY2011 Annual Report 24
Top 20 Countries By # Web Visits The FY2011 Top 20 Countries for visits >= 1 minute is sorted by the # of Visits. Data came from 11 data center s (these data centers are listed in Slide #17). All statistics are based on country information resolved by NetInsight. Percent Visitors 1.60% 1.10% 0.60% 0.30% 0.30% 0.20% 0.20% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% Percent Visits 1.50% 1,235,080 1.30% 1,125,414 0.60% 0.30% 0.20% 0.20% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% Percent Views 5.00% 4.60% 2.50% 0.50% 0.50% 0.80% 0.30% 0.40% 0.50% 0.40% 0.30% 0.10% 0.40% 0.40% 0.40% 0.30% 0.30% 0.20% 0.20% 0.20% Country Country Ranking Visitors Visits Views United States China India Great Britain Canada Korea, Republic of Australia Russia Iran Italy Germany Philippines Japan Spain Indonesia Brazil Malayasia France Chile Thailand 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 52,810 37,291 20,180 10,467 8,432 5,831 5,020 3,949 4,286 4,428 3,305 4,913 2,180 3,481 3,548 2,839 2,320 1,920 1,769 1,946 87,115 77,507 33,555 14,555 13,030 10,534 7,697 7,274 7,161 6,864 5,710 5,694 5,538 5,428 5,112 4,538 4,518 3,586 3,185 3,076 607,435 115,051 127,330 186,005 67,102 88,873 110,869 94,515 76,015 32,275 102,435 95,569 92,944 63,761 62,849 42,515 59,449 40,102 February 2012 FY2011 Annual Report 25
Total Users and Trends Total Users Data Volume Distribution Trend Data Product Distribution Trend Top 10 Products Trend FY2010-FY2011 Known U.S. - Foreign Product Distribution Trend Web Trends (Visits and Visitors) February 2012 FY2011 Annual Report 26
Total Users Total Users is an estimate formed by combining the distinct Data Users and distinct Web Visitors, removing the overlap. The common element for these counts is the IP address (Host); therefore, the comparison is made without using the additional details provided by the Data User email address or the Web Visitor browser. Not being able to compare the users directly likely results in an undercount. Web Visitors included in the count are for those visitors with visits of one minute or longer. To minimize the undercount, the final Total Users value includes the total Web Visitors (IP address plus browser), plus the distinct Data Users (counted by IP Address). Distinct Web Visitor (1 min+) (by Host IP) 109,250 3,362 1,764 79,533 2,707 46,532 92,513 226,258 6,857 12,821 85,070 666,667 Distinct Data User Distinct Web Visitor (1 min+) Dual Users (Data and Web) % of Data Users using the web Data Center Data Users Only ASDC ASF CDDIS GES DISC GHRC LP DAAC MODAPS NSIDC ORNL PO DAAC SEDAC Total 2,490 2,563 63,850 79,021 3,278 21,140 26,142 10,947 15,081 19,774 182,646 426,932 139,685 5,236 2,093 108,531 3,092 64,358 118,902 287,337 8,349 17,425 100,968 855,976 2,238 1,796 62,884 51,120 2,716 18,699 20,984 10,516 11,866 17,466 158,669 358,954 252 767 966 27,901 562 2,441 5,158 431 3,215 2,308 23,977 67,978 10.1% 29.9% 1.5% 35.3% 17.1% 11.5% 19.7% 3.9% 21.3% 11.7% 13.1% 15.9% Total distinct users of data and services 1,214,930 February 2012 FY2011 Annual Report 27
Data Volume Distribution Trend The Volume Distribution Trend presents distributed volume counts from EMS by data center. OBPG distribution metrics from the Ocean Color web site are included beginning in FY2004. CDDIS data became available in FY2009. Fiscal Year FY00 FY01 FY02 FY03 FY04 FY05 FY06 FY07 FY08 FY09 FY10 FY11 Total Volume (TBs) ASF CDDIS GESDISC GHRC ASDC LP DAAC MODAPS NSIDC ORNL PO.DAAC SEDAC OBPG Total 0.01 0.14 0.05 1.36 2.35 2.31 1.88 2.16 16.50 41.98 2.66 103.11 20.99 45.37 82.97 185.02 278.13 361.22 493.29 192.65 302.80 487.32 698.68 1,042.45 0.63 1.00 1.25 6.49 7.70 7.56 9.10 8.01 12.08 8.63 12.41 5.94 6.32 30.38 62.53 107.90 147.01 127.37 204.70 225.24 167.14 187.92 232.71 195.51 8.69 25.71 171.32 110.43 209.82 224.27 329.00 431.40 448.12 538.94 952.71 1,178.55 0.00 0.00 0.00 0.00 0.00 0.00 18.48 564.21 813.94 866.75 1,287.38 1,578.39 0.24 0.40 1.36 4.20 15.91 27.11 55.69 69.54 81.32 120.00 140.17 185.14 0.01 0.02 0.47 1.21 1.23 1.90 0.95 1.17 0.74 2.86 4.99 7.16 1.85 2.73 4.92 28.08 37.49 31.37 36.55 14.06 62.17 91.35 104.92 111.83 0.08 0.12 0.17 0.22 0.16 0.17 0.16 0.08 0.06 0.32 1.43 2.88 38.82 105.87 325.03 444.90 702.68 791.97 1,173.50 1,544.53 1,964.48 2,429.21 3,629.34 4,729.70 2.90 8.69 23.71 36.01 59.61 73.96 173.85 282.98 9.20 17.43 35.76 174.51 62.39 4,190.88 80.79 1,694.72 4,628.95 5,129.16 701.06 22.71 527.32 5.84 661.69 17,880.03 February 2012 FY2011 Annual Report 28
Data Product Distribution Trend The Product Distribution Trend presents distributed product counts from EMS by data center. OBPG distribution metrics from the Ocean Color web site are included beginning in FY2004. CDDIS data became available in FY2009. Fiscal Year FY00 FY01 FY02 FY03 FY04 FY05 FY06 FY07 FY08 FY09 FY10 FY11 ASF CDDIS GESDISC GHRC ASDC LP DAAC MODAPS NSIDC ORNL PO.DAAC SEDAC OBPG Total 0.00 0.00 0.00 0.03 0.06 0.06 0.04 0.05 0.30 0.47 0.10 0.37 2.34 2.64 5.28 10.92 15.67 26.55 41.41 30.98 38.75 54.50 84.22 133.84 0.97 1.03 1.42 4.68 3.40 3.58 4.05 9.29 10.18 5.68 0.66 0.72 0.22 0.97 3.68 4.15 6.77 5.70 7.78 7.32 3.57 5.11 4.41 5.04 0.62 1.24 4.63 3.72 8.90 15.08 11.93 24.32 16.76 38.83 51.95 63.97 0.00 0.00 0.00 0.00 0.00 0.00 1.67 33.36 47.74 47.21 79.76 98.77 0.13 0.25 0.40 0.86 0.96 1.80 4.69 8.13 10.73 17.25 22.90 20.18 0.01 0.03 0.09 0.11 0.42 0.49 0.36 1.22 0.40 7.70 49.88 3.19 1.05 2.08 3.55 10.45 10.30 12.83 13.48 5.71 16.49 31.72 50.33 38.27 0.19 0.26 0.26 0.30 0.25 0.26 0.32 0.11 0.07 0.49 3.57 4.16 5.52 8.49 19.31 35.21 47.03 68.06 90.64 127.54 155.66 254.66 412.80 501.38 0.29 1.71 4.91 7.04 10.67 8.66 12.43 20.54 37.06 52.60 112.33 Total Products (Millions) 1.48 201.99 447.09 45.66 54.72 241.94 308.49 88.27 63.90 196.29 10.24 66.24 1,726.30 February 2012 FY2011 Annual Report 29
Top 10 Products Trend by Volume FY2010 FY2011 FY2010 Top 10 Products Distributed By Volume* Ranking 1 2 3 4 5 6 7 8 9 10 Product Description GBs Files 2,850,783 2,378,453 6,432,178 1,707,672 9,320,890 1,629,756 4,865,754 816,726 1,252,625 675,024 MOD09GA MOD021KM MOD03 MYD021KM AIRIBRAD MYD09GA MYD03 MOD13Q1 MOD09GQ MOD02HKM MODIS/Terra Surface Reflectance Daily L2G Global 1km and 500m SIN Grid MODIS/Terra Level 1B Calibrated Radiances - 1km MODIS/Terra Geolocation - 1km MODIS/Aqua Level 1B Calibrated Radiances - 1km AIRS/Aqua infrared geolocated radiances MODIS/Aqua Surface Reflectance Daily L2G Global 1km and 500m SIN Grid MODIS/Aqua Geolocation - 1km MODIS/Terra Vegetation Indices 16-Day L3 Global 250m SIN Grid MODIS/Terra Surface Reflectance Daily L2G Global 250m SIN Grid MODIS/Terra Level 1B Calibrated Radiances - 500m 226,826.39 210,100.01 158,329.60 156,542.44 141,685.42 126,802.22 122,261.48 114,249.90 100,876.07 86,922.21 FY2011 Top 10 Products Distributed By Volume* Ranking 1 2 3 4 5 6 7 8 9 10 Product Description GBs Files 3,739,321 5,482,610 MOD021KM MOD09GA AIRIBRAD MYD021KM MOD09GQ MOD03 MYD03 MOD13Q1 MOD09A1 MOD02HKM Level 1B Calibrated Radiances - 1km MODIS/Terra Surface Reflectance Daily L2G Global 1km and 500m SIN Grid AIRS/Aqua infrared geolocated radiances Level 1B Calibrated Radiances - 1km MODIS/Terra Surface Reflectance Daily L2G Global 250m SIN Grid Geolocation - 1km Geolocation - 1km MODIS/Terra Vegetation Indices 16-Day L3 Global 250m SIN Grid MODIS/Terra Surface Reflectance 8-Day L3 Global 500m SIN Grid Level 1B Calibrated Radiances - 500m 343,592.10 331,656.08 272,501.05 10,548,705 261,833.43 177,308.16 154,674.88 152,307.74 137,804.76 93,398.45 89,697.63 2,993,917 2,216,940 6,401,390 5,983,657 1,063,894 1,946,396 685,511 *Some products are inherently larger than other files in size and therefore may skew the results. February 2012 FY2011 Annual Report 30
Top 10 Products Trend by # of Files FY2010 FY2011 FY2010 Top 10 Products Distributed By #Files Ranking 1 2 3 4 5 6 7 8 9 10 Product Description Files** 47,126,600 15,365,035 12,207,462 12,004,610 9,906,940 9,506,179 9,320,890 141,685.42 7,170,225 6,810,203 6,432,178 158,329.60 GBs 2,782.47 5,158.29 14,338.23 15,691.49 11,740.50 9,297.75 MOD13Q1 GNSS_DAILY_D MOD04_L2 248 MYD04_L2 250 AIRIBRAD TRMM_3B42 GNSS_DAILY_O MOD03 MODIS/Terra Vegetation Indices 16-Day L3 Global 250m ISIN Grid GNSS Daily Compact Observation Data MODIS/Terra Level 2 Aerosol GHRSST Level 2P USA NASA MODIS Aqua 11 micron SST MODIS/Aqua Level 2 Aerosol GHRSST Level 2P USA NASA MODIS Terra 11 micron SST AIRS/Aqua infrared geolocated radiances TRMM 3B42 3-Hour 0.25deg x 0.25deg and Other-GPI Calibration Rainfall GNSS Daily Observation Data MODIS/Terra Geolocation - 1km 8,949.83 4,584.40 FY2011 Top 10 Products Distributed By #Files Ranking 1 2 3 4 5 6 7 8 9 10 Product Description Files** 24,961,658 22,823,601 19,239,372 13,794,053 13,136,109 11,539,969 10,548,705 272,356.18 8,812,313 8,470,895 8,022,077 GBs 106.91 9,062.93 22,705.28 46,353.12 21,111.94 13,665.43 GNSS_IGSTROP GNSS_DAILY_D MOD04_L2 MOD05_L2 AIRX2RET MYD04_L2 AIRIBRAD TRMM_3B42 GPS_ACORB 248 GNSS Final Troposphere Zenith Path Delay Product GNSS Daily Compact Observation Data Level 2 Aerosol Level 2 Total Precipitable Water Vapor Test Results AIRS/Aqua FINAL Level 2 Products (Without HSB) Level 2 Aerosol AIRS/Aqua infrared geolocated radiances TRMM 3B42 3-Hour 0.25deg x 0.25deg and Other-GPI Calibration Rainfall GPS AC Orbit Solution Product GHRSST Level 2P USA NASA MODIS Aqua 11 micron SST 11,632.24 1,340.71 18,781.63 ** When counting # of files, metadata files are not included. February 2012 FY2011 Annual Report 31
Known U.S. Foreign Product Distribution Trend Product Trend Foreign U.S. FY2007 35,960,845 65,563,006 FY2008 56,769,710 69,857,119 FY2009 120,843,195 113,052,619 FY2010 152,842,193 242,093,094 FY2011 189,496,476 262,304,205 Note: Metrics do not include product distribution where the destination country could not be determined. Also excluded are the ocean products from OBPG for which country information is not available. February 2012 FY2011 Annual Report 32
Web Trends Web metrics data for EOSDIS became available as of FY2007. Data for FY2007 is complete for 7 and FY2008 is complete for 8 of the 11 data centers providing the metrics for FY2009 and FY2010. During FY11, all 11 data centers provided metrics. These web metrics are for visits of one minute or more. Fiscal Year Views Visits FY2007 7,599,722 707,365 FY2008 8,263,283 827,714 FY2009 11,463,765 1,079,317 FY2010 13,654,146 1,108,858 FY2011 18,617,279 1,318,598 Visitors Repeat Visitors 443,079 523,416 702,058 718,944 855,976 77,731 91,801 116,886 205,378 150,076 February 2012 FY2011 Annual Report 33
Definitions (1 of 3) EMS Term Definition EOSDIS element serving as a source of metrics information for describing the ingest, archive and distribution of EOSDIS science data; web activity metrics are also collected. For the EOSDIS annual reporting, metrics from individual data providers at a single site are combined (e.g., NSIDC = NSIDCECS + NSIDCV0). Metrics describing the ingest, archive and distribution of EOSDIS science data at EOSDIS Data Centers. This EOSDIS Annual Report presents data metrics from EOSDIS Data Centers. Most metrics can be found in the EMS HTMLDB interface (http://ops1.ems.eosdis.nasa.gov: 8000/pls/apex/f?p=111). Metrics from other sources are noted in the report where applicable. Metrics describing the web activity at EOSDIS Data Center web sites and EOSDIS related web sites. This EOSDIS Annual Report presents web metrics by EOSDIS Data Centers. These metrics can be found in the EMS NetInsight interface (https://ems.eos.nasa.gov/NetInsight/index.html). Designates the type of business or organization accessing EOSDIS. The domain is determined from the IP address and country. Data Provider Data Metrics Web Metrics Domain EMS Data File Term Definition Ingest is the amount of data coming into a data center over a period of time and includes all product levels. Ingest Archive is the amount of data added to the archive over a period of time and includes all products levels. Archive The Total Archive Size describes the EOSDIS archive at the end of the fiscal year. This includes all data (including ancillary) but not data marked for deletion. Any individual requesting data as defined by an IP address plus email, within the time period. The number of distinct (i.e., counted once) users receiving science data or metadata during the report period. The smallest unit of data inventoried and distributed to users; typically, a granule is a single data file, though some granules may include multiple files. EMS counts individual files as distinct products. This is roughly equivalent to counting EOS granules, although in the case of some EOS instrument data, a granule may contain more than one file. If so, the files are counted as individual products. In counting unique products, A product having two different version numbers was considered two unique data products. The number of files successfully delivered to Public users. This count excludes METADATA file types. If the file type does not distinguish a file as a metadata or a science file, i.e., it is encoded as n/a, then the default process is to count the file as a science data product. Total Archive Size Data User Distinct Users Granule Product Number of Products Delivered Volume of Products Delivered The volume of data (in GBs) successfully delivered to Public users. This includes all file types, including METADATA. February 2012 FY2011 Annual Report 34
Definitions (2 of 3) EMS Data File Term Definition Any user who uses products obtained from the Data Providers for scientific or other uses. If a data provider does not assign user categories EMS automatically assigns all distributions to this category. Public User Any identified and authorized user who requests data for the purposes of quality assurance/testing. Any identified and authorized user who requests data for the purposes of product generation. QA/Test User Production User Any user (human or machine) that transfers data inside the data providers network space for the purpose of backups, internal testing, hardware migration, temporary staging of standard products, etc. Internal User Any user formally associated with a defined EOS Science Team using data for objectives of the respective Science Team. If a Science Team user acts in dual capacities (e.g. as a Science Team User and a Public User) the user must use different credentials to access data or user will be assigned to science user by EMS. All distinct Public users requesting data within the time period. Distinct Public users requesting data more than once during the time period. If the user is requesting data for the first time ever within the specific time period and then requests data again during the specific time period, he/she would be counted as a repeat user. Science Team User All Users Repeat Users EMS Web File Term Definition Any individual defined by IP Address+browser that views a web page. A visitor can also become a 'Data User' once data is requested. The number of distinct (i.e., counted once) visitors to a provider's web sites during the time period. Hit by a user during a session to a web page, excluding error hits and hits to user-defined files such as inline images (.JPG, .GIF, etc.), Java applets, and specific redirects or services provided by the data provider. A series of consecutive views of a website by the same user without continuous interruption of more than 30 minutes. If a user does not view a new page in a specified time, the next page viewed by that user is considered the start of a new visit. The number of page views to a provider's web pages over the time period. The number of visits over the time period. All distinct visitors viewing a web page during the report time period. Visitors who view a web page during a specific time period who have accessed the system before. If the visitor accesses the system for the first time ever within the time period and then accesses the system again during the specific time period, he/she would be counted as a repeat visitor. Visitor Distinct Visitors View Visit EMS Web Views EMS Web Visits All Visitors Repeat Visitors February 2012 FY2011 Annual Report 35
Definitions (3 of 3) Report Term Stage 1 Definition Metrics data directly from the EMS tools, presented by data provider as available. Stage 2 Metrics data grouped by data center , augmented with external data, includes all twelve data centers. Metrics data presented by the major contributing data centers, often accompanied by a graphic. Stage 3 February 2012 FY2011 Annual Report 36