Review of Rosetta Orbiter Radar Data Archive Findings

Rosetta Orbiter RSI Bi-Static Radar (BSR) Data Archive Review David Hollibaugh Baker NASA Goddard Space Flight Center 9/3/2019 RO-C-RSI-1/2/3-PRL-1537-V1.0 RO-C-RSI-1/2/3-PRL-1538-V1.0 RO-C-RSI-1/2/3-PRL-1539-V1.0 RO-C-RSI-1/2/3-ESC1-1554-V1.0 RO-C-RSI-1/2/3-ESC1-1555-V1.0 RO-C-RSI-1/2/3-ESC1-1556-V1.0

Overview Reviewed many of the document files, with spot checking of data products due to time constraints. Will provide summaries of findings for: Root Directory Files Catalog Files Document Files Calib Files Index Files Brows Files Data Files (level 1a) Data Files (level 2) Extras Summary of RIDs (internal red text) at end of presentation. Also included is a summary of issues found later that did not make it in as RIDs (internal orange text).

Root Directory Files (aareadme, errata, voldesc) Present in every volume and looked the same. Looked good.

Catalog Files Visually assessed presence and readability across volumes. Appeared consistent across volumes. catinfo.cat looked good dataset.cat some inconsistencies with data files (see next slides) insthost.cat a lot of useful details; did not fully read, but looked good. mission.cat a lot of useful details; did not fully read, but looked good. person.cat looked good. ref.cat did not fully read but looked good. soft.cat dummy file; ok. target.cat did not fully read but looked good.

Catalog Files dataset.cat some inconsistencies with data files. RSI-US_DB-002: The dataset.cat document describes the data filename convention as rggttttlll_sss_yydddhhmm_qq.eee, however the level 2 data are missing a '0' from the file name to be compliant with the convention. That is, the the "lll" part of the file name should be 'l02', not 'l2' as currently given. For example, r14r1a3l2_bsr_142832157_00.tab should be r14r1a3l02_bsr_142832157_00.tab. should be l02 Excerpted from dataset.cat

Catalog Files dataset.cat some inconsistencies with data files. RSI-US_DB-003: The Level 2 data are grouped in three directories: bsr, ptl, and tml. The dataset.cat document does not describe the difference between these data or defines what the directory names mean. A description of these was not found in any other document. RSI-US_DB-005: The dataset.cat file suggests that there should be Level 2 DPS, DPX, and SRG data, or bistatic radar surface reflection geometry files. These were not included in the datasets. Are they missing? DPX, DPS, RGS, RGX, and SRG files are not found in level 2 directory Excerpted from dataset.cat Level 2 data directories Not mentioned here. (However, later found a description in calibration document)

Catalog Files dataset.cat some inconsistencies with data files. RSI-US_DB-004: There are multiple data products that have different data source identifiers (i.e., the 'tttt' in the filename convention rggttttlll_sss_yydddhhmm_qq.eee). For example, r14r2a3l1a_rsr_142712215_02.dat has a data source identifier of 'r2a3', meaning RSR block 2A, subchannel 3, open loop. A meaningful description of what this means was not found in dataset.cat or TNF_SIS.TXT; or, if it does exist then it is not easily found. This is important for understanding the differences in the data products and their meaning. Further, Level 2 filenames have data source identifiers of 'R1Az', etc, but the dataset.cat document (File naming convention section) suggests that these are only for Level 1A and Level 1B data, and are not listed under Level 2. Not immediate clear what the difference is. (Although later discovered through careful scrutiny of labels that these are X/S band, and RCP/LCP data.

Document Files There were a lot of document files with a lot of very useful information. Sometimes difficult to identify the appropriate documents for just the bistatic radar experiment. But with some searching, eventually found useful information. dsn_doc/rose_bsr_20140928_d14.pdf seems important but not in docinfo.cat or referenced in any of the level 2 labels or data descriptions. data Filenames have 2A and 2A; should these columns be renamed 2A and 2B?

Document Files Examined docinfo.txt. Discrepancies in dsn_doc*: cnfg_cal.doc : not in docinfo.txt; Suggest that it be pdf format. JPEG : missing from directory, docinfo.txt states that it is a zip folder of jpeg files. r14dsn0l1a_nmc_142712215_00.txt (and similar in other volumes) : not listed in docinfo.txt rose_bsr_20140928_d14.pdf (and similar in other volumes): not listed in docinfo.txt *Was too late getting these in as RIDs. Listed in separate summary table at end of presentation

Index Files Visually assessed presence and readability across volumes. browse_index - ok checksum - ok index - ok indexinfo - ok

Calib Files Visual assessed presence and readability across volumes. Generally looked ok. For level 1a data, labels have RECORD_TYPE = UNDEFINED. Is this OK? Calinfo.txt suggests that the files are ASCII.

Browse Files Visually assessed presence and readability across volumes. The browse images were helpful. In all of the files: Label files state that the lower right panels of images should have an extract of the first few lines of the source RSR PDS label . In fact, the lower right panels are blank. Lower Right Panel Blank

Data Directories (level1a) Used IDL ReadPDS v4.9 to spot check at least two .dat files from each volume. data = READPDS('r14r1a3l1a_rsr_142712215_00.lbl', HEADPDS=label, /SILENT) Was able to read and manipulate/plot data in all files. Too many columns to evaluate accuracy of all of the data. Example plot from r14r1b3l1a_rsr_142712215_00 Data evaluated:

Data Directories (level02) Opened at least one .tab file from each volume in Excel and inspected. Detailed plots of 14r1b3l2_bsr_142712215_00, etc. in volume RO-C-RSI-1/2/3-PRL-1537-V1.0 Tried to replicate the Browse products.

Data Directories (level02) Issues: RSI-US_DB-001: The level 2 files (bsr, ptl, and tml in RO-C-RSI- 1/2/3-PRL-1537-V1.0) are missing an 'r' at the start of their name, per the dataset.cat description. RSI-US_DB-006: Level 2 products have PRODUCT_TYPE = "UDR" in labels, when they probably should be "RDR" types since the data have been reduced through calibration. missing an r

Data Directories (level02) Issues: BSR data: Are the values across all of the sub-channels suppose to be identical? BSR data: Need to describe differences between _00 and _01 files in the labels. RSI-US_DB-004: What are the differences in the data source identifiers (e.g., 'r2a3', meaning RSR block 2A, subchannel 3, open loop). Not clear in labels, dataset.cat or other files. My guess is X, S, RCP, and LCP based on labels but, again, not clear. RSI-US_DB-003: What are the differences between BSR, PTL, and TML? Not in labels or dataset.cat. In calibration document, though. All of the above needs to be made more clear. It took me too long to figure out all this information!

Data Directories (level02, ptl, tml) 14r1b3l2_ptl_142712215_00;14r1b3l2_ptl_142712215_01; 14r1b3l2_tml_142712215_00.tab Data plot looks good!

Data Directories (level02, ptl, tml) 14r1b3l2_ptl_142712215_00;14r1b3l2_ptl_142712215_01; 14r1b3l2_tml_142712215_00.tab Data plot looks good!

Data Directories (level02, bsr, tml) 14r1b3l2_bsr_142712215_00; 14r1b3l2_bsr_142712215_01; 14r1b3l2_tml_142712215_00.tab Labels not clear on the difference between _00 and _01 files

Data Directories (level02, ptl, tml) ptl: 14r1b3l2_ptl_142712215_00 and 14r1b3l2_ptl_142712215_01 Browse: r14r1b3l1a_bro_142712215_01.jpg Power vs. time plots agree well Are these power spectra data missing from level 2? Or derived from level 1a dsn files?

Data Directories (level02, tml) One tml file (14r1b3l2_tml_142712215_00) had ellipsis ( ) as a separator between start and stop time. All other tml files visually looked ok. 14r1b3l2_tml_142712215_00.tab Ellipsis separator

Data Directories ros_rsi_igm_is_3087.pdf: 7.1.3.2.2. Bistatic Radar products level 2: Power Spectra States that The BSR spectra contain as a function of spectral frequency the power of the right-handed circular polarized (RCP) and the left-handed circular polarized (LCP) signals at X-band and S-band, and the real and imaginary components of the RCP and LCP cross spectra again at both frequency bands. I did not see this data, as outlined in Table 7-10. The BSR data in the Level 2 directory only contain time and power. Where is the rest of the data for the power spectra (power vs. frequency)? The file format description also does not describe the PTL and TML files (although this is described in the calibration report files)

Extras Did not fully evaluate the SPICE data in the extras folders. RSI-US_DB-007: There is no data in the following directory: RORSI_4003_2014_284_V1.0/extras/ancillary/spice/spk

Summary The data were readable and generally looked good, and many helpful documents were included. Often difficult to find the documents or information specifically pertaining to the bistatic radar experiment. Much too difficult for a novice to the experiment to easily understand the differences between the level 2 data products. Need to provide consistency in documentation and improved direction to appropriate documents.

RIDs (in Eclipse) RSI-US_DB- 001 The level 2 files (bsr, ptl, and tml in RO-C-RSI-1/2/3-PRL-1537-V1.0) are missing an 'r' at the start of their name, per the dataset.cat description. minor Level 2 data missing an 'r' in filename The dataset.cat document describes the data filename convention as rggttttlll_sss_yydddhhmm_qq.eee, however the level 2 data are missing a '0' from the file name to be compliant with the convention. That is, the the "lll" part of the file name should be 'l02', not 'l2' as currently given. For example, r14r1a3l2_bsr_142832157_00.tab should be r14r1a3l02_bsr_142832157_00.tab. RSI-US_DB- 002 minor Product file names inconsistent with dataset.cat The Level 2 data are grouped in three directories: bsr, ptl, and tml. The dataset.cat document does not describe the difference between these data or defines what the directory names mean. A description of these was not found in any other document. RSI-US_DB- 003 minor Add level 2 directory description to dataset.cat There are multiple data products that have different data source identifiers (i.e., the 'tttt' in the filename convention rggttttlll_sss_yydddhhmm_qq.eee). For example, r14r2a3l1a_rsr_142712215_02.dat has a data source identifier of 'r2a3', meaning RSR block 2A, subchannel 3, open loop. A meaningful description of what this means was not found in dataset.cat or TNF_SIS.TXT; or, if it does exist then it is not easily found. This is important for understanding the differences in the data products and their meaning. Further, Level 2 filenames have data source identifiers of 'R1Az', etc, but the dataset.cat document (File naming convention section) suggests that these are only for Level 1A and Level 1B data, and are not listed under Level 2. RSI-US_DB- 004 minor Data source identifiers The dataset.cat file suggests that there should be Level 2 DPS, DPX, and SRG data, or bistatic radar surface reflection geometry files. These were not included in the datasets. Are they missing? Level 2 products have PRODUCT_TYPE = "UDR" in labels, when they probably should be "RDR" types since the data have been reduced through calibration. There is no data in the following directory: RORSI_4003_2014_284_V1.0/extras/ancillary/spice/spk RSI-US_DB- 005 major Level 2 DPS, DPX, and SRG files? RSI-US_DB- 006 minor Level 2 data labeled as "UDR" RSI-US_DB- 007 minor Empty spk directory

Other Issues (not in Eclipse) 1. Document Files: dsn_doc/rose_bsr_20140928_d14.pdf seems important but not in docinfo.cat or referenced in any of the level 2 labels or data descriptions. Should the table s channel names 3A and 3B be renamed 2A and 2B ? 2. Document Files: Discrepancies in dsn_doc: a. cnfg_cal.doc : not in docinfo.txt; Suggest that it be pdf format. b. JPEG : missing from directory, docinfo.txt states that it is a zip folder of jpeg files. c. r14dsn0l1a_nmc_142712215_00.txt (and similar in other volumes) : not listed in docinfo.txt d. rose_bsr_20140928_d14.pdf (and similar in other volumes): not listed in docinfo.txt 3. Calib Files: For level 1a data, labels have RECORD_TYPE = UNDEFINED. Is this OK? Calinfo.txt suggests that the files are ASCII.

Other Issues (not in Eclipse) 4. Browse Files: Label files state that the lower right panels of images should have an extract of the first few lines of the source RSR PDS label . In fact, the lower right panels are blank. 5. Level 2 Data (BSR): Are the values across all of the sub- channels suppose to be identical? 6. Level 2 Data (BSR): Labels not clear on the difference between _00 and _01 files. 7. Level 2 Data (General): Are the power spectra data missing from level 2? Or derived from level 1a dsn files? 8. Level 2 Data (TML): One tml file (14r1b3l2_tml_142712215_00) had ellipsis ( ) as a separator between start and stop time.