Catalog Architecture for Efficient Data Management
"Explore the innovative architecture of a catalog presented by Luke Campbell and Micah Wengren. Learn how data providers share metadata through accessible folders and catalog services on the web. Discover the seamless process of metadata harvesting and management, enabling efficient data organization and service monitoring."
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
IOOS Catalog Presented by Luke Campbell and Micah Wengren
Catalog's new architecture Data Providers share metadata through a publicly available Web Accessible Folder (WAF) or through a Catalog Service for the Web (CSW). 3
Catalog's new architecture All metadata from Data Providers get copied into a publicly available central WAF. 4
Catalog's new architecture The IOOS Registry provides a web interface for data providers to set up and manage harvesting from their WAFs to the IOOS Central WAF. 5
Catalog's new architecture The IOOS Catalog harvests all the metadata records from the Central WAF and downloads them into CKAN's database. PyCSW downloads the records from CKAN. 6
Catalog's new architecture The IOOS Service Monitor downloads metadata from CKAN and combines statistics to present service-level metadata. 7
Registry Capabilities Harvest Management 9
Registry Capabilities Troubleshooting Errors 10
Registry Capabilities Synchronized with CKAN 11
Catalog Capabilities Search Full-text Keyword Geo-Filter Formats Tags Organization 12
Catalog Capabilities API Searching Updating (auth) Harvests (auth) 13
Challenges CKAN Architecture wasn't designed for frequent harvests and frequent metadata updates. ISO-19115 is not a simple standard. 14
Outlook Sensor Monitor Improvements Registry API Improve Harvesting Performance 15
