Match Tuning Best Practices - Data Profiling, Analysis, Design, and Implementation
Enhance your match tuning processes with best practices in data profiling, analysis, design, and implementation. Understand the life cycle of match rules, optimize attribute profiling, and fine-tune your matching algorithms for better results.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
Match Tuning Best Practices July 21, 2021
Match Rule Life Cycle Data Profiling and Analysis Testing and Tuning Design and Implementation Match Tuning 2
Data Analysis and Profiling - Profiling For each attribute from each source: Cardinality Completeness (Empty Strings, 0s, and nulls) Uniqueness Common Values (12/31/9999, 123-456-7890) Noise Words (Inc, Org, LLC) Standardization (Email, Phone, and Address) 3
Data Analysis and Profiling - Analysis Identifying Attributes Differentiating Attributes Categorizing Attributes Low Uniqueness Differentiates data within a nested attribute Examples Address.AddressType Educiation.University High Uniqueness Varying Compleness High Completeness Examples Examples Gender SSN City Email Phone 4
Design and Implementation - Design Configure rules in suspect rule type during design Set useOvOnly = true by default Be cautious when using negative rules Put match attributes names in the rule label Consider your Comparator and Tokenizer choices 5
Design and Implementation - Tokens ignoreInToken when In a not operand with ExactOrNull or ExactAndAllNull when the thresholdChars is used Low cardinality Attributes With multiple similar match rules One high identifying attribute per rule Keep Token Count < 300
Testing and Tuning - Static Match Rule Analyser GREEN - This indicates that the rule follows syntax and the analyzer has not found any major issue with the configuration. YELLOW - This indicates that the rule is identified either or has some similarities with an existing rule BLUE - This indicates that some of the operators used in the match rules could be either wrong or inefficient 7
Testing and Tuning - Troubleshooting Match Explanation API 9
