Revolutionizing AI with Train Once, Apply Anywhere Framework - OmniTrustAI
"Explore OmniTrustAI's revolutionary approach to AI with the Train Once, Apply Anywhere Framework, enabling trustworthy and scalable AI solutions across diverse domains. Learn about Large Language Models, the challenges of direct use, and the innovative Customized LLM concept. Discover OmniMatch, a powerful tool for seamless data linkage, and its impressive performance metrics in handling complex datasets."
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
OmniTrustAI: Revolutionizing AI with the Train Once, Apply Anywhere Framework Xiaowei Xu University of Arkansas at Little Rock OmniTrustAI.com
Large Language Models (LLM) A LLM is a probabilistic model of languages. LLM is trained using zillions of data and spend billions of $. LLM can generate human- like text, answer questions, write creative content and many more
Problems of Using LLM Directly 01 02 03 Safety and Privacy issues. Suboptimal Domain-specific tasks Too big and too expensive.
Knowledge transfer for a trustworthy Customized LLM (CLLM) Domain Knowledge Organization-specific Knowledge Org. specific data Domain-tuning data CLLM General Knowledge Foundation LLM
We first train CLLM only once using a single dataset. TOAA Train Once, Apply Anywhere Framework Then we directly apply the trained model to data across various domains without any additional training. TOAA empowers a universally applicable and trustworthy AI for businesses of any scale.
OmniMatch - Match Anything Without Pain OmniMatch is an out-of-the-box tool designed for effortless data linkage across various domains. We deployed OmniMatch on 2 million record pairs of Pseudo people data, simulating a most challenging scenario for the US Census. 1 million record Truth file. 1 million record Hard to match file, characterized by 20% missing values and additional noise factors. Pseudo People Data Sample
OmniMatch Performance Metrics Pseudo people data Accuracy Precision Recall F1 Score Run Time+ 9.5 Hours 59 pairs/s 1.7 ms/per Pair 97.02% 100% 94.05% 96.93% + Note: Runtime is measured on one A-100 Nvidia GPU server with 40 GB memory to process 2 million pairs of records.
OmniMatch - Zillows PR Real Estate Data Preparation 2600 record pairs, from Zillow's Puerto Rico Real Estate data, another challenging scenario for the US Census. 1300 Match Record with noise introduced as below. 50% Address fields with Language Noise 92% Living Area attributes modified 35% Bathroom attributes modified 19% Bedroom attributes modified 1300 Non-Match Record Pairs. zpid 2052890025 Pr610 Bo Canicao Lote A Pr610 Km #1.5 2052890026 0 Carr #465 2052891760 411 Carr Pr #1 2052892331 14 Calle Santiago Iglesias Pantin streetAddress zipcode city 00664 00662 00602 00965 state latitude PR PR PR PR longitude -66.6537 -67.08792 -67.18716 -66.115654 price bathrooms_A bedrooms_A livingArea 2 2 2 1 homeType priceForHDP unit 45000 # 1.5 0.28145293847566577 265000 # 465 0.2962793847566575 129000 # 1 1220 sqft 85000 3476.7 sqft lotAreaValue_A lotAreaUnit Real Estate Data Jayuya Isabela Aguada Guaynabo 18.292738 18.46082 18.356049 18.43339 45000 265000 129000 85000 5 3 3 3 1562 SINGLE_FAMILY 1500 SINGLE_FAMILY 1220 SINGLE_FAMILY 1200 SINGLE_FAMILY acres acres Sample
OmniMatch Performance Metrics Zillow's PR Real Estate Data Accuracy Precision Recall F1 Score Run Time+ 79.7 Seconds 88.71% 99.80% 77.58% 87.30% + Note: Runtime is measured on one A-100 Nvidia GPU server with 40 GB memory to process 2600 pairs of records.
Conclusion Train Once, Apply Anywhere (TOAA) framework is revolutionary. OmniMatch is a powerful tool of data linkage. Universally applicable and Trustworthy Omni Trust AI.
Team Dr. Xiaowei Xu Vivek Gunasekaran Xingqiao Wang
Visit OmniTrustAI.com OmniMatch Trial
