Transforming Data Silos to Interoperable Services & Platforms
Big Data applications in addressing storage and information extraction challenges for valuable data insights. Case study on automating information extraction for a TV channel receiving content from news agencies. Utilizing a cognitive platform based on multi-agents and knowledge graph to create an exploitable and interoperable information ecosystem. Dive into the technology stack involved, including Openshift, Docker containers, RabbitMQ, Ceph, and DevOps philosophies. Meet Aymeric Brisse, the CTO behind these innovative solutions.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
FROMDATASILOSTO SOURCESAND PLATFORMS PLATFORMS MULTI- -SOURCES ANDMULTI MULTI- -AGENTS AGENTSCOGNITIVE COGNITIVE MULTI AYMERIC BRISSE XLDB 2017 LIGHTNING TALK
Big Data | Applications NoSQL & distributed FS address the storage Data scientist & Machine Learning address the valuable information storage and access access issues (Cassandra, CephFS, etc.) information extraction extraction issues This allows awesome services to be built (image recognition, recommandation, etc.) | New challenges How to make these different services & data silos interoperable interoperable to cross-reference the data? How to make intelligible intelligible the mass of data now available to meet specific business needs? specific business needs? 2
Use case | Example A TV Channel receives various various content (footages, pictures, wires) from dozens of news agencies Automate Automate the valuable information extraction Retrieve structured structured & intelligible intelligible information (who, where, what) 3
Cognitive Platform | Workflow driven, based on multi-agents 4
Knowledge Graph | Exploitable & Interoperable information 5
Stack | Under the hood Base Base - - Openshift (Kubernetes with Docker containers & DevOps tools) Runtime Runtime - - One Docker image per Agent Communication Communication - - RabbitMQ for message delivery Databases Databases - - Various Storage Storage - - Ceph DevOps DevOps Philosophy Philosophy - - 12-Factor App (https://12factor.net/) 6
Aymeric BRISSE Aymeric BRISSE - - CTO aymeric.brisse@perfect-memory.com CTO
