Advances in Natural Language Processing and Deep Learning Research
Explore the latest advancements in Natural Language Processing (NLP) and Deep Learning research, covering topics such as Statistical Machine Learning, Machine Translation, Deep Text Analysis, and more. Dive into how children learn language naturally, the effectiveness of Big Data in training models, breakthroughs in Deep Learning, and applications like Named Entity Recognition and Sentiment Analysis. Stay updated on cutting-edge developments shaping the future of language technology.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
Letdellaparola Giuseppe Attardi Dipartimento di Informatica Universit di Pisa ESA SoBigData Pisa, 24 febbraio 2015
NaturalLanguage Learning Children learn to speak naturally, by talking with others Teach computers to learn language in a similarly natural way
Statistical Machine Learning Training on large document collections Requires ability to process Big Data If we used same algorithms 10 years ago they would still be running The Unreasonable Effectiveness of Big Data
Example: Machine Translation Arabic to English, five-gram language models, of varying size
Deep Learning Breakthrough: 2006 Output layer Prediction of target Hidden layers Learn more abstract representations Input layer Raw input
Lots of Unlabeled Data Language Model Corpus: 2 B words Dictionary: 130,000 most frequent words 4 weeks of training Parallel + CUDA algorithm 2 hours
Word Embeddings neighboring words are semantically related
A Unified Deep Learning Architecture for NLP NER (Named Entity Recognition) POS tagging Chunking Parsing SRL (Semantic Role Labeling) Sentiment Analysis
Deep Text Analysis Parsing Word Sense Disambiguation Anafora Resolution Information Extraction Sentiment Analysis Text Entailment Question Answering Biomedical Text Analysis
QA on Alzheimer Disease ROOT SUBJ OBJ APPO OBJ the -secretase inhibitor Semacestat failed to slow cognitive decline disorder protein drug SnowMed: C0236848 substance QA on Alzheimer Competition http://www.windturbinesyndrome.com/wp-content/uploads/2012/09/gold-medal.jpg
Big data, Big Brain Google DistrBelief Cluster capable of simulating 100 billion connections Used to learn unsupervised image classification Used to produce tiny ASR model Similar basic capability for processing image, audio and language European FET Brain project
