Enriches readers' understanding of how neural networks create a machine interpretable representation of the meaning of natural language

Includes an introductory chapter on machine learning, allowing novice readers to quickly understand how it is revolutionizing the field of natural language processing

Highlights mature commercial and open-source implementations available, providing key tips for readers implementing the reviewed techniques themselves

Klappentext

This book offers an introduction to modern natural language processing using machine learning, focusing on how neural networks create a machine interpretable representation of the meaning of natural language. Language is crucially linked to ideas - as Webster's 1923 "English Composition and Literature" puts it: "A sentence is a group of words expressing a complete thought". Thus the representation of sentences and the words that make them up is vital in advancing artificial intelligence and other "smart" systems currently being developed. Providing an overview of the research in the area, from Bengio et al.'s seminal work on a "Neural Probabilistic Language Model" in 2003, to the latest techniques, this book enables readers to gain an understanding of how the techniques are related and what is best for their purposes. As well as a introduction to neural networks in general and recurrent neural networks in particular, this book details the methods used for representing words, senses of words, and larger structures such as sentences or documents. The book highlights practical implementations and discusses many aspects that are often overlooked or misunderstood. The book includes thorough instruction on challenging areas such as hierarchical softmax and negative sampling, to ensure the reader fully and easily understands the details of how the algorithms function. Combining practical aspects with a more traditional review of the literature, it is directly applicable to a broad readership. It is an invaluable introduction for early graduate students working in natural language processing; a trustworthy guide for industry developers wishing to make use of recent innovations; and a sturdy bridge for researchers already familiar with linguistics or machine learning wishing to understand the other.

Inhalt

Introduction.- Machine Learning for Representations.- Current Challenges in Natural Language Processing.- Word Representations.- Word Sense Representations.- Phrase Representations.- Sentence representations and beyond.- Character-Based Representations.- Conclusion.