Deep Learning for Natural Language Processing
A Gentle Introduction

Provides a clear, accessible introduction to deep learning for natural language processing, covering both practical and theoretical aspects.

Mihai Surdeanu (Author), Marco Antonio Valenzuela-Escárcega (Author)

9781316515662, Cambridge University Press

Hardback, published 8 February 2024

344 pages
23.5 x 16 x 2.5 cm, 0.647 kg

'Who should read this? This is a book about Natural Language Processing (NLP), not computational linguistics (or any kind of linguistics)--that is, about engineering, not science, at least as linguists understand that term. So whether you should read this book depends on what you want to do with your career (or your free time). If you want to describe under-described languages with sparse textual data, this book may not for you, since deep learning methods require large amounts of data. But mostly the book is for those who want to learn how NLP is done currently, and it explains this well.' Michael B. Maxwell, LINGUIST List

Deep Learning is becoming increasingly important in a technology-dominated world. However, the building of computational models that accurately represent linguistic structures is complex, as it involves an in-depth knowledge of neural networks, and the understanding of advanced mathematical concepts such as calculus and statistics. This book makes these complexities accessible to those from a humanities and social sciences background, by providing a clear introduction to deep learning for natural language processing. It covers both theoretical and practical aspects, and assumes minimal knowledge of machine learning, explaining the theory behind natural language in an easy-to-read way. It includes pseudo code for the simpler algorithms discussed, and actual Python code for the more complicated architectures, using modern deep learning libraries such as PyTorch and Hugging Face. Providing the necessary theoretical foundation and practical tools, this book will enable readers to immediately begin building real-world, practical natural language processing systems.

Preface
1. Introduction
2. The perception
3. Logistic regression
4. Implementing text classfication using perceptron and LR
5. Feed forward neural networks
6. Best practices in deep learning
7. Implementing text classification with feed forward networks
8. Distributional hypothesis and representation learning
9. Implementing text classification using word embedding
10. Recurrent neural networks
11. Implementing POS tagging using RNNs
12. Contexualized embeddings and transformer networks
13. Using transformers with the hugging face library
14. Encoder-decoder methods
15. Implementing encoder-decoder methods
16. Neural architecture for NLP applications
Appendix A: Overview of the python language and the key libraries
Appendix B: Character endcodings: ASCII and unicode.

Subject Areas: Computational linguistics [CFX]