Natural Language Processing:

Neural Networks and Large Language Models

https://github.com/NiuTrans/NLPBook

https://niutrans.github.io/NLPBook

Tong Xiao and Jingbo Zhu

This is a book on neural networks and large language models in NLP. It is intended for anyone interested in NLP and deep learning. Some of the chapters are drawn from our previously published articles (e.g., Introduction to Transformers: An NLP Perspective and Foundations of Large Language Models), but we have added significant new content.

Chapters

Table of Contents [pdf] Part I: Preliminaries

Chapter 1: Foundations of Machine Learning [[pdf]](./chapters/nlp-book-chapter1.pdf)
Chapter 2: Foundations of Neural Networks [[pdf]](./chapters/nlp-book-chapter2.pdf)

Part II: Basic Models

Chapter 3: Words and Word Vectors [[pdf]](./chapters/nlp-book-chapter3.pdf)
Chapter 4: Recurrent and Convolutional Sequence Models [[pdf]](./chapters/nlp-book-chapter4.pdf)
Chapter 5: Sequence-to-Sequence Models [[pdf]](./chapters/nlp-book-chapter5.pdf)
Chapter 6: Transformers [[pdf]](./chapters/nlp-book-chapter6.pdf)

Part III: Large Language Models

Chapter 7: Pre-training [[pdf]](./chapters/nlp-book-chapter7.pdf)
Chapter 8: Generative Models [[pdf]](./chapters/nlp-book-chapter8.pdf)
Chapter 9: Prompting [[pdf]](./chapters/nlp-book-chapter9.pdf)
Chapter 10: Alignment [[pdf]](./chapters/nlp-book-chapter10.pdf)
Chapter 11: Inference [[pdf]](./chapters/nlp-book-chapter11.pdf)
Chapter 12: Reasoning [[pdf]](./chapters/nlp-book-chapter12.pdf) 🆕

Here's the complete version containing all the chapters [pdf].

Citing This Book

@book{Xiao-and-Zhu:2025NLP,
  title={Natural Language Processing: Neural Networks and Large Language Models},
  author={Tong Xiao and Jingbo Zhu},
  publisher={NiuTrans},
  year={2025}
}

Translations of This Book

This book has been translated into multiple languages using LLMs. You can find these translations at https://github.com/NiuTrans/NLPBookTranslations. The available languages include Chinese, Japanese, French, German, Italian and Portuguese.

Contact Us

For any issues or comments, please feel free to contact the authors directly via e-mail: xiaotong [at] mail.neu.edu.cn