Build a large language model (from scratch) / Sebastian Raschka.
| Author/creator | Raschka, Sebastian author. |
| Format | Book |
| Publication | Shelter Island, NY : Manning Publications Co., [2025] |
| Description | xx, 343 pages : illustrations ; 24 cm |
| Subjects |
| Contents | Understanding large language models -- Working with text data -- Coding attention mechanisms -- Implementing a GPT model from scratch to generate text -- Pretraining on unlabeled data -- Fine-tuning for classification -- Fine-tuning to follow instructions -- Introduction to PyTorch -- References and further reading -- Exercise solutions -- Adding bells and whistles to the training loop -- Parameter-efficient fine-tuning with LoRA. |
| Abstract | Build a Large Language Model (From Scratch) is a practical and eminently-satisfying hands-on journey into the foundations of generative AI. Without relying on any existing LLM libraries, you'll code a base model, evolve it into a text classifier, and ultimately create a chatbot that can follow your conversational instructions. And you'll really understand it because you built it yourself! |
| Bibliography note | Includes bibliographical references (pages 289-299) index. |
| ISBN | 9781633437166 paperback |
| ISBN | 1633437167 paperback |
| ISBN | electronic book |