Coming soon · Book Profile
Machine Learning Engineering
A practical, end-to-end guide to the engineering principles and best practices required to successfully build, deploy, and maintain machine learning systems in production.
A profile of this book is on the way.
What it’s about
While many resources teach the theory and algorithms of machine learning, this book bridges the critical gap between building a model and deploying a robust, scalable, and maintainable ML system in the real world. It addresses the entire project lifecycle, from defining business goals and collecting data to feature engineering, model deployment, monitoring, and maintenance. Readers will learn to navigate the common pitfalls that cause most ML projects to fail, such as data leakage, distribution shift, and the lack of proper infrastructure. It's a comprehensive manual for data analysts becoming ML engineers, current ML engineers seeking more structure, and software architects who need to integrate ML models into production systems.
The through-line
- Who it’s for
- A data analyst, data scientist, or software engineer who knows the basics of machine learning but struggles to translate their models into real-world, production-grade applications that deliver business value. They want to move beyond notebooks and build robust, scalable, and maintainable ML systems.
- The problem
- Their machine learning projects get stuck in the prototype phase, take too long to deploy, or fail to perform as expected in production. They face engineering challenges like data quality issues, deployment complexity, and performance degradation over time. They feel frustrated and uncertain about how to bridge the gap between ML theory and practical engineering. They are overwhelmed by the complexity of building end-to-end systems and fear their models will fail silently, costing the business time and money.
- The plan
- Project Scoping: Learn to prioritize ML projects, define clear goals, and understand why projects fail.
- Data Management: Master the principles of data collection, preparation, versioning, and avoiding common data problems like bias and leakage.
- Feature Engineering: Systematically create, select, and manage features to build a robust foundation for your models.
- Model Lifecycle Management: Follow a structured process for training, evaluating, deploying, serving, monitoring, and maintaining models in production.
- Engineering Best Practices: Adopt proven software and ML engineering practices for building reliable, scalable, and maintainable systems.
- The payoff
- The reader can confidently lead and execute machine learning projects from conception to production. · They build scalable, reliable, and maintainable ML systems that deliver consistent business value. · They become a highly sought-after machine learning engineer, capable of bridging the gap between data science and software engineering.
See our guide
Related profiles we’ve built
- Time Series Forecasting Using Foundation Models →
- Understanding Deep Learning →
- The AI Marketing Canvas: A Five-Step AI Plan for Marketers →
- Artificial Intelligence →
- Artificial Intelligence - A Very Short Introduction →
- Effective Data Science Infrastructure →
- Human + Machine →
- Big Data_ A Very Short Introduction (Very Short Introductions) →
Additional reading
- OpenAI Prompt Engineering Guide · OpenAI
Official documentation from the model provider on how to craft effective prompts, recommended by the author.
- Anthropic's Prompt Engineering Guide · Anthropic
Official guide from another major LLM provider, offering best practices for prompt design.
- dair-ai/Prompt-Engineering-Guide · DAIR.AI Community
A comprehensive, community-maintained GitHub repository covering a wide range of prompt engineering techniques.
- GPT Researcher · assafelovic
An open-source project that inspired the book's research summarization engine, recommended for further exploration of building production-grade LLM applications.
- Building Effective AI Agents · Anthropic
An article recommended by the author for a deeper understanding of the distinction between agentic workflows and autonomous agents.
- Model Context Protocol (MCP) Official Website · Anthropic and Community
The primary source for the MCP specification, tutorials, and ecosystem resources, essential for building or consuming MCP servers.
- FastMCP 2 Documentation · jlowin and community
The official documentation for the recommended Python SDK for building MCP servers, used in the book's example.
- Knowledge Graph Enhanced RAG · Tomaž Bratanič and Oskar Hane
Recommended by the author for readers interested in diving deeper into combining knowledge graphs with RAG.
- Database Management Systems · Gehrke and Ramakrishnan
Referenced in Chapter 2 as a resource for readers unfamiliar with the basics of SQL and Relational Database Management Systems (RDBMSs), which are foundational for the structured data analysis chapters.
- Survey of Hallucination in Natural Language Generation · Ji, Z., Lee, N., Frieske, R., et al.
Cited in Chapter 2 to explain the concept of 'hallucinations' in LLMs and to underscore the importance of verifying information provided by models.