A practical introduction to information retrieval architecture, written primarily for information literacy and evidence synthesis librarians, with a smaller secondary audience of systems/discovery librarians. It covers Boolean search, BM25, dense retrieval, hybrid search, reranking, query understanding, agentic search, retrieval failure and evaluation.
Read the textbook — version 1.0, three parts, thirteen chapters and six appendices.
The repository also includes two interactive companions: the BM25 Evidence Lab and the Vector Similarity Lab.
search-textbook.html is the sole maintained edition and source of truth. The retired single-flow edition can be recovered from Git history, and its former public URL redirects to the textbook. See tools/README.md for the maintenance passes, and CHANGELOG.md for what changed between versions.
The text, tables, diagrams and code are licensed CC BY 4.0 — copy, excerpt, translate, adapt and redistribute for any purpose, including commercially, with credit. No permission request is needed.
Screenshots of commercial products (scite, Google Scholar, Web of Science and others) are third-party material reproduced for comment and criticism, and are not covered. Product names and trademarks belong to their owners. See LICENSE for the full terms.
There are teaching notes — audience-specific guidance for information literacy, evidence synthesis and systems/discovery cohorts; three course shapes (a half-day workshop, a six-week module, a thirteen-week course); guidance on marking the three application exercises; discussion prompts per part; and the list of product claims to re-verify before teaching.
Chapters and appendices are written to be assignable on their own, and each has a stable link — use the Copy link control in any chapter heading. Every chapter ends with three Check yourself questions whose answers stay hidden until clicked — four in Chapters 1, 9 and 10, which each carry an extra distinction. Three combinations stand alone particularly well: Part I (Chapters 1–4) as an information-literacy grounding in retrieval foundations and lexical search; Chapters 2, 9 and 11–13 with Appendix F for evidence synthesis, where Appendix F should be treated as core rather than optional; and Chapter 13 with Appendix D for systems/discovery work on procurement and evaluation.
Tay, A. C. H. (2026). How search decides what you see: A librarian's guide to Boolean search, BM25, embeddings, reranking, and the retrieval pipelines behind hybrid and agentic search (Version 1.0). https://aarontaycheehsien.github.io/Information-retrieval-crashcourse/
Generative AI assisted with research, drafting, revision, code and all explanatory illustrations. The author reviewed the outputs, checked cited claims against the linked sources and takes responsibility for the final content. Read the full generative-AI use disclosure.