Published: 2020

Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks

CATEGORIES

RISK-BASED PROCESS SAFETY ELEMENTS

Research Summary

This foundational paper introduced the term Retrieval-Augmented Generation and the basic idea that still underlies most RAG systems: combine a language model’s parametric memory with an external, searchable document index. A neural retriever selects relevant passages, and the generator uses those passages while composing an answer. The authors describe two formulations—RAG-Sequence and RAG-Token—and show improved performance and factual specificity on knowledge-intensive tasks. For Process Safety Management, the central lesson is that an LLM need not rely only on knowledge embedded during training. It can retrieve current, organization-controlled evidence from PHAs, MOCs, incident reports, procedures, standards, and equipment records at query time. This supports updating knowledge without retraining, can provide provenance for answers and reduces the occurance of hallucinations. The paper is technical, but it supplies the conceptual architecture needed to understand what the retriever, vector index, and generator each do.

AUTHORS

Patrick Lewis; Ethan Perez; Aleksandra Piktus; Fabio Petroni; Vladimir Karpukhin; Naman Goyal; Heinrich Küttler; Mike Lewis; Wen-tau Yih; Tim Rocktäschel; Sebastian Riedel; Douwe Kiela

CITATIONS

P. Lewis et al., “Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks,” in Advances in Neural Information Processing Systems 33 (NeurIPS 2020), H. Larochelle et al., Eds. Red Hook, NY, USA: Curran Associates, 2020, pp. 9459–9474.

STAY INFORMED

AI & Process Safety Updates

New research, practical insights, and AI applications for process safety.
Research updates from PSM.ai and Gateway Group. Unsubscribe anytime.

Related Research

STAY INFORMED

AI & Process Safety Updates

New research, practical insights, and AI applications for process safety.
Research updates from PSM.ai and Gateway Group. Unsubscribe anytime.