Back to news
security Priority 4/5 8/28/2026, 11:05:47 AM

Survey on Retrieval-Augmented Generation Security Highlights Pipeline Vulnerabilities and Defense Frameworks

Survey on Retrieval-Augmented Generation Security Highlights Pipeline Vulnerabilities and Defense Frameworks

Retrieval-Augmented Generation has become a standard architecture for reducing large language model hallucinations by integrating external knowledge sources. However, this architectural shift introduces fresh security and robustness risks that extend beyond conventional model vulnerabilities. A new survey paper published on arXiv, titled "Retrieved But Not Reliable," systematically explores these emerging threat vectors, including corpus poisoning, backdoor attacks, and privacy leakage. The researchers categorize the security landscape into three core attacker objectives: accuracy, privacy, and fairness. By mapping these objectives across the standard retrieval pipeline, the survey provides a unified threat model targeting the corpus database, the vector retriever, and the generator model. This structured approach helps engineers pinpoint exactly where traditional data sanitization fails to protect downstream model outputs. On the defensive front, the survey evaluates countermeasures across four distinct stages: retrieval, reranking, generation, and traceback. Security teams can leverage these findings to design defense-in-depth strategies, such as validating retrieved documents before feeding them to generators or implementing traceback mechanisms to detect poisoned sources. Practitioners should evaluate these defensive patterns against their specific organizational data constraints and operational pipelines before production deployment.

Related tools

Recommended tools for this topic

These picks prioritize high-intent tools relevant to this topic. Some links may include partner or affiliate tracking.

#arxiv#research#security#data

Action Checklist

  1. Audit and sanitize all data ingestion sources Prevent corpus poisoning by verifying the integrity of raw documents before they are embedded into the vector database.
  2. Implement validation checks during the retrieval stage Filter out low-confidence or potentially adversarial retrieval results prior to the reranking and generation phases.
  3. Treat retrieved chunks as untrusted inputs inside the generator prompt Apply prompt-injection defenses and output-filtering techniques on the generation layer.
  4. Establish a traceback and lineage auditing system Maintain detailed mappings of which source documents contributed to specific model outputs to trace security anomalies.
  5. Benchmark pipeline robustness against known RAG attack models Utilize existing security benchmarks to simulate corpus poisoning and privacy leakage attacks in staging environments.

Source: arXiv

This page summarizes the original source. Check the source for full details.

Related