Skip to main navigation Skip to search Skip to main content

Evidence-First Retrieval Augmented Generation with Claim Repair for Security Operations Center Workflows

  • Mehmet Anil Taysi
  • , Rabia Eda Yilmaz
  • , Hidir Bozkurt
  • , Ayse Irem Ozmen
  • , Gokhan Ince
  • MDP Group

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Retrieval Augmented Generation (RAG) is increasingly used in Security Operations Center (SOC) workflows, yet standard pipelines may still produce confident claims that are weakly grounded in retrieved evidence. We present Evidence-First RAG (EFIR), a trustworthiness pipeline for security analysis, Common Vulnerabilities and Exposures (CVE) impact assessment, and containment planning. EFIR integrates retrieval steering, schema-constrained structured generation with span-level citations, claim level verification, evidence relinking, and repair. EFIR is evaluated on SOC oriented CVE benchmarks that cover both naturalistic open retrieval and component level ablation settings. The evaluation uses reliability, retrieval coverage, and verified actionability metrics, together with a separate human annotation study for verifier reliability. In these settings, EFIR improves the quality of evidence based output by reducing verifier negative content and increasing verified actionability, while the ablation results show that retrieval steering and repair provide complementary gains. A separate annotation study on 300 claims further supports the verification component, yielding a checker accuracy of 0.91 and inter-rater $\kappa=0.692$.

Original languageEnglish
Title of host publicationICHORA 2026 - 8th International Congress on Human-Computer Interaction, Optimization and Robotic Applications, Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798331581503
DOIs
Publication statusPublished - 2026
Event8th International Congress on Human-Computer Interaction, Optimization and Robotic Applications, ICHORA 2026 - Ankara, Turkey
Duration: 21 May 202623 May 2026

Publication series

NameICHORA 2026 - 8th International Congress on Human-Computer Interaction, Optimization and Robotic Applications, Proceedings

Conference

Conference8th International Congress on Human-Computer Interaction, Optimization and Robotic Applications, ICHORA 2026
Country/TerritoryTurkey
CityAnkara
Period21/05/2623/05/26

Bibliographical note

Publisher Copyright:
© 2026 IEEE.

Keywords

  • claim verification
  • cybersecurity
  • evidence relinking
  • hallucination reduction
  • retrieval-augmented generation
  • SOC
  • trustworthy AI

Fingerprint

Dive into the research topics of 'Evidence-First Retrieval Augmented Generation with Claim Repair for Security Operations Center Workflows'. Together they form a unique fingerprint.

Cite this