Ana gezinime geç Aramaya geç Ana içeriğe geç

Evidence-First Retrieval Augmented Generation with Claim Repair for Security Operations Center Workflows

  • Mehmet Anil Taysi
  • , Rabia Eda Yilmaz
  • , Hidir Bozkurt
  • , Ayse Irem Ozmen
  • , Gokhan Ince
  • MDP Group

Araştırma çıktısı: Kitap/Rapor/Konferans Bildirisinde BölümKonferans katkısıHakem

Özet

Retrieval Augmented Generation (RAG) is increasingly used in Security Operations Center (SOC) workflows, yet standard pipelines may still produce confident claims that are weakly grounded in retrieved evidence. We present Evidence-First RAG (EFIR), a trustworthiness pipeline for security analysis, Common Vulnerabilities and Exposures (CVE) impact assessment, and containment planning. EFIR integrates retrieval steering, schema-constrained structured generation with span-level citations, claim level verification, evidence relinking, and repair. EFIR is evaluated on SOC oriented CVE benchmarks that cover both naturalistic open retrieval and component level ablation settings. The evaluation uses reliability, retrieval coverage, and verified actionability metrics, together with a separate human annotation study for verifier reliability. In these settings, EFIR improves the quality of evidence based output by reducing verifier negative content and increasing verified actionability, while the ablation results show that retrieval steering and repair provide complementary gains. A separate annotation study on 300 claims further supports the verification component, yielding a checker accuracy of 0.91 and inter-rater $\kappa=0.692$.

Orijinal dilİngilizce
Ana bilgisayar yayını başlığıICHORA 2026 - 8th International Congress on Human-Computer Interaction, Optimization and Robotic Applications, Proceedings
YayınlayanInstitute of Electrical and Electronics Engineers Inc.
ISBN (Elektronik)9798331581503
DOI'lar
Yayın durumuYayınlandı - 2026
Etkinlik8th International Congress on Human-Computer Interaction, Optimization and Robotic Applications, ICHORA 2026 - Ankara, Türkiye
Süre: 21 May 202623 May 2026

Yayın serisi

AdıICHORA 2026 - 8th International Congress on Human-Computer Interaction, Optimization and Robotic Applications, Proceedings

???event.eventtypes.event.conference???

???event.eventtypes.event.conference???8th International Congress on Human-Computer Interaction, Optimization and Robotic Applications, ICHORA 2026
Ülke/BölgeTürkiye
ŞehirAnkara
Periyot21/05/2623/05/26

Bibliyografik not

Publisher Copyright:
© 2026 IEEE.

Parmak izi

Evidence-First Retrieval Augmented Generation with Claim Repair for Security Operations Center Workflows' araştırma başlıklarına git. Birlikte benzersiz bir parmak izi oluştururlar.

Alıntı Yap