Ana gezinime geç Aramaya geç Ana içeriğe geç

ITUNLP at MWE-2026 AdMIRe 2: A Zero-Shot LLM Pipeline for Multimodal Idiom Understanding and Ranking

  • Atakan Site*
  • , Oguz Ali Arslan
  • , Gülsen Eryigit
  • *Bu çalışma için yazışmadan sorumlu yazar
  • Istanbul Technical University

Araştırma çıktısı: Kitap/Rapor/Konferans Bildirisinde BölümKonferans katkısıHakem

1 Atıf (Scopus)

Özet

This paper presents our system for AdMIRe 2 (Advancing Multimodal Idiomaticity Representation), a shared task on multilingual multimodal idiom understanding. The task focuses on ranking images according to how well they depict the literal or idiomatic usage of potentially idiomatic expressions (PIEs) in context, across 15 languages and two tracks: a text-only track, and a multimodal track that uses both images and captions. To tackle both tracks, we propose a hybrid zero-shot pipeline built on large vision-language models (LVLMs). Our system employs a chain-of-thought prompting scheme that first classifies each PIE usage as literal or idiomatic and then ranks candidate images by their alignment with the inferred meaning. A primary-fallback routing mechanism increases robustness to safety-filter refusals, while lightweight post-processing recovers consistent rankings from imperfect model outputs. Without any task-specific fine-tuning, our approach achieves 55.9% Top-1 Accuracy in the text-only track and 60.1% in the multimodal (text+image) track, ranking first overall on the official leaderboard. These results suggest that carefully designed zero-shot LVLM pipelines can provide strong baselines for multilingual multimodal idiomaticity benchmarks.

Orijinal dilİngilizce
Ana bilgisayar yayını başlığıMWE 2026 - 22nd Workshop on Multiword Expressions, Proceedings of the Workshop
EditörlerAtul Kr. Ojha, Verginica Barbu Mititelu, Mathieu Constant, Ivelina Stoyanova, A. Seza Dogruoz, Alexandre Rademaker
YayınlayanAssociation for Computational Linguistics (ACL)
Sayfalar226-236
Sayfa sayısı11
ISBN (Elektronik)9798891763630
DOI'lar
Yayın durumuYayınlandı - 2026
Etkinlik22nd Workshop on Multiword Expressions, MWE 2026 - Rabat, Morocco
Süre: 28 Mar 2026 → …

Yayın serisi

AdıMWE 2026 - 22nd Workshop on Multiword Expressions, Proceedings of the Workshop

???event.eventtypes.event.conference???

???event.eventtypes.event.conference???22nd Workshop on Multiword Expressions, MWE 2026
Ülke/BölgeMorocco
ŞehirRabat
Periyot28/03/26 → …

Bibliyografik not

Publisher Copyright:
© 2026 Association for Computational Linguistics.

Parmak izi

ITUNLP at MWE-2026 AdMIRe 2: A Zero-Shot LLM Pipeline for Multimodal Idiom Understanding and Ranking' araştırma başlıklarına git. Birlikte benzersiz bir parmak izi oluştururlar.

Alıntı Yap