Skip to main navigation Skip to search Skip to main content

ITUNLP at MWE-2026 AdMIRe 2: A Zero-Shot LLM Pipeline for Multimodal Idiom Understanding and Ranking

  • Atakan Site*
  • , Oguz Ali Arslan
  • , Gülsen Eryigit
  • *Corresponding author for this work
  • Istanbul Technical University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

This paper presents our system for AdMIRe 2 (Advancing Multimodal Idiomaticity Representation), a shared task on multilingual multimodal idiom understanding. The task focuses on ranking images according to how well they depict the literal or idiomatic usage of potentially idiomatic expressions (PIEs) in context, across 15 languages and two tracks: a text-only track, and a multimodal track that uses both images and captions. To tackle both tracks, we propose a hybrid zero-shot pipeline built on large vision-language models (LVLMs). Our system employs a chain-of-thought prompting scheme that first classifies each PIE usage as literal or idiomatic and then ranks candidate images by their alignment with the inferred meaning. A primary-fallback routing mechanism increases robustness to safety-filter refusals, while lightweight post-processing recovers consistent rankings from imperfect model outputs. Without any task-specific fine-tuning, our approach achieves 55.9% Top-1 Accuracy in the text-only track and 60.1% in the multimodal (text+image) track, ranking first overall on the official leaderboard. These results suggest that carefully designed zero-shot LVLM pipelines can provide strong baselines for multilingual multimodal idiomaticity benchmarks.

Original languageEnglish
Title of host publicationMWE 2026 - 22nd Workshop on Multiword Expressions, Proceedings of the Workshop
EditorsAtul Kr. Ojha, Verginica Barbu Mititelu, Mathieu Constant, Ivelina Stoyanova, A. Seza Dogruoz, Alexandre Rademaker
PublisherAssociation for Computational Linguistics (ACL)
Pages226-236
Number of pages11
ISBN (Electronic)9798891763630
DOIs
Publication statusPublished - 2026
Event22nd Workshop on Multiword Expressions, MWE 2026 - Rabat, Morocco
Duration: 28 Mar 2026 → …

Publication series

NameMWE 2026 - 22nd Workshop on Multiword Expressions, Proceedings of the Workshop

Conference

Conference22nd Workshop on Multiword Expressions, MWE 2026
Country/TerritoryMorocco
CityRabat
Period28/03/26 → …

Bibliographical note

Publisher Copyright:
© 2026 Association for Computational Linguistics.

Fingerprint

Dive into the research topics of 'ITUNLP at MWE-2026 AdMIRe 2: A Zero-Shot LLM Pipeline for Multimodal Idiom Understanding and Ranking'. Together they form a unique fingerprint.

Cite this