Ana gezinime geç Aramaya geç Ana içeriğe geç

ITUNLP at IberLEF-PRESTA: A Zero-Shot Code Generation Approach for Question Answering over Spanish Tabular Data

  • Atakan Site*
  • , Emre Hakan Erdemir
  • , Gülşen Eryiğit
  • *Bu çalışma için yazışmadan sorumlu yazar
  • Istanbul Technical University

Araştırma sonucu: Dergiye katkıKonferans makalesibilirkişi

Özet

This paper presents our zero-shot, LLM-driven code generation approach for solving the IberLEF 2025 - PRESTA: Question Answering over Tabular Data in Spanish task. Our approach relies on a Python code generation framework that employs state-of-the-art large language models (LLMs), including OpenAI o3, Qwen3, DeepSeekR1, DeepSeek-V3, Llama 4, to generate executable Pandas code via optimized prompting strategies. Experimental results show that different LLMs vary in their effectiveness for code generation, and our hybrid configuration achieved the highest accuracy among the seven participating teams in the shared task. Specifically, our system reached 90% accuracy on the development set and 87% on the test set, demonstrating the viability of zero-shot methods for tabular question answering.

Orijinal dilİngilizce
DergiCEUR Workshop Proceedings
Hacim4098
Yayın durumuYayınlandı - 2025
Etkinlik2025 Iberian Languages Evaluation Forum, IberLEF 2025 - Zaragoza, Spain
Süre: 23 Eyl 202523 Eyl 2025

Bibliyografik not

Publisher Copyright:
© 2025 Copyright for this paper by its authors.

Parmak izi

ITUNLP at IberLEF-PRESTA: A Zero-Shot Code Generation Approach for Question Answering over Spanish Tabular Data' araştırma başlıklarına git. Birlikte benzersiz bir parmak izi oluştururlar.

Alıntı Yap