Italian Question Answering on Image Scene Graphs
GQA-it is a large-scale Italian dataset for Visual Question Answering based on the balanced version of GQA.
GQA-it contains more than 1 million question/answer pairs in Italian over 80K images obtained by applying Neural Machine Translation.
Most importantly, a Test set of 3,000 question-answer pairs has been manually validated to provide a valuable benchmark in Italian.
Example

Table with columns: Language, Question, Answer| Language | Question | Answer |
|---|
| En | Is the remote to the right or to the left of the book? | right |
| It | Il telecomando è a destra o a sinistra del libro? | destra |
| En | How thick is the book to the left of the remote? | thick |
| It | Quanto è spesso il libro a sinistra del telecomando? | spesso |
| En | What device is to the left of the calculator made of plastic? | charger |
| It | Quale dispositivo si trova a sinistra della calcolatrice di plastica? | caricabatterie |
| En | What's the charger made of? | plastic |
| It | Di cosa è fatto il caricabatterie? | plastica |
| En | Are there any phones? | no |
| It | Ci sono dei telefoni? | no |
Citation
@inproceedings{DBLP:conf/nl4ai/ScaiellaMHC024,
author={Antonio Scaiella and Daniele Margiotta and Claudiu Daniel Hromei and Danilo Croce and Roberto Basili},
title={Evaluating Multimodal Large Language Models for Visual Question-Answering in Italian},
year={2024},
cdate={1704067200000},
url={https://ceur-ws.org/Vol-3877/paper8.pdf},
booktitle={NL4AI@AI*IA},
crossref={conf/nl4ai/2024}
}