Model Card for Model ID
VQA model that also supports bounding boxes.
Run via vLLM:
vllm serve ridcl/paperwerk-vqa \
--max-model-len 32768 \
--enable-auto-tool-choice \
--tool-call-parser hermes \
--tensor-parallel-size 2
Examples input:
{
"role": "user",
"content": [
{
"type": "image_url",
"image_url": {
"url": "data:image/jpeg;base64,..."
},
},
{"type": "text", "text": "Extract values:\n- contract_date\n- names of the parties\n- Where is the company registered?"},
],
}
Example output (bbox format: [xmin, ymin, xmax, ymax], 0..1000 scale):
[
{
"query": "contract_date",
"value": "1 April 2025",
"box_2d": [466, 693, 544, 705],
"index": 0,
},
{
"query": "names of the parties",
"value": "CoolCo B.V.",
"box_2d": [151, 279, 257, 292],
"index": 0,
},
{
"query": "names of the parties",
"value": "John Doe",
"box_2d": [151, 403, 261, 415],
"index": 0,
},
{
"query": "names of the parties",
"value": "Jane Doe",
"box_2d": [151, 509, 268, 522],
"index": 0,
},
{
"query": "Where is the company registered?",
"value": "Amsterdam",
"box_2d": [164, 302, 281, 315],
"index": 0,
},
]