Method | Data Set | Faster RCNN | Test-dev (%) | Test-std (%) | ||||||
Y/N | Num | Other | Overall | Y/N | Num | Other | Overall | |||
PDID (Resnet-18) | VQA v2.0 | × | 75.57 | 34.68 | 40.99 | 54.13 | 72.96 | 36.05 | 40.95 | 54.33 |
PDID (Resnet-50) | VQA v2.0 | √ | 83.77 | 49.12 | 57.13 | 68.81 | 81.82 | 42.29 | 55.99 | 64.38 |
PDID (Resnet-101) | VQA v2.0 | √ | 86.81 | 53.36 | 60.33 | 71.02 | 86.99 | 53.09 | 65.28 | 71.23 |
PDID (Resnet-18) | VQA v1.0 | × | 75.01 | 29.69 | 39.87 | 52.02 | 75.22 | 29.91 | 40.26 | 53.95 |
PDID (Resnet-50) | VQA v1.0 | √ | 82.59 | 44.24 | 56.24 | 67.93 | 81.93 | 43.95 | 56.03 | 68.12 |
PDID (Resnet-101) | VQA v1.0 | √ | 83.88 | 44.85 | 57.33 | 68.99 | 83.01 | 44.17 | 56.36 | 69.01 |
PDID (Resnet-18) | VQA-CP v2 | × | - | - | - | - | 40.55 | 11.05 | 30.79 | 29.32 |
PDID (Resnet-50) | VQA-CP v2 | √ | - | - | - | - | 46.84 | 12.72 | 35.97 | 36.39 |
PDID (Resnet-101) | VQA-CP v2 | √ | - | - | - | - | 47.25 | 13.21 | 36.98 | 37.75 |
PDID (Resnet-18) | COCO-QA | × | - | - | - | - | - | - | - | 60.24 |
PDID (Resnet-50) | COCO-QA | √ | - | - | - | - | - | - | - | 68.68 |
PDID (Resnet-101) | COCO-QA | √ | - | - | - | - | - | - | - | 68.91 |
PDID (Original) | VQA v2.0 | × | 86.91 | 53.34 | 60.45 | 71.08 | 87.99 | 54.08 | 65.37 | 71.87 |
PDID (Original) | VQA v1.0 | × | 86.72 | 45.24 | 60.45 | 70.11 | 86.99 | 45.24 | 60.37 | 69.68 |
PDID (Original) | VQA-CP v2 | × | - | - | - | - | 50.82 | 13.24 | 40.39 | 42.09 |
PDID (Original) | COCO-QA | × | - | - | - | - | - | - | - | 70.94 |