Cosine meets Softmax: A tough-to-beat baseline for visual grounding
By: Researcher
Disclaimer: The provided code links for this paper are external links. Science Nest has no responsibility for the accuracy, legality or content of these links. Also, by downloading this code(s), you agree to comply with the terms of use as set out by the author(s) of the code(s).
Please contact us in case of a broken link from here
| Authors | Vineet Gandhi, Nivedita Rufus, K. Madhava Krishna, Unni Krishnan R Nair |
| Journal/Conference Name | arXiv preprint |
| Paper Category | Artificial Intelligence |
| Paper Abstract | In this paper, we present a simple baseline for visual grounding for autonomous driving which outperforms the state of the art methods, while retaining minimal design choices. Our framework minimizes the cross-entropy loss over the cosine distance between multiple image ROI features with a text embedding (representing the give sentence/phrase). We use pre-trained networks for obtaining the initial embeddings and learn a transformation layer on top of the text embedding. We perform experiments on the Talk2Car dataset and achieve 68.7% AP50 accuracy, improving upon the previous state of the art by 8.6%. Our investigation suggests reconsideration towards more approaches employing sophisticated attention mechanisms or multi-stage reasoning or complex metric learning loss functions by showing promise in simpler alternatives. |
| Date of publication | 2020 |
| Code Programming Language | Python |
| Comment |
Copyright Researcher 2022