Longformer for MS MARCO Document Re-ranking Task
By: Researcher
Disclaimer: The provided code links for this paper are external links. Science Nest has no responsibility for the accuracy, legality or content of these links. Also, by downloading this code(s), you agree to comply with the terms of use as set out by the author(s) of the code(s).
Please contact us in case of a broken link from here
| Authors | Mohammad Aliannejadi, Amir Soleimani, Fabio Crestani, Ivan Sekulić |
| Journal/Conference Name | arXiv preprint |
| Paper Category | Artificial Intelligence |
| Paper Abstract | Two step document ranking, where the initial retrieval is done by a classical information retrieval method, followed by neural re-ranking model, is the new standard. The best performance is achieved by using transformer-based models as re-rankers, e.g., BERT. We employ Longformer, a BERT-like model for long documents, on the MS MARCO document re-ranking task. The complete code used for training the model can be found on https//github.com/isekulic/longformer-marco |
| Date of publication | 2020 |
| Code Programming Language | Python |
| Comment |
Copyright Researcher 2022