Desmond Elliott

Desmond Elliott

Assistant professor, tenure track, Associate Professor

Member of:


    1. 2023
    2. Published

      Cleaner Categories Improve Object Detection and Visual-Textual Grounding

      Rigoni, D., Elliott, Desmond & Frank, Stella Christina, 2023, Image Analysis - 23rd Scandinavian Conference, SCIA 2023, Proceedings. Gade, R., Felsberg, M. & Kämäräinen, J-K. (eds.). Springer, p. 412-442 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 13885 LNCS).

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    3. Published

      Evaluating Bias and Fairness in Gender-Neutral Pretrained Vision-and-Language Models

      Cabello Piqueras, Laura, Bugliarello, Emanuele, Brandl, Stephanie & Elliott, Desmond, 2023, Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics (ACL), p. 8465-8483

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    4. Published

      LMCAP: Few-shot Multilingual Image Captioning by Retrieval Augmented Language Model Prompting

      Ramos, R., Martins, B. & Elliott, Desmond, 2023, Findings of the Association for Computational Linguistics, ACL 2023. Association for Computational Linguistics (ACL), p. 1635-1651

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    5. Published

      Language Modelling with Pixels

      Rust, Phillip, Lotz, Jonas Færch, Bugliarello, Emanuele, Salesky, E., Lhoneux, M. D. & Elliott, Desmond, 2023, The Eleventh International Conference on Learning Representations. arXiv.org, 32 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    6. Published

      MULTIFIN: A Dataset for Multilingual Financial NLP

      Jørgensen, R. K., Brandt, O., Hartmann, M., Dai, X., Igel, Christian & Elliott, Desmond, 2023, EACL 2023 - 17th Conference of the European Chapter of the Association for Computational Linguistics, Findings of EACL 2023. Association for Computational Linguistics (ACL), p. 864-879

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    7. Published

      PHD: Pixel-Based Language Modeling of Historical Documents

      Borenstein, Nadav, Rust, Phillip, Elliott, Desmond & Augenstein, Isabelle, 2023, Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processin. Association for Computational Linguistics (ACL), p. 87–107

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    8. Published

      Retrieval-augmented Image Captioning

      Ramos, R., Elliott, Desmond & Martins, B., 2023, EACL 2023 - 17th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Conference. Association for Computational Linguistics (ACL), p. 3648-3663

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    9. Published

      Smallcap: Lightweight Image Captioning Prompted with Retrieval Augmentation

      Ramos, R., Martins, B., Elliott, Desmond & Kementchedjhieva, Yova Radoslavova, 2023, Proceedings - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023. IEEE Computer Society Press, p. 2840-2849 10 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    10. Published

      Text Rendering Strategies for Pixel Language Models

      Lotz, Jonas Færch, Salesky, E., Rust, Phillip & Elliott, Desmond, 2023, Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics (ACL), p. 10155–10172

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    11. Published

      Visual Prediction Improves Zero-Shot Cross-Modal Machine Translation

      Hirasawa, T., Bugliarello, Emanuele, Elliott, Desmond & Komachi, M., 2023, Proceedings of the 8th Conference on Machine Translation, WMT 2023. Association for Computational Linguistics (ACL), p. 520-533

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    12. 2022
    13. Published

      Beyond Text and Back Again

      Elliott, Desmond, 2022, Proceedings of the Web Conference 2021 (WWW ’21),. ACM, p. 364-364 1 p.

      Research output: Chapter in Book/Report/Conference proceedingConference abstract in proceedingsResearch

    14. Published

      Context dependent prediction in DNA sequence using neural networks

      Grønbæk, Christian, Liang, Yuhu, Elliott, Desmond & Krogh, Anders, 2022, In: PeerJ. 10, 22 p., e13666.

      Research output: Contribution to journalJournal articleResearchpeer-review

    15. Published

      Date Recognition in Historical Parish Records

      Cabello Piqueras, Laura, Fierro Mella, Constanza Catalina, Lotz, Jonas Færch, Rust, Phillip, Rommedahl, J., Due, J. K., Igel, Christian, Elliott, Desmond, Pedersen, C. B., Salazar, I. & Søgaard, Anders, 2022, Frontiers in Handwriting Recognition : 18th International Conference, ICFHR 2022, Hyderabad, India, December 4–7, 2022, Proceedings. Porwal, U., Fornés, A. & Shafait, F. (eds.). Springer, p. 49-64 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 13639 LNCS).

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    16. Published

      IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages

      Bugliarello, Emanuele, Liu, F., Pfeiffer, J., Reddy, S., Elliott, Desmond, Ponti, E. M. & Vulić, I., 2022, Proceedings of the 39th International Conference on Machine Learning. PMLR, p. 2370-2392 (Proceedings of Machine Learning Research, Vol. 162).

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    17. Published

      Multilingual Multimodal Learning with Machine Translated Text

      Qiu, C., Oneată, D., Bugliarello, Emanuele, Frank, Stella Christina & Elliott, Desmond, 2022, Findings of the Association for Computational Linguistics: EMNLP 2022. Association for Computational Linguistics (ACL), p. 4178–4193

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    18. Published

      Revisiting Transformer-based Models for Long Document Classification

      Dai, X., Chalkidis, Ilias, Darkner, Sune & Elliott, Desmond, 2022, Findings of the Association for Computational Linguistics: EMNLP 2022. Association for Computational Linguistics, p. 7212–7230

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    19. 2021
    20. Published

      The Role of Syntactic Planning in Compositional Image Captioning

      Bugliarello, Emanuele & Elliott, Desmond, Apr 2021, Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume. Online: Association for Computational Linguistics, p. 593–607

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    21. Published

      Multimodal pretraining unmasked: A meta-analysis and a unified framework of vision-and-language berts

      Bugliarello, Emanuele, Cotterell, R., Okazaki, N. & Elliott, Desmond, 2021, In: Transactions of the Association for Computational Linguistics. 9, p. 978-994 17 p.

      Research output: Contribution to journalJournal articleResearchpeer-review

    22. Published

      Probing Cross-Modal Representations in Multi-Step Relational Reasoning

      Parfenova, I., Elliott, Desmond, Fernández, R. & Pezzelle, S., 2021, Proceedings of the 6th Workshop on Representation Learning for NLP (RepL4NLP-2021). Association for Computational Linguistics, p. 152-162

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    23. Published

      The added effect of artificial intelligence on physicians’ performance in detecting thoracic pathologies on CT and chest X-ray: A systematic review

      Li, D., Pehrson, Lea Marie, Lauridsen, C. A., Tøttrup, L., Fraccaro, M., Elliott, Desmond, Zajac, Hubert Dariusz, Darkner, Sune, Carlsen, Jonathan Frederik & Nielsen, Michael Bachmann, 2021, In: Diagnostics. 11, 12, 17 p., 2206.

      Research output: Contribution to journalReviewResearchpeer-review

    24. Published

      Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers

      Frank, S., Bugliarello, Emanuele & Elliott, Desmond, 2021, Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics (ACL), p. 9847-9857

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    25. Published

      Visually Grounded Reasoning across Languages and Cultures

      Liu, F., Bugliarello, Emanuele, Ponti, E. M., Reddy, S., Collier, N. & Elliott, Desmond, 2021, e: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics (ACL), p. 10467–10485

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    26. Published

      mDAPT: Multilingual Domain Adaptive Pretraining in a Single Model

      Kær Jørgensen, R., Hartmann, M., Dai, X. & Elliott, Desmond, 2021, Findings of the Association for Computational Linguistics: EMNLP 2021. Association for Computational Linguistics, p. 3404-3418

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    27. 2020
    28. Published

      CompGuessWhat?! A Multi-task Evaluation Framework for Grounded Language Learning

      Suglia, A., Konstas, I., Vanzo, A., Bastianelli, E., Elliott, Desmond, Frank, S. & Lemon, O., 2020, Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, p. 7625–7641

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    29. Published

      Fine-Grained Grounding for Multimodal Speech Recognition

      Srinivasan, T., Sanabria, R., Metze, F. & Elliott, Desmond, 2020, Findings of the Association for Computational Linguistics: EMNLP 2020. Association for Computational Linguistics, p. 2667-2677

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    30. Published

      Grounded Sequence to Sequence Transduction

      Specia, L., Barrault, L., Caglayan, O., Duarte, A., Elliott, Desmond, Gella, S., Holzenberger, N., Lala, C., Lee, S. J., Libovicky, J., Madhyastha, P., Metze, F., Mulligan, K., Ostapenko, A., Palaskar, S., Sanabria, R., Wang, J. & Arora, R., 2020, In: IEEE Journal on Selected Topics in Signal Processing. 14, 3, p. 577-591 9103248.

      Research output: Contribution to journalJournal articleResearchpeer-review

    31. Published

      Multimodal Machine Translation through Visuals and Speech

      Sulubacak, U., Caglayan, O., Grönroos, S., Rouhe, A., Elliott, Desmond, Specia, L. & Tiedemann, J., 2020, In: Machine Translation. 34, p. 97–147

      Research output: Contribution to journalJournal articleResearchpeer-review

    32. Published

      On Forgetting to Cite Older Papers: An Analysis of the ACL Anthology

      Bollmann, M. M. & Elliott, Desmond, 2020, Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, p. 7819-7827

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    33. Published

      Textual Supervision for Visually Grounded Spoken Language Understanding

      Higy, B., Elliott, Desmond & Chrupała, G., 2020, Findings of the Association for Computational Linguistics: EMNLP 2020. Association for Computational Linguistics, p. 2698–2709

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    34. Published

      The Sensitivity of Language Models and Humans to Winograd Schema Perturbations

      Abdou, M., Ravishankar, V., Barrett, M., Belinkov, Y., Elliott, Desmond & Søgaard, Anders, 2020, Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, p. 7590-7604

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    35. 2019
    36. Published

      Adversarial Removal of Demographic Attributes Revisited

      Barrett, M., Kementchedjhieva, Yova Radoslavova, Elazar, Y., Elliott, Desmond & Søgaard, Anders, 1 Nov 2019, Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, p. 6329-6334 6 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    37. Published

      Compositional Generalization in Image Captioning

      Nikolaus, M., Abdou, M., Lamm, M., Aralikatte, R. & Elliott, Desmond, 1 Nov 2019, Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL). Association for Computational Linguistics, p. 87-98 12 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    38. Published

      Understanding the Effect of Textual Adversaries in Multimodal Machine Translation

      Dutta Chowdhury, K. & Elliott, Desmond, 1 Nov 2019, Proceedings of the Beyond Vision and LANguage: inTEgrating Real-world kNowledge (LANTERN). Hong Kong, China: Association for Computational Linguistics, p. 35-40 6 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    39. Published

      Cross-lingual Visual Verb Sense Disambiguation

      Gella, S., Elliott, Desmond & Keller, F., 1 Jun 2019, Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, p. 1998-2004 7 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    40. 2018
    41. Published

      Adversarial Evaluation of Multimodal Machine Translation

      Elliott, Desmond, 2018, Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, p. 2974-2978 5 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    42. Published

      Assessing multilingual multimodal image description: Studies of native speaker preferences and translator choices

      Frank, S., Elliott, Desmond & Specia, L., 2018, In: Natural Language Engineering. 24, 3, p. 393-413 21 p.

      Research output: Contribution to journalJournal articleResearchpeer-review

    43. Published

      Findings of the third shared task on multimodal machine translation

      Barrault, L., Bougares, F., Specia, L., Lala, C., Elliott, Desmond & Frank, S., 2018, Third Conference on Machine Translation, Proceedings. Association for Computational Linguistics, Vol. 2. p. 308-327 20 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    44. Published

      How2: A large-scale dataset for multimodal language understanding

      Sanabria, R., Caglayan, O., Palaskar, S., Elliott, Desmond, Barrault, L., Specia, L. & Metze, F., 2018, Visually Grounded Interaction and Language (ViGIL), Montreal; Canada, December 2018. Neural Information Processing Society (NeurIPS).. (arXiv).

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    45. Published

      Lessons learned in multilingual grounded language learning

      Kádár, Á., Elliott, Desmond, Côté, M., Chrupala, G. & Alishahi, A., 2018, Proceedings of the 22nd Conference on Computational Natural Language Learning. Association for Computational Linguistics, p. 402-412 11 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    46. Published

      Measuring the Diversity of Automatic Image Descriptions

      van Miltenburg, E., Elliott, Desmond & Vossen, P., 2018, Proceedings of the 27th International Conference on Computational Linguistics. Association for Computational Linguistics, p. 1730-1741 12 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    47. Published

      Talking about other people: an endless range of possibilities

      van Miltenburg, E., Elliott, Desmond & Vossen, P., 2018, Proceedings of the 11th International Conference on Natural Language Generation. Association for Computational Linguistics, p. 415-420

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    48. 2017
    49. Cross-linguistic differences and similarities in image descriptions

      van Miltenburg, E., Elliott, Desmond & Vossen, P., 2017, Proceedings of the 10th International Natural Language Generation conference. p. 21-30 10 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    50. Exploring Concept Representations for Concept Drift Detection.

      Becher, O., Hollink, L. & Elliott, Desmond, 2017, SEMANTICS Workshops.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    51. Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description

      Elliott, Desmond, Frank, S., Barrault, L., Bougares, F. & Specia, L., 2017, Proceedings of the Second Conference on Machine Translation. p. 215-233 19 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    52. Imagination improves multimodal translation

      Elliott, Desmond & Kádár, A., 2017, Proceedings of the Eighth International Joint Conference on Natural Language Processing. p. 130-141 12 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    53. Room for improvement in automatic image description: an error analysis

      van Miltenburg, E. & Elliott, Desmond, 2017, In: arXiv. 1704, 04198

      Research output: Contribution to journalJournal articleResearch

    54. 2016
    55. 1 Million Captioned Dutch Newspaper Images

      Elliott, Desmond & Kleppe, M., 2016, Language Resources and Evaluation Conference.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    56. A Corpus of Images and Text in Online News

      Hollink, L., Bedjeti, A., van Harmelen, M. & Elliott, Desmond, 2016, Language Resources and Evaluation Conference.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    57. A shared task on multimodal machine translation and crosslingual image description

      Specia, L., Frank, S., Sima'an, K. & Elliott, Desmond, 2016, Proceedings of the First Conference on Machine Translation: Volume 2, Shared Task Papers. Vol. 2. p. 543-553 11 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    58. Automatic description generation from images: A survey of models, datasets, and evaluation measures

      Bernardi, R., Cakici, R., Elliott, Desmond, Erdem, A., Erdem, E., Ikizler-Cinbis, N., Keller, F., Muscat, A. & Plank, B., 2016, In: The Journal of Artificial Intelligence Research. 55, p. 409-442 34 p.

      Research output: Contribution to journalJournal articleResearchpeer-review

    59. DCU-UvA Multimodal MT System Report

      Calixto, I., Elliott, Desmond & Frank, S., 2016, Proceedings of the First Conference on Machine Translation, Berlin, Germany. Association for Computational Linguistics, p. 634–638

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    60. Multi30K: Multilingual English-German image descriptions

      Elliott, Desmond, Frank, S., Sima'an, K. & Specia, L., 2016, Proceedings of the 5th Workshop on Vision and Language. Association for Computational Linguistics, p. 70–74

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    61. Pragmatic factors in image description: the case of negations

      van Miltenburg, E., Morante, R. & Elliott, Desmond, 2016, Proceedings of the 5th Workshop on Vision and Language. p. 54-59 6 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    62. The ION corpus

      Hollink, L., Bedjeti, A., vanHarmelen, M. & Elliott, Desmond, 2016, In: Proceedings of Language Resources and Evaluation (LREC).

      Research output: Contribution to journalConference articleResearchpeer-review

    63. 2015
    64. Describing Images using Inferred Visual Dependency Representations.

      Elliott, Desmond & de Vries, A., 2015, Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing. Association for Computational Linguistics, p. 42-52 11 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    65. Multi-language Image Description with Neural Sequence Models

      Elliott, Desmond, Frank, S. & Hasler, E., 2015, In: arXiv. 1510, 04709

      Research output: Contribution to journalJournal articleResearch

    66. 2014
    67. Comparing Automatic Evaluation Measures for Image Description

      Elliott, Desmond & Keller, F., 2014, Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). Association for Computational Linguistics (ACL), p. 452-457 6 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    68. Query-by-Example Image Retrieval using Visual Dependency Representations

      Elliott, Desmond, Lavrenko, V. & Keller, F., 2014, Proceedings of the 25th International Conference on Computational Linguistics. Association for Computational Linguistics (ACL), p. 109-120 12 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    69. 2013
    70. Image Description using Visual Dependency Representations

      Elliott, Desmond & Keller, F., 2013, Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics (ACL), p. 1292-1302

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    71. 2012
    72. Practical considerations when filtering documents.

      Elliott, Desmond & Azzopardi, L., 2012, IIiX. p. 270-273 4 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    73. 2009
    74. Published

      A proactive personalised retrieval system

      Elliott, Desmond & Jose, J. M., 2009, Proceedings of the 18th ACM conference on Information and knowledge management. p. 1935-1938 4 p.

      Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    ID: 202364876