selected publications

• academic article

  • Understanding image-text relations and news values for multimodal news analysis.  Frontiers in Artificial Intelligence.  6. 2023
  • The Search as Learning Spaceship: Toward a Comprehensive Model of Psychological and Technological Facets of Search as Learning.  Frontiers in Psychology.  13. 2022
  • Characterization and classification of semantic image-text relations.  International Journal of Multimedia Information Retrieval.  31-45. 2020
  • Deep learning for content-based video retrieval in film and television production.  Multimedia Tools and Applications.  76:22169-22194. 2017

• chapter

  • Comparing Interface Layouts for the Presentation of Multimodal Search Results.  CHIIR '23: Proceedings of the 2023 Conference on Human Information Interaction and Retrieval. ACM. 321-327. 2023
  • MM-Claims: A Dataset for Multimodal Claim Detection in Social Media.  Findings of the Association for Computational Linguistics: NAACL 2022. 962-979. 2022
  • Predicting Knowledge Gain for MOOC Video Consumption.  Artificial Intelligence in Education. Posters and Late Breaking Results, Workshops and Tutorials, Industry and Innovation Tracks, Practitioners’ and Doctoral Consortium. Springer, Cham. 458-462. 2022
  • SaL-Lightning Dataset: Search and Eye Gaze Behavior, Resource Interactions and Knowledge Gain during Web Search.  CHIIR '22: ACM SIGIR Conference on Human Information Interaction and Retrieval. ACM. 347-352. 2022
  • Computational Approaches for the Interpretation of Image-Text Relations.  Empirical Multimodality Research. 109-138. 2021
  • Predicting Knowledge Gain During Web Search Based on Multimedia Resource Consumption.  Artificial Intelligence in Education 22nd International Conference, AIED 2021, Utrecht, The Netherlands, June 14–18, 2021, Proceedings, Part I. 318-330. 2021
  • Investigating Correlations of Automatically Extracted Multimodal Features and Lecture Video Quality.  SALMM '19: Proceedings of the 1st International Workshop on Search as Learning with Multimedia Information. New York, NY, United States: Association for Computing Machinery. 11-19. 2019
  • Visual Summarization of Scholarly Videos Using Word Embeddings and Keyphrase Extraction.  Digital Libraries for Open Knowledge 2019. Springer, Cham. 327-335. 2019
  • Understanding, Categorizing and Predicting Semantic Image-Text Relations.  ICMR '19: Proceedings of the 2019 on International Conference on Multimedia Retrieval. 168-176. 2019
  • “Is This an Example Image?” – Predicting the Relative Abstractness Level of Image and Text.  Advances in Information Retrieval 41st European Conference on IR Research, ECIR 2019, Cologne, Germany, April 14–18, 2019, Proceedings, Part I. Springer, Cham. 711-725. 2019
  • Recommending Scientific Videos Based on Metadata Enrichment Using Linked Open Data.  Digital Libraries for Open Knowledge. 286-292. 2018

• conference paper

  • Semi-supervised Identification of Rarely Appearing Persons in Video by Correcting Weak Labels.  ICMR '16 Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval. 381-384. 2016

• preprint

  • MM-Claims: A Dataset for Multimodal Claim Detection in Social Media 2022
  • Predicting Knowledge Gain for MOOC Video Consumption 2022
  • SaL-Lightning Dataset: Search and Eye Gaze Behavior, Resource Interactions and Knowledge Gain during Web Search 2022
  • Predicting Knowledge Gain during Web Search based on Multimedia Resource Consumption 2021
  • "Is this an example image?" -- Predicting the Relative Abstractness Level of Image and Text 2019