ZiF Research Group

Multimodal Rhetoric in Online Media Communications

May 2020 - September 2020

Convenors: Kay O'Halloran (Liverpool, GBR), John Bateman (Bremen, GER), Mehul Bhatt (Örebro, SWE)

Publications

  • John Bateman (2016). Methodological and Theoretical Issues for the Empirical Investigation of Multimodality. In: N.-M. Klug & H. Stöckl (Eds.), Sprache im Multimodalen Kontext / Language and Multimodality. Berlin: de Gruyter Mouton.

  • Bhatt, Mehul and Suchan, Jakob (2020). Cognitive Vision and Perception: Deep Semantics Integrating AI and Vision for Reasoning about Space, Motion, and Interaction., In ECAI 2020 - 24th European Conference on Artificial Intelligence, 29 August-8 September 2020, Santiago de Compostela, Spain, August 29 - September 8, 2020 - Including 10th Conference on Prestigious Applications of Artificial Intelligence (PAIS 2020), IOS Press, volume 325, 2020. DOI / http://ebooks.iospress.nl/publication/55229

  • Jakob Suchan and Mehul Bhatt (2018). Semantic Question-Answering with Video and Eye-Tracking Data: AI Foundations for Human Visual Perception Driven Cognitive Film Studies. In: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI 2016, New York, NY, USA, 9-15 July 2016 (Subbarao Kambhampati, ed.), ISBN: 9781577357704, IJCAI/AAAI Press, 2016. PDF: https://www.ijcai.org/Abstract/16/374

  • R. L. Breiger, R. Wagner-Pacifici, and J. W. Mohr (2018). Capturing distinctions while mining text data: Toward low-tech formalization for text analysis. Poetics, 68:104 – 119, 2018. ISSN 0304-422X. doi: https://doi.org/10.1016/j.poetic.2018.02.005

  • K. Chai, V. Potdar, and T. Dillon (2009). Content quality assessment related frameworks for social media. In: O. Gervasi, D. Taniar, B. Murgante, A. Lagana`, Y. Mun, and M. L. Gavrilova (eds), Computational Science and Its Applications – ICCSA 2009, pages 791?805, Berlin, Heidelberg: Springer. ISBN 978-3-642-02457-3.

  • E. Müller-Budack, J. Theiner, S. Diering, M. Idahl, R. Ewerth (2020). Multimodal Analytics for Real-world News using Measures of Cross-modal Entity Consistency. In: Proceedings of ACM International Conference on Multimedia Retrieval (ICMR), Dublin, Ireland, ACM, 2020, 16-25.

  • C. Otto, M. Springstein, A. Anand, & R. Ewerth (2020): Characterization and Classification of Semantic Image-Text Relations. In: International Journal on Multimedia Information Retrieval (IJMIR), Special Issue (Top papers of ACM ICMR 2019), Vol. 9, Issue 1, 2020, 31-45.

  • E. Müller-Budack, K. Pustu-Iren, S. Diering, & R. Ewerth (2018). Finding Person Relations in Image Data of News Collections in the Internet Archive. In Proceedings of International Conference on Theory and Practice of Digital Libraries (TPDL), Porto, Portugal, 2018, 229-240.

  • E. Müller-Budack, K. Pustu-Iren, & R. Ewerth (2018). Geolocation Estimation of Photos using a Hierarchical Model and Scene Classification. In: Proceedings of European Conference on Computer Vision (ECCV), München, 2018, 575-592.

  • C. A. Henning & R. Ewerth (2017): Estimating the Information Gap between Textual and Visual Representations. In: Proceedings of ACM International Conference on Multimedia Retrieval (ICMR), Bucharest, Romania, ACM, 2017, 14-22.

  • Venema R., Lobinger K. (2017) And Somehow It Ends up on the Internet." Agency, Trust and Risks in Photo-Sharing Among Friends and Romantic Partners, First Monday, 22 (7)

  • Mohr, J.W., Wagner-Pacifici, R., Breiger, R.L., and Bogdanov, P. (2013). "Graphing the Grammar of Motives in U.S. National Security Strategies: Cultural Interpretation, Automated Text Analysis and the Drama of Global Politics." Poetics: Journal of Empirical Research on Literature, the Media, and the Arts. Vol. 41(6): 670-700.

  • O'Halloran, K. L. (2015). Multimodal Digital Humanities. In: P. Trifonas (Ed.), International Handbook of Semiotics (pp. 383-409). Dordrecht: Springer.

  • R. Wagner-Pacifici, J. W. Mohr, and R. L. Breiger (2015). Ontologies, methodologies, and new uses of big data in the social and cultural sciences. Big Data & Society, 2(2):2053951715613810, 2015. doi: 10.1177/205391715613810. URL https://doi.org/10.1177/2053951715613810.