Multimodal Information Processing in NLP through Deep Learning and Language Modeling

Dr. Sriparna Saha explores how extracting insights from multiple modalities can enhance hate speech detection, complaint mining, and medical question summarization, and more.

Combining data from videos, images, and texts can create more comprehensive summaries. The speaker discusses their recent works in multimodal summarization, focusing on areas like comment-aware multimodal summarization, multilingual approaches, and medical question summarization. The talk will also cover the datasets and methods developed to address these challenges in detail.