Sourajit Saha
PhD Candidate, Computer Science at University of Maryland, Baltimore County
Visiting Graduate Scholar (Summer 2026), Johns Hopkins University
Email: ssaha2@umbc.edu Location: ITE 338, UMBC, Baltimore, MD 21250
Interactive Visual Search | Multimodal Retrieval | Multimodal Reasoning
Video Understanding | Vision and Language | RL Post-Training for Multimodal Systems
Resume CV
Highlights
Bio
I am a Computer Science PhD candidate (expected 2028), working under the guidance of
Tejas Gokhale
in the UMBC Cognitive Vision Group
at University of Maryland, Baltimore County (UMBC).
I am currently a Visiting Graduate Scholar at Johns Hopkins University (Summer 2026), working on multi-set video retrieval-augmented generation,
and a Research Assistant on the DARPA SciFy program.
I work on interactive multimodal retrieval/search, multimodal reasoning, and video understanding.
My research spans the following areas:
♦ Interactive Multimodal Retrieval, Search: Enhancing few-shot and zero-shot video search and retrieval, Developing Scene Graph-based Chain-of-Thought retrieval frameworks, Designing dialogue-driven interactive retrieval systems, Robust Ranking Evaluation.
♦ Video Understanding: Information Theory guided Video Question Answering (VQA), Progressive Video Captioning, Semantic Frame Selection, Video Editing.
♦ Visual Reasoning: Understanding spatial relationships and transformations, Studying counterfactual visual reasoning, Exploring techniques for image and model editing.
♦ Post-Training and RL for Multimodal Systems: Reward-driven post-training for multimodal retrieval, ranking, and reasoning; RL for retrieval policies, adaptive search strategies, and test-time decision-making from user feedback and task-specific retrieval signals.
Experience
Multi-set video retrieval-augmented generation (RAG); extending zero-shot multimodal retrieval to long-form, multi-source video corpora.
First-authored ACL 2026 (Oral) paper on zero-shot multimodal retrieval with multi-scale contextual representations; filed as US Patent App. 64/045,450.
Large-scale multilingual, event-based video retrieval.
Unsupervised domain adaptation for TB screening (IEEE Access 2022); meta-learning for COVID-19 chest X-ray classification (SPIE MI 2022).
Deep learning for retinal-disease diagnosis from OCT (ICMLA 2019); built a neural-net training-scheduling platform for the CCSE supercomputer.
News scroll for older news ↓
- Jul 2026: Received the Great Reviewer Award (top 1.4%) at ACL 2026
- Jul 2026: Presented MULTI-SCORE at the ACL 2026 Oral Session: Information Extraction and Retrieval, and gave an invited talk at the MAGMaR 2026 workshop, San Diego
- Jul 2026: Served as Session Chair for three sessions at ACL 2026 (Interaction & Speech; Information Extraction & Retrieval; Multimodality & Language Grounding)
- Jul 2026: Hosted an interactive session on Video Retrieval (ACL 2026) on July 5 (16:00-17:30) at La Jolla A&B (Grand Hyatt Manchester San Diego)
- Jun 2026: Serving as Program Committee for AAAI 2027, EMNLP 2026
- 2026: US Patent App. 64/045,450 filed on Zero-Shot Multimodal Retrieval with Multi-Scale Contextual Representations
- May 2026: Joining Dept. of CS @ Johns Hopkins University as a Visiting Graduate Scholar for summer'26
- May 2026: Recognized as an Outstanding Reviewer (top 5%) at CVPR 2026
- Apr 2026: One paper accepted at the ACL 2026 MAGMaR Workshop
- Apr 2026: MULTI-SCORE (Zero-shot multimodal retrieval) accepted at ACL 2026 (Main Track) - also selected for Oral presentation (top 15% papers)
- Apr 2026: Recognized as the ACL (ARR) 2026 reviewer with the highest number of “Outstanding Review” distinctions
- Mar 2026: Passed PhD Comprehensive Portfolio
- Mar 2026: Serving as Program Committee for NeurIPS 2026, ECCV 2026, BMVC 2026, CoNLL 2026, ICML workshop 2026 ( Hypothesis Testing ), ICML workshop 2026 ( AI4Science ), ACL workshop 2026 ( MAGMaR )
- Mar 2026: Received the NSF NAIR Sustainable Research Pathways (SRP) Fellowship for Summer 2026
- Mar 2026: Finalist, GEARS UMBC 3 Minute Thesis Competition 2026
- Feb 2026: Guest lecture on CMSC 675: Neural Networks at UMBC
- Jan 2026: Serving as Program Committee for ACL 2026, CVPRW 2026 ( Image Matching, TRUE-V ), ACM BCB 2026
- Nov 2025: Paper accepted at NeurIPS 2025 GenProCC workshop
- Oct 2025: Serving as Program Committee for CVPR 2026
- Aug 2025: Side Effects of Erasing Concepts from Diffusion Models accepted at EMNLP 2025 (Findings Track)
- Aug 2025: Serving as Program Committee for NeurIPS workshop 2025 ( Deep Learning for Code, AI4Science )
- Jul 2025: Serving as Program Committee for AAAI 2026
- Jul 2025: Received Lambda Research Grant Award at CVPR 2025
- Apr 2025: Serving as Program Committee for NeurIPS 2025 and ICCV 2025
- Feb 2025: Received WACV 2025 Broadening Participation Scholarship
- Jan 2025: Translation Invariant Polyphase Sampling accepted at WACV 2025 (Oral)
- Jan 2025: Began serving as Research Assistant on the DARPA SciFY (Scientific Feasibility) project at UMBC.
- Dec 2024: Received UMBC GSA Professional Development Grant, 2025
- Oct 2024: One paper accepted at WACV 2025 in Tucson, Arizona (Preprint)
- Mar 2024: Got accepted into SCALE 2024 at JHU to work on event-based visual content retrieval on summer'24
- Feb 2024: Guest lecture on CMSC 691: Computer Vision at UMBC
- Feb 2024: Serving as Program Committee for IJCAI 2024, ACM Transactions on Computing for Healthcare
- Nov 2023: Guest lecture on CMSC 678: (Graduate) Machine Learning at UMBC
- Oct 2023: Serving as Program Committee for AAAI 2024 (student abstract)
- Sep 2023: Joined Cognitive Vision Group at UMBC, led by Tejas Gokhale
- Aug 2023: One paper accepted at ICCV 2023 in OODCV, Paris, France
- May 2023: I got my Masters in Computer Science at UMBC in Spring 2023
- Oct 2022: One paper accepted at AAAI 2023 in Washington D.C
- Mar 2022: One paper accepted at IEEE ACCESS
- Oct 2021: One paper accepted at SPIE Medical Imaging Conference 2022 in San Diego
- Summer 2021: I was a Machine Learning intern at VIPAR Lab (Vision Image Processing Algorithms Research Lab), UMBC
- Jan 2021: I joined UMBC for grad school
- Sep 2020: One book chapter published in Part of the Advances in Intelligent Systems and Computing book series, Springer
- Dec 2019: One paper accepted at ICMLA 2019 in Florida
- Feb 2019: One paper accepted at ICCIT 2018 in Dhaka
- Dec 2018: One paper accepted at ELSEVIER - Procedia Computer Science
- Jul 2018: I joined IUB as a Research Assistant.
Publications
Most recent publications on Google Scholar — 197 citations, h-index 7.
Zero-Shot Multimodal Retrieval with Multi-Scale Contextual Representations. Sourajit Saha, Tejas Gokhale
ACL 2026 (Oral + Main, top 15%) · US Patent App. 64/045,450 (pending) paper project code
Side Effects of Erasing Concepts from Diffusion Models. Shaswati Saha, Sourajit Saha, Manas Gaur, Tejas Gokhale
EMNLP 2025 (Findings) paper code
Improving Shift Invariance in Convolutional Neural Networks with Translation Invariant Polyphase Sampling. Sourajit Saha, Tejas Gokhale
RFC-Net: Learning High Resolution Global Features for Medical Image Segmentation on a Computational Budget (Student Abstract). Sourajit Saha, Shaswati Saha, Md Osman Gani, Tim Oates, David Chapman
Mitigating Domain Shift in AI-Based TB Screening With Unsupervised Domain Adaptation. Nishanjan Ravin, Sourajit Saha, Alan Schweitzer, Ameena Elahi, Farouk Dako, Daniel Mollura, David Chapman
Pairwise Meta Learning Pipeline: Classifying COVID-19 abnormalities on chest radio-graphs. Sourajit Saha, Yaacov Yesha, Yelena Yesha, Aryya Gangopadhyay, David Chapman, Michael Morris, Babak Saboury, Phuong Nguyen
SPIE Medical Imaging Conference 2022 Paper
A comprehensive set of novel residual blocks for deep learning architectures for diagnosis of retinal diseases from optical coherence tomography images. Sharif Amit Kamran, Sourajit Saha, Ali Shihab Sabbir, Alireza Tavakkoli
Awards, Grants & Honors
- Jul 2026: Great Reviewer Award (top 1.4%), ACL 2026
- May 2026: Outstanding Reviewer (top 5%), CVPR 2026
- Mar 2026: NSF NAIR Sustainable Research Pathways (SRP) Fellowship, Summer 2026
- Mar 2026: Finalist, GEARS UMBC 3 Minute Thesis Competition 2026
- Jul 2025: Winner, Lambda Research Grant Award 2025 (competitive GPU compute grant)
- Jun 2025: Travel Grant, CVPR 2025
- Feb 2025: Broadening Participation Scholarship, WACV 2025
- Dec 2024: UMBC GSA Professional Development Grant, 2025
- Nov 2024: Travel Grant, EMNLP 2024
- Feb 2023: UMiami FIDSC Travel Grant, AAAI 2023
- Feb 2022: UMBC CARTA Travel Award, SPIE Medical Imaging Conference 2022
- 2015–16: Champion, Intra University Programming Contest, BRAC University; ranked 22, SUST Inter-University Programming Contest
- 2013–17: Dean's Award & Vice Chancellor's Award for Academic Excellence, BRAC University
Academic Service
- ACL 2026, San Diego: Interaction and Speech (July 5); Information Extraction and Retrieval (July 6); Multimodality and Language Grounding to Vision, Robotics and Beyond 2 (July 7)
Session Chair
- Conferences: NeurIPS 2026, NeurIPS 2025, CVPR 2026, ICCV 2025, ECCV 2026, ACL 2026, EMNLP 2026, AAAI 2027, AAAI 2026, AAAI 2024 (student abstract), BMVC 2026, CoNLL 2026, ACM BCB 2026, IJCAI 2024
- Journals: Engineering Applications of Artificial Intelligence (Elsevier), APSIPA Transactions on Signal and Information Processing (Cambridge University Press), ACM Transactions on Computing for Healthcare, Computers and Electronics in Agriculture (Elsevier)
- Workshops: Document Intelligence and Understanding (EMNLP 2026), Deep Learning for Code (ICML 2026, NeurIPS 2025), Hypothesis Testing (ICML 2026), AI Scientists (ICML 2026), MAGMaR (ACL 2026), TRUE-V (CVPR 2026), Image Matching (CVPR 2026), AI for Scientific Discovery (NeurIPS 2025)
Program Committee / Reviewer
- CVF, AAAI, ACL
Membership
- UMBC (Guest Lecture): CMSC 675: Neural Networks Spring 2026
- UMBC (Guest Lecture): CMSC 691: Computer Vision Spring 2024
- UMBC (Guest Lecture): CMSC 678: Machine Learning Fall 2023
- UMBC (TA): CMSC 678: Machine Learning Fall 2024 Fall 2023
- UMBC (TA): CMSC 691: Computer Vision Spring 2024
- UMBC (TA): CMSC 471: Introduction to Artificial Intelligence Spring 2023
- UMBC (TA): CMSC 313: Assembly Language and Computer Organization Fall 2021
- UMBC (TA): CMSC 341: Data Structures Spring 2021
Teaching
Collaborators
- Tejas Gokhale
- Shaswati Saha
- Shubhashis Roy Dipta
Current Collaborators
- Manas Gaur
- Tim Oates
- David Chapman
- Sharif Amit Kamran
- Ali Shihab Sabbir
Previous Collaborators
Acknowledgement
Website theme inspirations: Aniruddha Saha, Martin Saveski, Aditi Partap.