Shubhashis Roy Dipta

PhD ResearcherNLPCVMultimodal Gen AIData Science


Baltimore, Maryland-21227

I am a Computer Science PhD Researcher under Dr. Frank Ferarro at the University of Maryland, Baltimore County (UMBC). My research combines Natural Language Processing (NLP) and Computer Vision (CV). I have a track record of publishing in top-tier conferences and journals.

Currently, I’m focused on multimodal counterfactual event reasoning, understanding, and generation. My previous work, a hierarchical variational autoencoder for event representation learning, has applications in text summarization, question answering, and counterfactual reasoning (Published in *SEM 2023, ACL).

Actively looking for Research Collaboration in Natural Language Processing or Multimodal (Language + Vision) Work. I am greatly enthusiastic about participating in shared tasks. Please contact me if you want to collaborate.

I completed my M.Sc. in CS with Phi Kappa Phi (CGPA 4.0/4.0) in Spring 2023 at UMBC. Before my M.Sc., I gained over 3 years of industry experience as a Full-Stack Software Engineer. During that time, I also worked with Dr. Iman Dehzangi (Rutgers University) and published 4 journal papers.

I have a strong background in ML programming, including PyTorch, 🤗 HuggingFace, NLTK, Spacy, Matplotlib, Seaborn, Tableau and more. I’ve excelled in machine learning competitions (Kaggle top-70 🥉) and coding competitions (ACM ICPC 8th out of 300+ teams) and more. I was the founder of UniShopr, a cross-border e-commerce for my home country (Bangladesh).

Research Interest

        ✓ Multimodal Generation (Language 📖 + Vision 👀)
        ✓ Natural Language Understanding 📖
        ✓ Computer Vision 👀

WRITE ✍️  on Machine Learning, NLP, Vision, Multimodal AI

Subscribe to get notified when I post a new content.

Recent News
(See All)

Jan 31, 2024 Reviewed another paper in Scientific Reports, a reputed journal from Nature.
Jan 4, 2024 One of my small contribution has been merged into the Pytorch Lightning codebase. See here.
Jan 1, 2024 Reviewed 1 paper in W-NUT workshop of EACL 2024.
Dec 31, 2023 Reviewed 1 paper in Plant Methods, a reputed journal from Springer Nature.
Dec 18, 2023 Our paper named “SeeBel: Seeing is Believing” is now available in arXiv. This is a joint work with Sourajit Saha.

Featured Publications
(Show More)

Check out Google Scholar for a full list of my publications.

  1. Semantically-informed Hierarchical Event Modeling
    Shubhashis Roy DiptaMehdi Rezaee, and Francis Ferraro
    In Proceedings of the 12th Joint Conference on Lexical and Computational Semantics (*SEM 2023), Jul 2023
  2. SEMal: Accurate protein malonylation site predictor using structural and evolutionary information
    Shubhashis Roy DiptaGhazaleh Taherzadeh, Md Wakil Ahmad, Md Easin Arafat, Swakkhar Shatabda, and Abdollah Dehzangi
    Computers in biology and medicine, Jul 2020