Vihaan Misra

Hi, I'm Vihaan Misra!

PhD Student, Robotics Institute, Carnegie Mellon University

I am a PhD student at the Robotics Institute at CMU, working with Prof. Jean Oh in the Bot-Intelligence Group. Prior to joining CMU, I received my bachelor's in Electrical Engineering with a minor in AI from Netaji Subhas University of Technology.

My research focuses on multimodal generative models that bridge semantic understanding with physical constraints. I'm interested in how robots can create and manipulate their environment using different modalities like language, audio, and vision. This spans work on cross-modal translation, text-driven spatial arrangement with geometric constraints, and understanding how generative models encode abstract structural concepts like numerosity and spatial relationships. The common thread is building systems that are not just visually compelling but also physically grounded and controllable in meaningful ways.

Email Email Scholar Scholar GitHub GitHub LinkedIn LinkedIn Twitter Twitter
Research Interests:
Robotics & Embodied AI Multimodal Learning Creative AI & Generative Models 3D Vision & Graphics Foundation Models

Selected Publications

ShapeShift

ShapeShift: Text-to-Mosaic Synthesis via Semantic Phase-Field Guidances

Vihaan Misra, Peter Schaldenbrand, Jean Oh

Under Review, SIGGRAPH 2026

Human-Robot Joint Painting

If I Move, Do You Move? Investigating the Role of Interpersonal Synchrony in Human-Robot Joint Painting

Abena Boadi-Agyemang, Peter Schaldenbrand, Vihaan Misra, Elizabeth J. Carter, Jean Oh, Aaron Steinfeld

IEEE International Conference on Robot and Human Interactive Communication (RO-MAN 2025) - Forthcoming

Robot Synesthesia

Robot Synesthesia: A Sound and Emotion Guided AI Painter

Vihaan Misra, Peter Schaldenbrand, Jean Oh

🏆 Best Arts Paper Award

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2024)

Paper Website
AdaGen

AdaGen: Adaptive Generalized Knowledge Transfer Framework for Sensor-based Surface Classification

Vihaan Misra, Shivshankar S Menon, Snehanshu Saha, Archana Mathur, Haoxiang Yu, Vaskar Raychoudhary

SN Computer Science (2024)

Paper
Robot Painting

Robot Painting: Art for Robotics

Peter Schaldenbrand*, Gerry Chen, Vihaan Misra, Yunhao Lorie Chen, Ken Goldberg, Jean Oh

ICRA @ 40 (2024)

Video
Sketch-to-Image

Sketch-to-Image Synthesis using Semantic Priors

Vihaan Misra, Peter Schaldenbrand, Jean Oh

RISS Working Papers' Journal | Robotics Institute Summer Scholars Journal (2022)

Paper
WASH Awareness

A Machine Learning Application for Raising WASH Awareness in the Times of COVID-19 Pandemic

Rohan Pandey, Vihaan Misra et al.

Scientific Reports, Nature Publications (2022)

Paper
Robotics in Industry 4.0

Robotics in Industry 4.0

Ashwin Misra, Anuj Agrawal, Vihaan Misra

Handbook of Smart Materials, Technologies, and Devices, Springer (2021)

Chapter
Uncertainty Modeling

Improving non-deterministic uncertainty modelling in Industry 4.0 scheduling

Ashwin Misra, Ankit Mittal, Vihaan Misra

Preprint (2021)

Paper

Experience

Carnegie Mellon University
PhD Student in Robotics
August 2023 - Present
Working in the Bot-Intelligence Group under Prof. Jean Oh. Research focuses on multimodal generative AI and creative AI applications in robotics, developing systems that create visual content through emotions, sounds, and language.
Mercedes-Benz R&D
Research Engineer
January - August 2023
Developed advanced driver assistance systems and autonomous driving technologies. Built machine learning models for sensor fusion and computer vision applications in automotive safety systems.
University of Alberta
Research Assistant
2021 - 2022
Conducted rehabilitation robotics research, developing adaptive wheelchair routing algorithms based on surface classification using machine learning for improved mobility assistance.
IIIT Hyderabad
Research Intern
2021
Worked with the Robotics Research Center on computer vision and deep learning for visual perception systems in autonomous navigation through complex environments.
University of Miami
Research Collaborator
2021 - 2022
Collaborated on interdisciplinary AI and healthcare research, developing machine learning models for medical image analysis and diagnostic support systems.
Orient Electric
Research Consultant
2022
Provided technical consultation on IoT solutions and smart home technologies. Developed prototype systems for energy efficiency monitoring and automation in consumer appliances.
IIIT Delhi
Research Intern
2019 - 2020
Worked at the Technology Innovation Hub on AI applications, contributing to machine learning projects in computer vision and natural language processing.
NSUT Delhi
B.Tech EE (Minor: AI)
2019 - 2023
Completed Bachelor's in Electrical Engineering with minor in Artificial Intelligence. Conducted research in robotics and AI, participated in technical competitions and innovation projects.