Internship - Multimodal Embodied AI
Ora
Summary
MERL is looking for a self-motivated intern to work on problems at the intersection of multimodal large language models and embodied AI in dynamic indoor environments. The ideal candidate would be a PhD student with a strong background in machine learning and computer vision, as demonstrated by top-tier publications.
Job description
The intern is expected to collaborate with researchers in computer vision at MERL to develop algorithms and prepare manuscripts for scientific publications.
Required Specific Experience
- Experience in designing 3D interactive scenes
- Experience with vision based embodied AI using simulators (implementation on real robotic hardware would be a plus)
- Experience training large language models on multimodal data
- Experience with training reinforcement learning algorithms
- Strong foundations in machine learning and programming
- Strong track record of publications in top-tier computer vision and machine learning venues (such as CVPR, NeurIPS, etc.)
Hands on experience in using animated 3D human shape models (e.g., SMPL and variants) is desired.
Requirements
- PhD student in machine learning, computer vision, or related field
- Strong background in machine learning and computer vision
- Experience designing 3D interactive scenes
- Experience with vision-based embodied AI using simulators
- Experience training large language models on multimodal data
- Experience training reinforcement learning algorithms
- Strong programming skills
- Strong track record of publications in top-tier venues such as CVPR, NeurIPS
- Hands-on experience with animated 3D human shape models (e.g., SMPL) is desired
- Implementation on real robotic hardware is a plus
Company overview
Ora is the world's leading full-service ophthalmic drug and device development firm, operating as a specialized contract research organization (CRO) focused exclusively on ophthalmology. Founded in 1974 and headquartered in Andover, Massachusetts, the company has over 45 years of experience in advancing eye care innovations globally. Ora provides comprehensive research and development services spanning preclinical studies, clinical trials, regulatory strategy, and product development for both pharmaceutical and medical device companies. With operations across the United States, United Kingdom, Australia, and Asia, the company has helped clients achieve more than 85 product approvals to date. Ora's expertise covers a wide range of ophthalmic conditions including allergy, dry eye, retina diseases, glaucoma, and anti-infective therapies. The company employs over 500 ophthalmology specialists who utilize proprietary clinical models, integrated data solutions, and global regulatory strategies to accelerate product development from concept to market. Ora serves a diverse client base ranging from startups to global pharmaceutical and device companies, positioning itself as the trusted partner for ophthalmic innovation worldwide.