Internship - Multimodal Instruction and Video Synthesis
Ora
Summary
We are seeking a highly motivated intern to conduct original research in generating multimodal instructions for tasks such as assembly, machine operation, and maintenance.
Job description
The successful candidate will collaborate with MERL researchers in the design, implementation, and experimentation of novel methods for producing high-quality instructional manuals from operational video sequences, as well as synthesizing instructional videos from multimodal manuals.
Required Specific Experience
- Experience with 3D modeling tools for CAD data, physics simulators, and foundation models
- Experience in video analysis and synthesis, including using diffusion models
- At least one paper in a top-tier computer vision or machine learning venue such as CVPR, ECCV, ICCV, ICML, ICLR, NeurIPS, AAAI, or TPAMI
- Ph.D. student in computer vision or a related field
Requirements
- PhD student (or recent graduate) in computer vision or a related field
- Strong publication record with at least one paper in a top-tier computer vision or machine learning venue (CVPR, ECCV, ICCV, ICML, ICLR, NeurIPS, AAAI, or TPAMI)
- Strong programming skills
- Experience developing and implementing new models
- Broad knowledge of machine learning and deep learning methods
- Experience training foundation models
- Experience with 3D modeling tools for CAD data and physics simulators
- Experience in video analysis and synthesis, including using diffusion models
- Full authorization to work in the U.S.
Benefits
- Relocation Stipend
- Covered Travel To And From MERL
- Monthly Charlie Card
- Health Insurance
- Immigration Support
- Professional Development Opportunities
Company overview
Ora is the world's leading full-service ophthalmic drug and device development firm, operating as a specialized contract research organization (CRO) focused exclusively on ophthalmology. Founded in 1974 and headquartered in Andover, Massachusetts, the company has over 45 years of experience in advancing eye care innovations globally. Ora provides comprehensive research and development services spanning preclinical studies, clinical trials, regulatory strategy, and product development for both pharmaceutical and medical device companies. With operations across the United States, United Kingdom, Australia, and Asia, the company has helped clients achieve more than 85 product approvals to date. Ora's expertise covers a wide range of ophthalmic conditions including allergy, dry eye, retina diseases, glaucoma, and anti-infective therapies. The company employs over 500 ophthalmology specialists who utilize proprietary clinical models, integrated data solutions, and global regulatory strategies to accelerate product development from concept to market. Ora serves a diverse client base ranging from startups to global pharmaceutical and device companies, positioning itself as the trusted partner for ophthalmic innovation worldwide.