Reality Labs Research (RLR) brings together a world-class, cross-disciplinary R&D team to develop the next generation of AR and VR technologies. Come work alongside a world leading team of scientists and engineers to create the technology that makes AR and VR pervasive and universal. Our research focuses on developing comprehensive solutions to complex eye tracking problems, including both algorithms and hardware for AR and VR systems. We are currently seeking researchers with experience in machine learning for computer vision applications, to help build eye tracking models that leverage multiple sensing modalities and that are personalized for best performance on every user of the system.

Research Scientist, Machine Learning and Eye Tracking Responsibilities

• Research and develop novel machine learning and computer vision based methods for eye tracking in AR/VR form factors.
• Work with large-scale eye tracking data sets to build models that work across the diversity of the entire human population.
• Combine data driven and 3D model based methods to deliver robust performance independent of device fit.
• Incorporate data from multiple sensor modalities to build robust, efficient models.
• Quantify the robustness and accuracy of these models using statistical analysis of the data.
• Optimize models to deliver robust, always-on eye tracking in power-constrained platforms.
• Categorize failures and mine the data for difficult edge cases, and use this to improve the worst-case performance of eye tracking algorithms.
• Help to develop simulation and ground truth data collection tools that reduce the amount of data needed to deliver robust models.
• Collaborate with other research scientists, hardware and software engineers to develop innovative machine learning techniques for eye tracking use-cases.

Minimum Qualifications

• PhD degree in computer science, machine learning, or equivalent experience in a related field.
• Experience building and shipping CV, ML, or optimization systems that are proven to be robust in real world use cases.
• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• 5+ years experience in machine learning for computer vision applications.
• 3+ years of programming experience in Python and experience with ML frameworks such as PyTorch.

Preferred Qualifications

• Experience with large-scale machine learning techniques like semi-supervised learning, weakly-supervised learning and online adaptation of ML models.
• Experience building personalized models for Eye Tracking or other human tracking tasks such as body, face or hand tracking.
• Experience delivering robust data-driven models incorporating multiple sensor modalities at different data rates.
• Understanding of sensor and optics principles that impact computer vision applications, including MTF, quantum efficiency, refraction, reflectance, etc.
• Experience with transformers for vision applications.
• Proven track record in publishing papers in machine learning and/or computer vision conferences including CVPR, ICCV, ISMAR, ECCV, NeurIPS, AAAI, ICLR.

About Meta

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics. Meta is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support. If you need support, please reach out to accommodations-ext@fb.com.

$177,000/year to $251,000/year + bonus + equity + benefits

Individual pay is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base salary, Meta offers benefits. Learn more about benefits at Meta.