Simulation Software Engineer - Reinforcement Learning

Sanctuary in Vancouver, BC

Your New Role and Team

Sanctuary, a world leader in building AI-based control systems for humanoid robots, is looking to hire a Software Engineer with experience in Reinforcement Learning for our Simulation team. Reporting to the Software Engineering Manager and working closely with the Machine Learning team, you'll delve deep into the design and implementation of simulation environments to support Machine Learning R&D fueling our general-purpose robots.

We're seeking candidates who thrive on broad thinking and are eager to continuously learn and develop their technical skills in a dynamic industry environment. As a key member of our team, you'll have the opportunity to own solutions from conception to deployment, adapt to complex development landscapes, and drive innovation that enhances our technology stack. If you're ready to make a significant impact and contribute to the advancement of robotics technology, we invite you to join us.
Working at Sanctuary AI
Sanctuary AI is an equal opportunity employer; employment with Sanctuary AI is governed based on skills, competence, and qualifications and will not be influenced in any way by race, color, religion, gender, national origin/ethnicity, veteran status, disability status, age, sexual orientation, gender identity, marital status, mental or physical disability, or any other legally protected status. In 2023, Sanctuary AI moved into a state-of-the-art office facility and has been recognized by LinkedIn as a Top Startup company.
Compensation and Benefits
Sanctuary offers a market-leading compensation package that includes competitive salaries, equity stakes, and a full suite of benefits for permanent employees, encompassing health coverage, paid time off, cutting-edge work facilities, and worksite flexibility by role. Our commitment to fairness ensures that our total compensation consistently surpasses market standards.

About Sanctuary AI
Founded in 2018, Sanctuary builds humanoid robots and a novel control system for them that integrates symbolic logic and reasoning with data-driven robot foundation models. We use our robots to collect vision, audio, touch, and proprioception data from the perspective of the robot while they perform real-world work tasks. We use that data to train multimodal robot foundation models. Because our systems are vertically integrated, we can design, deploy, and refine at scale. Our mission is to create the world's first human-like intelligence in general-purpose robots.




Recruiting and Employment Agency Notice:
Recruitment and hiring is conducted internally by Sanctuary AI. We are not seeking or soliciting any new agency partnerships or agreements at this time . Any employment agency or professional recruiter (“Agency”) that provides an unsolicited resume(s) or otherwise presents a prospective job candidate through the Sanctuary AI career site or directly to any Sanctuary AI employee, irrevocably grants to Sanctuary AI the unrestricted right to engage, hire, or contract with that candidate at Sanctuary AI's sole discretion without any compensation to the Agency. We appreciate your interest in working together, and should the need arise our Talent Acquisition team will contact any external firms directly.

    • Develop, maintain, and upgrade our simulation software stack
    • Contribute in the development of high-fidelity digital twin models of our general purpose robotics systems in simulation for machine learning application
    • Contribute in design reviews and recommend systems improvements
    • Analyze requirements and provide robust technical designs to drive agile implementation
    • Participate in cross-team meetings, scoping, and decision making
    • Recommend new technologies to ensure quality and productivity
    • Help teams analyze and troubleshoot application issues

      • Your Experience
      Qualifications:
    • Bachelor’s or Master’s degree in Computer Engineering, Computer Science, Mechanical Engineering, Physics, or other relevant engineering disciplines or equivalent experience
    • 2+ years of hands-on engineering experience with Python, C++, Rust, or equivalent languages in a dynamic, fast-paced environment

      • Skills:
    • Development experience with simulation platforms such as Omniverse ecosystem (IsaacGym, IsaacSim, IsaacLab, Orbit) as well as MuJoCo (MJX)
    • Experience designing, implementing, and rigorously testing software components ensuring reliability and performance under demanding conditions.
    • Knowledge of implementing and improving state-of-the-art Reinforcement Learning (RL) algorithms and testing them in simulation settings
    • Ability to design RL training pipelines to facilitate fast deployment on physical robots
    • Keep up to date with state-of-the-art RL methodologies and robotics
    • Experience in developing and optimizing large-batch parallel simulations (both in CPU and GPU) for Reinforcement Learning
    • Experience in sim-to-real transfer (including sim tuning, design and coding domain randomization)
    • Familiarity with advanced physics engines such as MuJoCo, Bullet, DRAKE, Vortex, DART, Havok, etc.
    • Comprehensive knowledge of engineering best practices, including coding standards, system design, testing methodologies, and operational excellence
    • Familiarity with system identification and dynamics system modeling methods
    • Familiarity with kinematic analysis, multi-body dynamics, and controls
    • Familiarity with tactile and force-feedback haptics

      • Traits:
    • Possess exceptional listening skills and adeptness in conflict resolution, fostering a collaborative and inclusive team culture
    • Demonstrate influential leadership, capable of driving consensus and inspiring others to embrace new ideas and methodologies.
    • Embrace challenges with tenacity and enthusiasm, pushing the boundaries of what's possible in robotics and simulation technology.
    • Exhibit patience, persistence, and meticulous attention to detail when troubleshooting issues, ensuring the delivery of robust and reliable solutions.
    • Maintain an unwavering commitment to advancing the field of robotics, driven by a passion for creating machines with human-like intelligence.
Apply