Software Engineer, Infrastructure Data Plane

Anyscale in San Francisco, CA

About Anyscale:

At Anyscale , we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray , a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI , Uber , Spotify , Instacart , Cruise , and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.

Anyscale is based in San Francisco, CA. Employees are required to come in office 3x a week.

About the role
Anyscale is looking for a Software Engineer to join the Infrastructure Data Plane team. Anyscale aims to provide the next generation of tools and infrastructure to make developing and running distributed AI applications in the cloud as easy as on your laptop. At the Cloud Platform Data Plane team, we build the scalable, secure, and robust backbone to realize this vision.

We are seeking a talented Software Engineer with a strong background in data plane development and expertise in container technologies. As part of our engineering team, you will play a crucial role in designing, implementing, and optimizing data plane solutions that power our cutting-edge products.

You will be able to work on the open-source Ray, our major infinite laptop proprietary product, and the integration and interaction between the two as well as critical customer features.
Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.

Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
    • Design and develop components to manage Ray applications and auxiliary containers running on the data plane
    • Create cutting-edge features to enhance reliability, performance, scalability, and observability of Anyscale-managed Ray workloads
    • Implement and maintain accelerator support
    • Manage and optimize storage, networking, and security aspects of the data plane
    • Handle dependencies and container image management
    • Participate in code reviews, design discussions, and architecture planning sessions
    • Provide on-call support and collaborate with customer and field teams to troubleshoot data plane issues
    • Work with a team of leading distributed systems and machine learning experts
    • Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
    • 3+ years of experience writing high-quality production code
    • Hands-on experience building high-performance distributed systems at scale
    • Proficiency in Go and Python
    • In-depth knowledge of low-level operating system foundations (Linux kernel, file systems, containers)
    • Comprehensive understanding of network protocols and associated tools
    • Ability to work independently and collaboratively in a fast-paced environment
    • Customer-focused mindset with excellent communication skills
      • Bonus
    • Master's degree in Computer Science or related technical field
    • Contributions to open-source projects in dataplane or container technologies
    • Familiarity with cloud platforms (AWS, Google Cloud, Azure) and Kubernetes
Apply