Software Engineer (ML Platform)
Anyscale in San Francisco, CA
$170,112 - $237,000
About Anyscale:
Anyscale provides a development platform intended to simplify distributed computing. This enables software developers of all skill levels to build applications that run at any scale from a laptop to the data center.
We're commercializing a popular open source project called Ray - which is a framework for distributed computing as well as an ecosystem of libraries for scalable machine learning.
Our goal is to enable organizations to accelerate the progress of AI applications out into the real world and at lower cost. Backed by Andreessen Horowitz, NEA, and Addition.
Anyscale is based in San Francisco, CA.
About the role :
Anyscale is looking to hire strong engineers to build next generation high-performance machine learning serving systems (both our open source libraries and SaaS offering).
Much of the tooling used to serve ML models today is inherited from the previous generation of infrastructure, but emerging ML applications come with a new set of requirements: high compute requirements, the need for specialized hardware, and composing many different models along with business logic in a single request.
Our goal is provide a simple but powerful set of tools to make bringing complex ML applications to production a reality.
About the Platform team :
The Platform team’s mission is to build world class systems for serving ML models in production. Part of this work is building and maintaining the open source Ray Serve library, as well as contributing directly to the Anyscale platform used by our customers to run mission-critical applications.
Much of our work is user-facing: you’ll have the opportunity to collaborate with open source users and customers from small startups with lean ML engineering teams to industry-leading companies using Ray, such as Uber, Shopify, and ByteDance.
Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
- Building a highly available service for ML model serving
- Improve Ray Serve and our other libraries to make authoring next-generation production ML applications as easy as possible
- Improve our autoscaling capabilities to drive performance improvements & cost savings
- Reduce latency and improve throughput for single- and multi-model serving
- Solid background in algorithms, data structures, system design
- Experience working with modern machine learning tooling (PyTorch, Tensorflow, JAX)
- At least 1+ year of relevant work experience
- Experience building and maintaining an open source project
- Experience building and operating machine learning infrastructure in production
- Experience building highly available serving systems
- At Anyscale, we take a market-based approach to compensation. We are data-driven, transparent, and consistent. The target salary for this role is $170,112 ~ $237,000. As the market data changes over time, the target salary for this role may be adjusted.
- Stock Options
- Healthcare plans, with premiums covered by Anyscale at 99%
- 401k Retirement Plan
- Wellness stipend
- Education stipend
- Paid Parental Leave
- Paid Time Off
- Commute reimbursement
- 100% of in office meals covered
This role is also eligible to participate in Anyscale's Equity and Benefits offerings, including the following: