Engineering Manager, Ray Data

About Anyscale: At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.

Anyscale is looking for an engineering leader to manage the open source Ray Data team. Ray Data is the Python-native data processing engine for AI workloads on Ray. It handles multimodal and structured data and powers batch inference, data loading for distributed training, and large-scale preprocessing.

The team owns the open source library end to end, including: The streaming execution engine, including scheduling, backpressure, and resource management across CPUs and GPUs Batch inference for LLMs and multimodal models, including integrations with inference engines such as vLLM Data loading for production training workloads with Ray Train and popular ML frameworks Connectors for data sources and formats such as P