Lead Engineer, Reinforcement Learning & Scenario Generation
소프트웨어 엔지니어정규직리드 · 7년 이상
Serve Robotics에서 강화학습(RL) 및 시나리오 생성을 주도할 리드 엔지니어를 채용합니다. 로봇 공학 또는 AI 분야에서 7년 이상의 경력이 필수이며, 대규모 분산 학습 파이프라인 구축 및 시뮬레이션 환경 설계 경험이 중요합니다. 자율주행 로봇의 안전성과 성능을 높이기 위한 고도화된 학습 시스템을 설계하고 팀을 이끌게 됩니다.
At Serve Robotics, we’re reimagining how things move in cities. Our personable sidewalk robot is our vision for the future. It’s designed to take deliveries away from congested streets, make deliveries available to more people, and benefit local businesses.
The Serve fleet has been delighting merchants, customers, and pedestrians along the way in Los Angeles, Miami, Dallas, Atlanta and Chicago while doing commercial deliveries. We’re looking for talented individuals who will grow robotic deliveries from surprising novelty to efficient ubiquity.
We are tech industry veterans in software, hardware, and design who are pooling our skills to build the future we want to live in. We are solving real-world problems leveraging robotics, machine learning and computer vision, among other disciplines, with a mindful eye towards the end-to-end user experience. Our team is agile, diverse, and driven. We believe that the best way to solve complicated dynamic problems is collaboratively and respectfully.
The Lead Engineer, RL Scaling & Procedural Scenario Generation is responsible for building scalable training pipelines and generating high-fidelity synthetic scenarios. This role designs procedural simulation environments, creates diverse long-tail edge cases, and optimizes RL systems to train robust foundational models. This role sits at the intersection of simulation, machine learning, distributed systems, and content generation and has a high impact on how quickly and safely agents learn in simulation.
Develop RL algorithms that can help with terrain intelligence and social navigation behaviors.
Design, build, and optimize large-scale RL training pipelines (distributed compute, GPU clusters, containerized workflows).
Implement curriculum learning, domain randomization, and multi-agent RL strategies.
Optimize RL model performance, sample efficiency, and stability across thousands to millions of simulation steps.
Build automated tools for experiment orchestration, rollout collection, and metrics visualization.
Develop procedural generation pipelines for synthetic environments, agents, and dynamic behaviors.
Build tools to generate long-tail scenarios, sudden appearance of objects, traffic behaviors, rare events, and environmental variations.
Create systems for configuration, validation, and scoring of generated scenarios.
Collaborate with autonomy, ML, and safety teams to map real-world failures into repeatable synthetic simulation cases.
Design APIs to connect RL agents, scenario generators, planners, and environment simulators.
Debug and optimize simulation performance (real-time speed, determinism, reproducibility).
Work with 3D assets, traffic models, mapping systems (e.g., Isaac Sim, CARLA, Unity, Gazebo).
Partner with autonomy, data, and modeling teams to define training objectives and scenario requirements.
Translate real-world logs and edge cases into parameterized procedural content.
Document tools, frameworks, and workflows for internal users.
Master’s degree in Robotics, AI, Computer Science, Mathematics, or a related field.
7+ years of professional experience with shipping transformer based AI models handling complex navigation or manipulation tasks in AV or robotics solutions at scale in the real world.
3+ years technical leadership/architecture experience
Strong experience with Reinforcement Learning (PPO, SAC, A3C, DQN, multi-agent RL, or equivalents).
Hands-on experience with distributed training frameworks (Ray RLlib, Accelerate, PyTorch Distributed, Kubernetes, or similar).
Proficiency in Python and C++ for performance-critical simulation or graphics pipelines.
Experience building or modifying simulation environments (Isaac Sim, Unity, Unreal, CARLA, Gazebo, MuJoCo or custom engines).
Experience with procedural generation (noise functions, rule-based systems, agent scripts, behavior trees).
Experience with GPU compute, containers, and cloud infrastructure.
Background in generative AI (diffusion, LLMs) for scenario synthesis or environment creation.
Experience with traffic simulation (SUMO) or sensor simulation (LiDAR, camera pipelines).
Knowledge of CUDA, graphics engines, physics modeling, or rendering.
United States - Base salary range (U.S. – all locations): $190k - $230k USD
Canada - Base salary range (Canada - all locations): $160k - $190k CAD