로봇 NEO를 위한 시뮬레이션 환경을 설계하고 강화학습 알고리즘을 통해 새로운 기능을 학습시키는 업무를 수행해요. 컴퓨터 공학 또는 관련 분야의 학사 학위와 소프트웨어 엔지니어링 분야의 4년 경력이 반드시 필요해요. C++를 활용한 실시간 시스템 구축과 대규모 분산 학습 경험을 갖춰야 해요. 제어 및 데이터 수집 팀과 협업하여 실제 환경에 정책을 배포하는 역할을 맡아요. 지원 시 이메일 본문에 을 반드시 기재해야 해요.
Job Description: Design simulation environments for NEO (name of robot) and teach NEO (robot) to learn new capabilities via reinforcement learning (RL) algorithms. This enables our robots to be safe and robust in a variety of conditions. Full-stack engineering, from data engineering to model architecture design to shipping polished products. Train NEO to do a diverse set of manipulation and locomotion tasks. Close the sim2real gap between policies trained in simulation and real. Work with controls, Quality Assurance (QA,) and data collection teams to ship reinforcement learning (RL) policies to the production fleet. Deploy skills trained with reinforcement learning (RL) into home environments.
Requirements: Bachelor’s degree or foreign degree equivalent in Computer Science, Mathematics, Software Engineering, Robotics, or related field and four (4) years of experience in Software Engineering or related role.
Skills: Experience and/or education must include:
Train large-scale imitation-learning models for motion planning. Curate expert demonstration datasets, designing loss functions, and deploying policies in real-world or simulated environments. Implement DAgger (Dataset Aggregation), including iteratively collecting additional expert demonstrations in response to model errors, to reduce covariate shift and improve policy robustness.
Generative architectures such as diffusion models, variational autoencoder, or applied to planning. Model architecture selection and stable training on high-dimensional data.
Architecting and executing distributed neural-network training across large GPU clusters. Data/model parallelism, gradient synchronization such as NCCL, fault tolerance, and efficient I/O for multi-TB datasets.
Build and optimize low-latency, real-time software systems. Use of C++ for hard-real-time applications, with hands-on knowledge of multithreading, lock-free data structures, and real-time OS constraints.
CONTACT: Please reference Job ID: 9443267 & email resume to careers.us@1x.tech
