Overview As a member of Scale AI's ACE team, you'll study data types essential for building intelligent agents and guide data strategy to empower state-of-the-art LLM agents. You will bridge research and real-world deployment, producing publications and collaborating with customers and engineers to translate advances into scalable solutions. The role blends cutting-edge AI research with practical prototyping across browser and SWE agents. You'll be part of a mission-driven group that benchmarks agent performance and advances agentic capabilities.
Compensation / Benefits- Comprehensive health, dental and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend (optional)
- Equity-based compensation eligibility
Responsibilities- Study data landscapes needed for autonomous agents and guide data strategy
- Collaborate with customer researchers and Scale engineers to translate research into scalable solutions
- Contribute to impactful research publications on agents
- Benchmark agent performance across real-world environments and scenarios
- Prototype and validate new ideas addressing data, interaction, and evaluation challenges
Key requirements- Practical experience with LLMs and proficiency in frameworks like PyTorch, Jax, or TensorFlow
- Track record of published research in top ML venues (ACL, EMNLP, NAACL, NeurIPS, ICML, ICLR, COLM, etc.)
- At least three years of experience addressing sophisticated ML problems in research or product development
- Strong written and verbal communication skills and ability to work cross-functionally
- Strong written and verbal communication
- Cross-functional collaboration
- Creative problem-solving
- PyTorch
- Jax
- TensorFlow
