S
Not Specified Permanent

San Francisco, California · USA job

Research Scientist, Safety Post Training

Scale AI

San Francisco, California

Job description

Overview

In this role you advance safety post-training methods and interpretability to make frontier AI systems safer and more understandable for researchers and policymakers. You will work within Scale's policy research team to connect ML findings with safety standards and real world evaluation benchmarks. You'll design pipelines to study how training choices shape safety and alignment, and translate insights into practical mitigations. This position offers a mission driven opportunity to influence AI risk governance across industry, government, and academia.

Compensation / Benefits
  • comprehensive health, dental and vision coverage
  • retirement benefits
  • learning and development stipend
  • generous PTO
  • commuter stipend (possible)
Responsibilities
  • Design and run post-training pipelines to study how training choices affect model safety, robustness, and alignment properties
  • Develop interpretability informed evaluations to reveal unsafe or undesirable model behaviors and guide mitigations
  • Collaborate with policymakers, engineers, and researchers to translate findings into actionable safety standards, benchmarks, and best practices
Key requirements
  • Commitment to safe, trustworthy AI deployments
  • Experience with post-training and RL techniques such as RLHF, DPO, GRPO, and similar approaches
  • A track record of published research in machine learning, particularly in generative AI
  • At least three years of experience addressing sophisticated ML problems in research or product development
  • Strong written and verbal communication skills to operate in a cross-functional team
  • Cross-functional collaboration
  • Clear and effective communication
  • Analytical thinking and problem solving
  • Post-training methods
  • Reinforcement learning techniques (RLHF, DPO, GRPO)
  • Mechanistic interpretability (nice to have)

Explore related USA jobs

Similar jobs you may like

Related roles with a similar title and location.

Same category Similar role Same postal code Same area Same location Same country

Principal Scientist / Senior Research Scientist / Scientific Operations Principal - Histopathology & Translational Biomarkers

KA Recruiting Inc.

San Francisco, California, United States · 94101

Same category Same area Same location Same country

Laboratory Manager OR Laboratory Operations Manager at Top Hospital

KA Recruiting Inc.

San Francisco, California, United States · 94103

Same category Same location Same country

IRL Manager or Immunohematology Reference Laboratory Manager in California

KA Recruiting Inc.

Duarte, California, United States · 91010

Same category Same location Same country

Laboratory Technologist - California

KA Recruiting Inc.

Oakland, California, United States · 94601

Same category Same location Same country

Clinical Laboratory Technologist – Generalist Central Florida

KA Recruiting Inc.

Bishop, California, United States · 93514

Same category Same location Same country

Medical Physicist - Radiation Therapy ($85.24–$128.84/Hourly)

KA Recruiting Inc.

Palm Springs, California, United States · 92262

Same category Same location Same country

NEW Laboratory Manager - Award Winning Health System (California)

KA Recruiting Inc.

Fremont, California, United States · 94538

Same category Same location Same country

Clinical Lab Scientist (CLS) or Med Tech (MT) - Microbiology - $15,000 sign-on bonus!

KA Recruiting Inc.

Cathedral City, California, United States · 92234

Need help finding a job?

Chat with our AI assistant.