Overview In this role you will lead enterprise AI testing and evaluation, shaping how AI solutions are tested, monitored, and governed across the organization. You will balance strategic leadership with hands-on technical work to advance AI risk management and safety standards. You'll guide a team of AI specialists and collaborate with Model Risk Management to define performance thresholds and escalation triggers. This is a chance to drive responsible AI at scale within a customer-focused bank.
Compensation / Benefits- medical/prescription coverage with HSA
- dental and vision options
- 401(k) with match
- stock purchase plans
- educational assistance
- wellness program
Responsibilities- Builds and leads the enterprise AI testing and evaluation function, designing and improving testing frameworks for high-impact AI solutions
- Owns AI risk management components, including pre-deployment testing and post-deployment monitoring for generative/agentic AI
- Establishes AI performance, risk, and safety standards with Model Risk Management, including thresholds and escalation criteria
- Leads AI risk incident response, ensuring timely mitigation actions such as pausing deployments or patching when needed
- Provides technical leadership for a team of AI specialists, fostering collaboration and delivery excellence
- Acts as hands-on practitioner-leader, contributing to strategy, methodologies, and day-to-day team activities
- Balances strategic leadership with technical execution, serving as both people leader and subject matter expert in AI evaluation and governance
Key requirements- University/college degree (level unspecified)
- 8+ years industry experience (implied)
- At least 5 years of prior management experience
- Proficiency in Python, Microsoft Studio, Agent Builder, and Azure
- Strong knowledge of AI governance, risk management, and testing methodologies
- Analytical thinking
- Collaborative mindset
- Leadership and people management
- Python
- Microsoft Studio
- Agent Builder
