N
Not Specified Permanent

San Jose, California · USA job

Senior Product Architect, K8s-Based AI Infrastructure

Nvidia

San Jose, California

Job description

Overview

As a Product Architect at NVIDIA, you define architectures for AI clusters and oversee product development from concept to lifecycle. You'll balance feasibility with user needs, collaborating across hardware, software, security, and systems teams. You'll prototype, test, and iterate at scale, while producing thorough documentation and engaging content for customers and partners. This role places you at the nexus of innovation and execution, shaping products for AI infrastructure at datacenter scale.

Compensation / Benefits
  • equity
  • benefits
  • base salary range (Levels 4/5)
  • remote work flexibility
  • career growth opportunities
  • inclusive work environment
Responsibilities
  • Stay at the forefront of AI Infrastructure & Agentic AI trends and propose new concepts
  • Define detailed product architectures focusing on performance, scalability, interoperability, and datacenter deployment
  • Lead prototyping and testing to validate design and diagnose bottlenecks
  • Iterate designs based on feedback and evolving requirements
  • Collaborate with hardware, software, security, and systems teams for seamless integration
  • Conceptualize solutions with partners and customers, building POCs and MVPs
  • Provide comprehensive technical documentation and user guides
  • Develop targeted content (whitepapers, blogs, curriculum) for customers and users
Key requirements
  • 8+ years of experience architecting datacenter-scale HPC or AI infrastructure in a principal/lead role
  • Bachelor in Computer Science or related field (or equivalent experience)
  • Strong background in technologies enabling large-scale infrastructure management (networks, storage)
  • Extensive experience with DevOps tools including Python, Ansible, Container Runtimes, Kubernetes, and data center deployments
  • Familiarity with AI workloads, including agentic & RAG-based workflows, inference at scale, large-scale training & fine-tuning, and model evaluation
  • Exceptional communication skills for translating complex tech to diverse audiences
  • Passion for staying updated with AI and related technologies
  • exceptional communication
  • collaboration
  • self-motivation/autonomy
  • Python
  • Ansible
  • Container Runtimes

Explore related USA jobs

Similar jobs you may like

Related roles with a similar title and location.

Same category Same postal code Same area Same location Same country

Field Gutter Installer

LeafHome

San Jose, California, United States · 95101

Same category Same location Same country

Building Engineer 2

US AMR-Jones Lang LaSalle Americas, Inc.

Costa Mesa, California, United States · 92626

Same category Same location Same country

Construction Project Manager

Boardwalk IG Management LLC

Yountville, California, United States · 94599

Same category Same location Same country

Public Works Construction Manager

4LEAF, Inc

Sacramento, California, United States · 95814

Same category Same location Same country

General Labor

Employee Force Provider

Alhambra, California, United States · 91899

Same category Same location Same country

Architect Quality Assurance

Exavalu Inc.

Newport Beach, California, United States · 92660

Same category Same location Same country

Construction Project Manager

Boardwalk IG Management LLC

Yountville, California, United States · 94599

Same category Same location Same country

Public Works Construction Manager

4LEAF, Inc

Sacramento, California, United States · 94203

Need help finding a job?

Chat with our AI assistant.