T
Not Specified Permanent

White Plains, New York · USA job

BCG Platinion Lead AI Tech Architect - AI Platforms

The Boston Consulting Group

White Plains, New York

Job description

Overview

In this role, you design and guide end-to-end AI platform architectures that weave together LLMs, data pipelines, and enterprise systems. You work across AI, data, product, and engineering teams to deliver scalable, agentic AI solutions. You prototype and validate architectures, and mentor teams while translating complex concepts for stakeholders. This is a chance to shape AI platform patterns at scale in a collaborative, growth-minded environment.

Compensation / Benefits
  • Zero dollar health insurance premiums for employees and dependents
  • Dental coverage up to $5,000 orthodontia
  • Vision insurance
  • Gym membership reimbursement
  • Fully vested retirement contributions
  • Generous paid time off and office closure during holidays
Responsibilities
  • Design AI and LLM-based system architectures with emphasis on scalability, performance, and maintainability
  • Evaluate and select AI frameworks and tooling to fit use cases (e.g., LangChain, LlamaIndex, LangGraph, Semantic Kernel)
  • Create agentic AI solutions for workflow automation including memory usage and orchestration patterns
  • Define integration patterns (RAG, context management, prompts, enterprise connectivity) and lifecycle governance
  • Develop proof-of-concepts and architectural prototypes for AI platforms and agent orchestration
  • Support production deployment, observability, and governance for scalable solutions
  • Define development standards for versioning, testing, deployment, and LLMOps
  • Communicate technical designs clearly to both technical and non-technical stakeholders
  • Lead and mentor junior architects and technology consultants to ensure architectural alignment
  • Contribute to business development through architecture input and solution shaping
Key requirements
  • 6+ years in software/data engineering or AI systems with architecture/leadership experience
  • Strong software architecture and distributed systems foundation
  • Experience designing AI/ML or LLM-based systems in production or near-production
  • Programming experience (Python, JavaScript, TypeScript) preferred
  • Familiarity with AI-assisted coding tools and rapid prototyping
  • Experience with agentic AI frameworks (LangChain, LangGraph, Semantic Kernel, AutoGen, LlamaIndex)
  • Knowledge of RAG, multi-agent orchestration, memory patterns, vector databases, function-calling
  • Cloud architecture and API integration (AWS, Azure, GCP); cloud AI deployments
  • Containerization/orchestration (Docker, Kubernetes)
  • Exposure to vector databases (Pinecone, Qdrant, Aure) or similar
  • Strong analytical and communication skills; consulting mindset; travel willingness
  • Gen AI fluency and validation of AI outputs
  • Collaborative and stakeholder-oriented
  • Clear communicator for technical and non-technical audiences
  • Ambiguity-tolerant and agile in delivery
  • LangChain
  • LlamaIndex
  • LangGraph

Explore related USA jobs

Similar jobs you may like

Related roles with a similar title and location.

Same category Same area Same location Same country

Senior Electrical Estimator

Cis-Tec

White Plains, New York, United States · 10610

Same category Same location Same country

Ready Mix Concrete Quality Control Supervisor

50167 Heidelberg Materials NE LLC

Central Square, New York, United States · 13036

Same category Same location Same country

Facilities & EHS Site Leader

GE Vernova

Malta, New York, United States

Same category Same location Same country

Construction Scheduler - Flushing NY 11354

Nexus

Queens, New York, United States

Same category Same location Same country

Construction Masonry Foreman / Supervisor(CMU specialist)

Wave Masonry

New York, New York, United States · 10292

Same category Same location Same country

Construction Safety Manager

Novisal LLC

New York, New York, United States · 10004

Same category Same location Same country

SACC Site Supervisor (Albany)

Boys & Girls Clubs of the Capital Area Inc

Albany, New York, United States · 12201

Same category Same location Same country

SACC Site Supervisor (Albany) - $18 - $20 Hourly Wage

Boys & Girls Clubs of the Capital Area Inc

Albany, New York, United States · 12201

Need help finding a job?

Chat with our AI assistant.