T
Not Specified Permanent

Quincy, Massachusetts · USA job

BCG Platinion Principal AI Tech Architect - AI Platforms

The Boston Consulting Group

Quincy, Massachusetts

Job description

Overview

As an AI Systems Architect, you shape scalable AI and LLM-based architectures across the organization. You collaborate with product managers, data scientists, and engineers to translate goals into robust designs and guide teams through architectural best practices. You prototype and validate new patterns, evaluate emerging AI tools, and ensure production readiness with governance and observability. This role blends high-level system design with hands-on engineering to drive impactful, AI-enabled solutions at scale. You join a collaborative, forward-thinking firm that values practical innovation and technical leadership.

Compensation / Benefits
  • Zero-dollar health premiums for employee and family
  • Dental and vision coverage
  • Gym membership reimbursement
  • Fully vested retirement contributions
  • Generous paid time off
  • Paid parental leave and family benefits
Responsibilities
  • Define system architectures for AI/LLM solutions ensuring scalability and reliability
  • Design integration patterns for model orchestration, context management, and external connectivity
  • Establish architectural blueprints, governance, and design principles for AI initiatives
  • Develop MVPs/POCs to test architectural choices and accelerate innovation
  • Evaluate emerging AI frameworks and tools for fit and integration
  • Collaborate with cross-functional teams to translate business goals into robust AI designs
  • Provide technical direction and mentorship on architectural patterns and scalability
  • Oversee production readiness including observability, versioning, testing, and monitoring of models and AI services
Key requirements
  • Strong foundation in software architecture and distributed systems design
  • Experience designing or scaling AI/ML or LLM-based applications
  • Proficiency in Python, TypeScript, or Node.js
  • Familiarity with LangChain, Semantic Kernel, AutoGen, CrewAI, LlamaIndex
  • Understanding of data management, cloud architecture, and API-based integration
  • Experience with vector databases, context retrieval, and prompt orchestration patterns
  • Strong communication and documentation skills
  • Strong communication and documentation
  • Mentorship and leadership of engineering teams
  • Collaborative, cross-functional work style
  • Python
  • TypeScript
  • Node.js

Explore related USA jobs

Similar jobs you may like

Related roles with a similar title and location.

Same category Same location Same country

Staff Vice President Construction Underwriter - FM Intellium

FM

Norwood, Massachusetts, United States · 02062

Same category Same location Same country

Jr. Estimator

RoadSafe Traffic Systems

Avon, Massachusetts, United States · 02322

Same category Same location Same country

Senior Construction Project Manager

JLL

Cambridge, Massachusetts, United States · 02138

Same category Same location Same country

Jr. Estimator - $36 - $38 Hourly Wage

RoadSafe Traffic Systems

Avon, Massachusetts, United States · 02322

Same category Same location Same country

Middle School Building Based Educator ()

Match Education

Boston, Massachusetts, United States · 02101

Same category Same location Same country

Construction Project Manager

The Norfolk Companies

Braintree, Massachusetts, United States · 02184

Same category Same location Same country

Construction Project Manager - $85000 - $110000 Yearly Salary

The Norfolk Companies

Braintree, Massachusetts, United States · 02184

Same category Same location Same country

Superintendent II

Peckham Industries

Palmer, Massachusetts, United States · 01069

Need help finding a job?

Chat with our AI assistant.