W
Not Specified Permanent

New York City, New York · USA job

Senior Architect, Data Engineering

West Monroe Partners

New York City, New York

Job description

Overview

In this Senior Architect role, you shape data-driven architectures for diverse clients, guiding big data strategy and platform choices. You will lead AI/ML initiatives and lakehouse designs across industries, collaborating with cross-functional teams to deliver scalable data solutions. Your work enables secure, governed data pipelines that power analytics and AI workloads, with a strong emphasis on client impact and pre-sales support. This role offers hands-on technical leadership with opportunities to influence technology decisions and growth.

Compensation / Benefits
  • medical, dental, vision, and basic life insurance
  • 401k with company contributions
  • employee stock ownership plan (ESOP)
  • annual bonuses
  • unlimited flexible time off
  • ten paid holidays per year
Responsibilities
  • Provide guidance on platform selection for Databricks, Snowflake, and Microsoft Fabric
  • Design data pipelines and processing flows for analysis using Spark on Scala, Storm, Flume, Sqoop
  • Define data structures for ingestion and reporting aligned with use cases
  • Offer data management expertise (structure, stewardship, semantics, mapping) for architecture and platform design
  • Architect and implement scalable AI/ML and Generative AI solutions on Databricks, Snowflake, Microsoft Fabric
  • Design data architectures enabling AI/ML workloads with high-quality, governed data pipelines and lakehouse environments
  • Coach consultants, share best practices, perform code reviews
  • Coordinate with data source owners to ensure analytics integration with platforms and source systems
  • Ensure data integrity across systems
  • Engage in business development activities, crafting proposals and participating in pre-sales to drive growth
  • Collaborate on proposals, demos, and presentations to align with client objectives and win business
Key requirements
  • 10+ years of professional experience, 5+ in consulting
  • Strong Databricks and/or Snowflake expertise with lakehouse, governance, and AI/ML enablement
  • Experience with Azure OpenAI, OpenAI APIs, LangChain, Semantic Kernel, MLflow, Mosaic AI, or similar
  • Hands-on with LLMs, prompt engineering, embeddings, vector databases, RAG architectures
  • Knowledge of Big Data methodologies and modern distributed architectures
  • Strong data engineering experience with Databricks, Snowflake, and/or Fabric
  • Experience with relational databases (SQL Server) and large unstructured data
  • ETL development experience; cloud platform exposure (AWS, Azure, GCP)
  • Experience with PowerBI and Tableau; Azure SQL, Data Lake, Data Factory familiarity
  • Excellent communication; commitment to inclusion and diversity; travel 30-50%
  • collaborative
  • strong communication
  • client-facing leadership
  • Databricks
  • Snowflake
  • Microsoft Fabric

Explore related USA jobs

Similar jobs you may like

Related roles with a similar title and location.

Same category Same location Same country

Ready Mix Concrete Quality Control Supervisor

50167 Heidelberg Materials NE LLC

Central Square, New York, United States · 13036

Same category Same location Same country

Facilities & EHS Site Leader

GE Vernova

Malta, New York, United States

Same category Same location Same country

Senior Electrical Estimator

Cis-Tec

White Plains, New York, United States · 10610

Same category Same location Same country

Construction Scheduler - Flushing NY 11354

Nexus

Queens, New York, United States

Same category Same location Same country

Construction Masonry Foreman / Supervisor(CMU specialist)

Wave Masonry

New York, New York, United States · 10292

Same category Same location Same country

Construction Safety Manager

Novisal LLC

New York, New York, United States · 10004

Same category Same location Same country

SACC Site Supervisor (Albany)

Boys & Girls Clubs of the Capital Area Inc

Albany, New York, United States · 12201

Same category Same location Same country

Assistant Construction Superintendent - $65000 - $70000 Yearly Salary

Midland Management LLC

Rochester, New York, United States · 14601

Need help finding a job?

Chat with our AI assistant.