Overview As Senior Data Platform Architect, you will lead end-to-end architecture, security design, and governance of State Street's enterprise data platform spanning Snowflake, Databricks, and open data formats. You will shape scalable, secure, compliant data platforms to support analytics, regulatory reporting, AI/ML, and batch workloads across investment management use cases. You'll drive multi-cloud, governance, and data-sharing capabilities with a strong emphasis on auditability and risk management. This role combines hands-on delivery with strategic oversight to enable safe, scalable data operations.
Compensation / Benefits- 401K with company match
- medical/dental/vision insurance
- life insurance
- long-term disability
- paid time off
- Employee Assistance Program (EAP)
Responsibilities- Define and govern the hybrid Snowflake-Databricks architecture for data warehousing and data lake designs
- Establish reference blueprints and patterns for enterprise-scale, auditable platform usage
- Lead interoperability across Iceberg/Horizon/Unity Catalog across AWS, Azure, and GCP
- Architect open data platform strategy using Apache Iceberg, Delta Lake, Parquet, and Polaris/Unity Catalog
- Define standards for open table formats, catalog federation, and cross engine compatibility
- Govern data virtualization patterns for secure, cost-efficient data access across multiple sources
- Lead modernization of batch applications migrating from legacy systems to cloud-native solutions
- Set batch performance, resiliency, cost, and monitoring standards; identify and mitigate security risks during migration
- Partner with application owners to retire legacy infrastructure as part of cloud migration
- Provide SME guidance during architecture reviews and engage security, risk, audit, and cloud teams
Key requirements- Snowflake - governance, external tables, loading, Snowpark, RBAC, data sharing
- Databricks - Unity Catalog, ML pipelines, Delta/Iceberg
- Open platforms - Apache Iceberg, Delta Lake, Parquet, Polaris, Trino/Starburst
- Data virtualization - Denodo, Starburst, Snowflake/Databricks federation
- Batch modernization - Oracle/PL-SQL, mainframe to cloud-native orchestration
- Multi-cloud - AWS/Azure/GCP storage, IAM, networking
- Data modeling - dimensional/medallion schemas, tuning
- Languages - SQL, Python, Java, JavaScript, Scala, Spark; notebooks; Snowpark
- Linux - strong familiarity with Linux environments
- Regulated industry experience - financial services, SOX, MRA, NPPI/PII handling
- Generative AI - scripting and prompting capabilities
- Strong communication and cross-team collaboration
- Strong communication
- Collaborative teamwork
- Stakeholder engagement
- Snowflake architecture and governance
- Databricks Lakehouse & Unity Catalog
- Open table formats (Iceberg, Delta Lake, Parquet)
