Principal Architect & Data Engineer
$160,000–$170,000 year
RemoteCanada
Job Summary
Architect the consolidation of disparate storage and compute environments into a unified, high-performance Lakehouse supporting Iceberg and Delta Lake. Scale internal agentic platforms and design a Data Mesh enabling business units to innovate within pre-defined guardrails while maintaining a single, governed enterprise source of truth. Define standards, contracts, and observability metrics for structured and unstructured data in both batch and near-real-time contexts. Set global standards for high-performance query analytics, data modeling, and Zero-Copy architecture patterns. Mentor intermediate and senior data architects, fostering technical rigor and continuous professional development. Guide technical delivery across federated teams to ensure decentralized projects align with centralized enterprise architectural standards. Present complex architectural roadmaps, ROI projections, and security risk assessments to the Senior Leadership Team and Board. Partner with business leaders to map data products and ML models directly to corporate KPIs such as Revenue Growth and Operational Efficiency.
Required Qualifications
- 10+ years of professional experience in large-scale data engineering, architecture, and data platform roles
- 1+ years at a Staff or Principal level
- Mastery of Python
- Mastery of SQL
- Mastery of Spark
- Proven experience with workflow orchestration (e.g., Airflow)
- Experience with Infrastructure as Code (Terraform/CloudFormation)
- Experience with robust CI/CD testing pipelines
- Deep, hands-on expertise in AWS (S3, Glue, Redshift, Bedrock) OR Google Cloud (BigQuery, Vertex AI)
- Expert knowledge of federated query engines
- Expert knowledge of semantic layers
- Expert knowledge of modern Zero-Copy data sharing
- Extensive experience operating production data platforms in batch and near-real-time environments
- Experience with strong lineage, catalogs, and access controls serving as systems of record
- Proven track record building enterprise data governance, contracts, and quality frameworks
- Experience with metadata standards
- Experience with classification
- Experience with PII detection/redaction
- Ability to define safe-access patterns for AI consumption
- Experience enforcing security baselines (encryption, RBAC/ABAC, masking/tokenization)
- Experience with policy-as-code
- Experience establishing comprehensive frameworks for transparent cost attribution
- Experience with optimized storage tiering
- Experience with advanced metadata tagging
- Ability to advise executive leadership on operational efficiency
- Experience architecting automated triggers to detect and mitigate budget variances
- Proven experience architecting RAG (Retrieval-Augmented Generation) patterns
- Experience with vector readiness concepts (schemas, metadata, provenance)
- Experience managing enterprise AI registries
- Experience defining business logic centrally (via semantic modeling)
- 10+ years of experience in data engineering and/or architecture
- 5+ years AWS Redshift ecosystem
- None travel
- Relocation provided
Desired Qualifications
- 1+ years at a Staff or Principal level
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.