Skip to main content
Cardlytics

Principal Software Engineer, Tech Lead - Platform

RemoteUnited States only
Published
Role
Data Engineering
Experience
Senior
Employment
Full-time
Company size
Enterprise
Salary not disclosed
Check eligibility

Open to US only. Set where you work from to check your eligibility.

No BS summary

Principal-level technical leader for data platform engineering. Deep hands-on experience with Databricks/Spark/Delta Lake on AWS, Terraform, and lakehouse architectures; 7+ years in data roles and 2+ years in lead/architect capacity. Remote (US) — must be able to work in/for the US.

Core skills

DatabricksDelta LakeSpark

Required skills

AWSEMRUnity CatalogPySparkSQLTerraformCI/CDGitHub Actions

Optional skills

feature storesemantic layerdata ontologyknowledge graphML/AI pipelinesagentic applications

What you'll do

  • Design and evolve the Cardlytics next-generation architecture; establish reference architectures and standards for batch, streaming, ML, and AI/agentic workloads.
  • Build out the semantic layer, feature store, and data ontology to enable governed, self-service access for human and machine consumers.
  • Serve as the primary technical partner for analysts, engineers, and business users; develop self-service guides, onboarding materials, and best-practice documentation.
  • Set technical direction for the platform and mentor engineers across the data and platform teams; manage the vendor relationship.
  • Define monitoring standards and SLAs; lead performance tuning for Spark jobs, open table formats (e.g. Delta, Hudi), and SQL query engines; own incident response and root-cause analysis.
  • Drive adoption of a unified governance layer (e.g., Databricks Unity Catalog) for RBAC, column-level security, data lineage, and metadata management; implement security best practices including encryption and audit logging.
  • Define the operating model and guardrails for managed lakehouse platforms (including Databricks on AWS) — compute policies, access model, catalog structure, and cost governance.
  • Own the CI/CD strategy for lakehouse and data platform deployments (Terraform, GitHub Actions, Asset Bundles); enforce DevOps practices across engineering teams.

What they require

  • 7+ years of experience in data engineering or data platform roles, with at least 2 years in a technical lead or architecture capacity.
  • Deep, hands-on expertise with Databricks, AWS EMR or similar, Delta Lake, Unity Catalog, Spark (PySpark), and SQL; solid understanding of compute/cluster management on AWS.
  • Proven experience designing and delivering Lakehouse architectures and large-scale ELT/ETL pipelines in production environments.
  • Proficiency in Infrastructure as Code tools, such as Terraform.
  • Demonstrated experience supporting diverse stakeholder groups including analysts, engineers (including ML engineers), and non-technical business users.
  • Strong understanding of data governance, data modeling, and cloud security best practices.
  • Excellent communication and collaboration skills, with the ability to translate technical concepts for non-technical audiences.
  • Familiarity with or willingness to work within macOS and Google Workspace environment.

Benefits

  • Flexible paid time off plus company holidays
  • Medical, dental, and vision insurance begins on your first day
  • 401(k) retirement plan with company match, plan also includes a student loan debt repayment option
  • Employee Stock Purchase Plan
  • Educational assistance for continuing education
  • Lifestyle Spending Account for physical, emotional, and financial wellness
  • Complimentary Calm app subscriptions

Founded in 2008, Cardlytics (NASDAQ: CDLX) is the industry-leading purchase intelligence and incentives platform. We make commerce smarter and more rewarding for everyone by helping businesses attract, understand, and incentivize consumers through our partners' digital reward programs.

AdTechEnterprisecardlytics.com/
Salary not disclosed