Skip to main content
Experian

Lead Data Engineer (Brazil Based)

RemoteNot specified
Published
Role
Unknown
Experience
Lead
Employment
Full-time
Salary not disclosed
Check eligibility

The listing doesn't say where it hires from. Check the description or the employer's site before applying.

No BS summary

We are looking for a Lead (Senior) Data | Software Engineer to lead the evolution of a petabyte-scale data platform on AWS. In this role, you will design and build highly scalable, resilient, and high‑performance data pipelines and services, applying advanced software and data engineering practices.

Core skills

query optimizationdata partitioningstorage patterns

Required skills

AWSAWS data ecosystem/Glue/S3/Athena/Managed Airflow/IcebergSparkJVM languages/Java/Scala/KotlinPythonGitGitHubBitbucket

Optional skills

DBTmodern transformation frameworksconcurrent programmingparallel programmingPythonAngularTypeScriptvector databases

Required languages

English advanced

What you'll do

  • Design, implement, and evolve a petabyte‑scale AWS data platform, applying advanced engineering, distributed systems principles, and cloud‑native practices to ensure performance, reliability, and scalability.
  • Build and optimize highly scalable data pipelines using JVM languages (Java, Scala, Kotlin, etc...), Spark, Python, and cloud‑native services, ensuring efficient, resilient, and production‑ready data processing that supports analytics and downstream products.
  • Act as a principal‑level technical leader, mentoring engineers, driving high‑quality code reviews, and promoting best practices to elevate engineering maturity across the organization.
  • Contribute to architectural and design decisions, working closely with architects, product owners, and engineering leadership to guide platform evolution aligned with business strategy.
  • Plan and deliver complex technical initiatives, ensuring high‑quality outcomes, predictable execution, and effective collaboration within agile value‑stream teams.
  • Ensure operational readiness by following coding standards, testing practices, monitoring strategies, and release procedures, supporting production deployments to maintain platform stability.
  • Explore and adopt modern technologies, such as GraphQL integrations, vector databases, and AI/LLM-based techniques, enhancing data access, platform usability, and development efficiency.

What they require

  • Expert-level software and data engineering experience in large-scale data platforms
  • Deep experience building petabyte-scale systems using Java-based languages such as Scala and Apache Spark
  • Advanced understanding of distributed systems and highly parallelized workloads
  • Strong skills in query optimization, data partitioning, and efficient storage patterns
  • Cloud ecosystem mastery (AWS required; Azure/GCP are pluses)
  • Experience influencing long-term system architecture and platform design
  • Excellent code review, mentorship, and technical leadership capabilities
  • Hands-on experience working on agile environments and collaborating across cross-functional engineering teams
  • Strong version control and multi-repo collaboration skills (Git, GitHub, Bitbucket)
  • Bachelor's degree in Computer Science, Engineering, or related technical field, or equivalent experience
  • Relevant experience
  • Advanced English and availability to travel to São Carlos/SP when needed
  • Experience with DBT or modern transformation frameworks
  • Knowledge of concurrent and parallel programming
  • Familiarity with Python, Angular and TypeScript
  • Experience with vector databases (pgvector, Redis vector fields, etc.)
  • Practical experience applying AI/LLM techniques to data platforms, data access, or software quality

Benefits

  • At Serasa Experian, we believe that diversity is essential for a healthier and more innovative work environment, where everyone can share experiences and express their ideas.
  • We also have our affinity groups, created to empower and support individuals from underrepresented groups: ExperianPride (LGBTQIAPN+ community), Ubuntu (racial equity), Women in Experian (gender equity), Aspire (people with disabilities), and Connecting Generations (generations).

Irish company that provides information services

🇮🇪 IrelandDataEnterpriseexperian.com/

What people say about this company

3.6/ 5

Salary not disclosed