Skip to main content
Valtech

Senior Data Engineer

RemoteNorth Macedonia only
Published
Role
Data Engineering
Experience
Senior
Salary not disclosed
Check eligibility

Open to MK only. Set where you work from to check your eligibility.

No BS summary

Experienced Senior Data Engineer needed to build and optimize cloud-based data platforms on AWS and Databricks. Requires strong Python, SQL, Spark, and Delta Lake skills. Must understand business problems behind data and collaborate with data scientists and ML engineers. Experience with GenAI and LLM pipelines is a plus.

Core skills

Apache SparkAWSDatabricks

Required skills

PythonSQLDelta Lake

Optional skills

SnowflakeMicrosoft Azure / FabricGCPGenAIRAG pipelinesvector databasesLLM data preparationCI/CD for data pipelines

What you'll do

  • Design and implement scalable data platforms and pipelines primarily on AWS and Databricks, with exposure to other cloud environments (Azure/Fabric, GCP, Snowflake) considered a plus.
  • Develop reliable batch, streaming, and near-real-time pipelines using technologies such as Spark and Delta Lake, and build ingestion, transformation, and curation workflows for both structured and unstructured data.
  • Implement modern data architectures including lakehouse patterns and medallion layering (bronze, silver, gold) within Databricks, ensuring systems are reusable, scalable, and aligned with enterprise needs.
  • Deliver high-quality datasets that support analytics, machine learning, causal modeling, and optimization systems.
  • Enable data pipelines for GenAI use cases (including LLMs, RAG pipelines, and vector-based data flows), as well as agent-based architectures and intelligent workflows, ensuring that data is model-ready and production-grade — leveraging AWS AI/ML services and Databricks' MLflow and Unity Catalog where relevant.
  • Design scalable logical and physical data models for analytical and operational use cases, ensuring consistency across domains.
  • Orchestrate workflows using tools such as Airflow, dbt, Databricks Workflows, or equivalents, with strong focus on automation, reliability, and maintainability of end-to-end pipelines.
  • Apply modern architecture patterns including event-driven and streaming architectures, and ensure adherence to best practices in data governance, lineage, quality, and access control (RBAC/ABAC), using tools such as Unity Catalog and AWS Lake Formation.
  • Establish strong data observability, including monitoring of data freshness, pipeline reliability, and SLA adherence, ensuring systems remain trustworthy and production-ready.
  • Enable data serving layers (APIs, feature inputs, analytical endpoints) to support downstream systems, including ML and AI platforms.
  • Continuously monitor and optimize pipelines and infrastructure for performance, scalability, and cost efficiency across AWS and Databricks environments.
  • Bring genuine curiosity to every engagement — ask the right questions to understand not just what stakeholders are asking for, but why.
  • Apply common sense thinking, detailed analysis, and experience-based recommendations to help derive and refine business requirements, surfacing gaps or better alternatives where they exist rather than simply executing a brief as written.
  • Work closely with data scientists, ML engineers, analysts, and business stakeholders to translate requirements into robust data solutions.
  • Support adoption of data products and contribute to best practices across the data and AI ecosystem.

What they require

  • Strong hands-on experience with Apache Spark and Delta Lake, and strong programming skills in Python and SQL.
  • Proven experience building batch and streaming data pipelines and production-grade data platforms, with solid understanding of data modeling, data quality, and governance principles.
  • Strong, demonstrable hands-on experience with AWS and Databricks is essential.
  • Familiarity with other modern data platforms such as Snowflake, Azure/Fabric, or GCP is a plus but not required.
  • Experience with lakehouse architectures and distributed data systems, and strong understanding of scalability, reliability, and performance considerations in data pipelines.
  • Naturally curious, with strong problem-solving skills focused on scalability and reliability, and a collaborative approach to working in cross-functional teams.
  • Comfortable applying common sense thinking, detailed analysis, and experience-based recommendations to help derive and challenge business requirements rather than taking them at face value.
  • Experience in Agile or consulting environments is beneficial.

Benefits

  • Private health insurance
  • Educational program with training and certification
  • Wellbeing program
  • Free beverages
  • Free coffee, drinks, and snacks at work
  • Company dinners
  • Ski trips, carting, laser-tag, wine tasting, picnics, cooking classes
  • Competitive salary
  • 24 days of vacation
  • Annual company events with the whole team
  • Challenging projects
  • Cool colleagues
  • Honest feedback
  • Honesty, openness and respect are among our core values.
  • Open feedback culture in order to build trust and grow together.

Valtech is the experience innovation company that exists to unlock a better way to experience the world. By blending crafts, categories, and cultures, we help brands unlock new value in an increasingly digital world. At the intersection of data, AI, creativity, and technology, we drive transformation for leading organizations, including L’Oréal, Mars, Audi, P&G, Volkswagen Dolby, and more.

Digital ExperienceEnterprisevaltech.com/

What people say about this company

2.8/ 5

Salary not disclosed