Skip to main content
EUROPEAN DYNAMICS
EUROPEAN DYNAMICS

Senior Databricks Administrator/Architect

RemoteSpain only
Published
Role
Data Engineering
Experience
Lead
Employment
Contract
Company size
Enterprise
Salary not disclosed
Check eligibility

Open to ES only. Set where you work from to check your eligibility.

No BS summary

Senior Databricks Administrator/Architect with 9 years of IT experience, 8 years designing enterprise data platforms, and 5 years hands-on Azure Databricks. Must know Azure Databricks, Delta Lake, Unity Catalog, Spark/PySpark, SQL, Azure DevOps, Terraform/Bicep, Azure security and data governance. Fluent English required.

Core skills

Azure DatabricksUnity CatalogApache Spark

Required skills

Delta LakeAzure Data Lake Storage Gen2Azure Data FactoryAzure Event HubAzure SQLAzure SQL DatabasePySpark/Spark SQLTerraform/BicepAzure DevOpsRBACManaged IdentitiesPrivate EndpointsAzure Key VaultAzure MonitorMicrosoft Entra IDAzure ADAzure networkingSQLPython

Optional skills

Databricks MLFeature StoreModel ServingGenerative AI architecturesPower BIMicrosoft FabricSynapse Analytics

Required languages

English Fluent

What you'll do

  • Collaborate with Data Platforms and Integration team in architecting and implementing scalable enterprise data platform solutions utilizing Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, Azure Data Factory, Azure Event Hub, Azure SQL, and related Azure services
  • Design and develop enterprise data engineering frameworks supporting batch, streaming, ELT/ETL, and real-time analytics workloads
  • Administer and maintain Azure Databricks workspaces including cluster configuration, job scheduling, workspace administration, Unity Catalog implementation, secret management, compute policies, cluster policies, and workspace governance
  • Define and implement enterprise security architecture including identity integration with Microsoft Entra ID (Azure AD), Role-Based Access Control (RBAC), Privileged Identity Management (PIM), data encryption, private networking, managed identities, Key Vault integration, and secure access patterns
  • Establish enterprise data governance standards utilizing Unity Catalog including data lineage, data quality, metadata management, catalog organization, access policies, and audit capabilities
  • Deploy and Configure CI/CD pipelines utilizing Azure DevOps and Databricks Asset Bundles (DAB), Infrastructure as Code (Terraform/Bicep where applicable), deployment automation, release management, and environment promotion strategies
  • Optimize Databricks workloads through performance tuning, Spark optimization, cluster sizing, workload isolation, caching strategies, partitioning, Delta optimization, Photon, and cost optimization best practices
  • Design enterprise monitoring, logging, operational dashboards, alerting, and platform health monitoring utilizing Azure Monitor, Log Analytics, Application Insights, and Databricks system tables
  • Develop reusable architecture patterns, reference implementations, development standards, naming conventions, coding standards, operational procedures, and platform documentation
  • Support migration of legacy enterprise data warehouses, ETL solutions, and reporting platforms to Azure Databricks and modern Lakehouse architecture
  • Provide technical support and troubleshooting for production incidents related to Azure Databricks, Spark workloads, data pipelines, and platform infrastructure

What they require

  • University degree in combined with relevant IT professional experience of 9 years
  • At least 8 years of experience in designing and implementing enterprise data platforms
  • At least 5 years of hands-on experience hands-on Azure Databricks experience in enterprise environments
  • Experience with architecting modern Lakehouse solutions using Azure Databricks and Delta Lake
  • Experience in administering Azure Databricks workspaces, clusters, Unity Catalog, compute policies, job orchestration, and workspace security
  • Experience in developing data engineering solutions using Apache Spark (PySpark and/or Spark SQL)
  • Experience in implementing enterprise data governance utilizing Unity Catalog, metadata management, data lineage, and fine-grained access controls
  • Experience implementing Infrastructure as Code using Terraform and/or Bicep
  • Strong experience implementing CI/CD pipelines utilizing Azure DevOps, automated testing, release management, and deployment automation
  • Experience designing and working with enterprise security architectures including RBAC, Managed Identities, Private Endpoints, Key Vault integration, encryption, and network security
  • Experience implementing enterprise data quality frameworks, monitoring, observability, and operational dashboards
  • Strong understanding of data modelling techniques including dimensional modelling, Data Vault, medallion architecture, and enterprise data warehouse concepts
  • Strong knowledge of Azure Data Lake Storage Gen2, Azure Data Factory, Azure Event Hub, Azure SQL Database, Azure Key Vault, Azure Monitor, Microsoft Entra ID (Azure AD), and Azure networking
  • Strong SQL programming skills and proficiency in Python and PySpark development
  • Preferred: Knowledge of AI/ML workloads, Databricks ML, Feature Store, Model Serving, and Generative AI architectures is considered an asset
  • Preferred: Experience with Power BI, Microsoft Fabric, Synapse Analytics, or other enterprise analytics platforms is highly desirable
  • Preferred: Experience working within large international organizations, NGOs, or United Nations agencies is desirable
  • Preferred: The following certifications are desirable: Databricks Certified Platform, Architecture/Microsoft Azure Solution Architecture Expert/Databricks, Certified Data Engineer Associate/Professional
  • Excellent command of the English language

Benefits

  • Offer your services as part of a team of a major European Institution
  • Operating in an international, multilingual and multicultural environment
  • Real chances to make a difference
  • Competitive remuneration, based on qualifications and experience
  • Either on contract basis or remuneration with full benefits package
  • All applications will be treated as confidential

EUROPEAN DYNAMICS supplies software products and IT platforms for government and public-sector use internationally. Its offerings include systems for taxation, courts and judicial bodies, civil and business registries, financial regulatory authorities, electronic forms, and secure software distribution.

🇬🇷 GreeceSoftware, Information And Communication TechnologiesEnterpriseeurodyn.com/

What people say about this company

3.5/ 5

Salary not disclosed