Перейти к основному содержимому
Innodata

Data Platform Engineer (GCP)

УдалённоCanada только
Опубликовано
Роль
Инженерия данных
Опыт
Мидл
Занятость
Полная занятость
Размер компании
Крупная
CAD 80k–CAD 150k/yr
Проверьте доступность

Доступно для: CA only. Укажите, откуда вы работаете, чтобы проверить доступность.

Коротко по делу

Mid-level Data/Platform engineer (3–7 years) for GCP production data platforms. Must have hands-on BigQuery, Cloud Spanner, Dataflow, Pub/Sub and Cloud Composer/Apache Airflow experience; strong Python and SQL. Remote — Canada only.

Ключевые навыки

BigQueryCloud SpannerApache Airflow

Обязательные навыки

DataflowPub/SubCloud ComposerCloud StorageCloud MonitoringCloud LoggingIAMPythonSQLTerraform

Желательные навыки

App EngineCloud RunGKECI/CD on GCPDevOps practices on GCPInfrastructure as CodeData observabilityVertex AI

Чем предстоит заниматься

  • Support and maintain production GCP data platforms, pipelines, and workflows across batch and streaming workloads.
  • Support production workflows orchestrated through Cloud Composer / Apache Airflow, including troubleshooting DAG failures, dependencies, scheduling issues, retries, and data-latency or SLA issues.
  • Optimize Airflow DAGs and orchestration workflows to improve reliability, execution time, recoverability, and operational efficiency.
  • Troubleshoot pipeline failures, data latency, performance degradation, configuration problems, and infrastructure-related issues.
  • Work extensively with Cloud Spanner, BigQuery, Dataflow, Pub/Sub, Cloud Composer (Apache Airflow), Cloud Storage, Cloud Monitoring and Logging, IAM, and related GCP services.
  • Monitor platform health and proactively improve reliability, scalability, performance, and operational efficiency.
  • Optimize existing pipelines and workloads to improve data refresh times, throughput, query performance, and platform stability.
  • Support platform, infrastructure, configuration, and dependency upgrades while maintaining production stability and compliance.
  • Perform root-cause analysis for recurring production issues and implement sustainable fixes.
  • Support IAM, access controls, monitoring, alerting, logging, and operational governance.
  • Collaborate with client and cross-functional Data Engineering, BI/Analytics, Application Engineering, Infrastructure, and Platform teams on production issues and enhancements.
  • Adapt to established client-specific engineering, security, compliance, review, and operational processes.
  • Review existing architectures and recommend incremental improvements without unnecessarily redesigning stable production systems.
  • Create and maintain technical documentation, operational runbooks, troubleshooting guides, and platform support procedures.

Что требуется

  • 3-7 years of experience in Data Engineering, Cloud Engineering, Platform Engineering, or a related role.
  • Strong hands-on experience building, supporting, or maintaining production workloads on Google Cloud Platform (GCP).
  • Strong experience with BigQuery and Cloud Spanner.
  • Hands-on experience with Dataflow, Pub/Sub, batch/streaming data pipelines, and Cloud Composer / Apache Airflow.
  • Strong Python and SQL skills.
  • Good understanding of GCP IAM, service accounts, permissions, monitoring, logging, alerting, and production operations.
  • Experience troubleshooting complex production environments and performing root-cause analysis.
  • Understanding of data ingestion, transformation, orchestration, data quality, performance optimization, and reliability.
  • Ability to quickly understand existing systems, codebases, pipelines, configurations, and client-specific tools and workflows.
  • Strong communication and collaboration skills across engineering and business teams.

Innodata (Nasdaq: INOD) is a global data engineering company providing data, evaluation frameworks, human expertise, solutions, platforms, and services for Generative AI / AI builders and adopters.

🇺🇸 Соединенные ШтатыAI DataКрупнаяinnodata.com/

Что говорят о компании

4.1/ 5

CAD 80k–CAD 150k/yr