Перейти к основному содержимому
Inca Digital

Senior Data Engineer, Blockchain data and/or NLP pipelines

УдалённоUnited States только
Опубликовано
Роль
Инженерия данных
Опыт
Синьор
Зарплата не указана
Проверьте доступность

Доступно для: US only. Укажите, откуда вы работаете, чтобы проверить доступность.

Коротко по делу

Senior data engineer in the United States with advanced Python/SQL and production ETL/ELT experience. Must have deep expertise in either blockchain ledger data or NLP/LLM pipelines, plus working proficiency in the other. Needs Airflow/Dagster/Prefect/Step Functions-style orchestration, PostgreSQL/RDS, S3, APIs/dashboards, Docker, Git, CI/CD, and IaC.

Ключевые навыки

PythonSQLETL/ELT

Обязательные навыки

ETLELTAirflow/Dagster/Prefect/AWS Step FunctionsPostgreSQLAmazon RDSAmazon S3Kong OSS/FastAPIDockerGitCI/CDGitHub ActionsAWS CodeBuildAWS CodePipelineTerraform/AWS CDK

Желательные навыки

KafkaAWS SQSAWS SNSMongoDBClickHouseDuckDBSnowflakeAthena

Чем предстоит заниматься

  • Design, build, and operate end-to-end batch and incremental ETL/ELT pipelines, turning raw data into production-grade APIs, dashboards, and automated alerts.
  • High-throughput data acquisition from diverse sources: relational databases, third-party and vendor APIs, flat files, blockchain nodes and indexers, and social and web text at scale.
  • NLP and LLM-assisted processing over unstructured text — entity and claim extraction, classification, deduplication, and enrichment feeding downstream risk models.
  • Model and query data across relational, object, and graph (Neo4j) stores, choosing the right one for the access pattern rather than defaulting to a favorite.
  • Provenance and reproducibility: raw captures immutable, datasets versioned, and any published finding reproducible as of the date it was made.
  • Data quality as a first-class deliverable: validation, lineage, reconciliation, and freshness monitoring.
  • Partner with the Head of R&D, engineers, data scientists, and our investigations team to translate intelligence requirements into scalable client-facing products.
  • Contribute to technical design and architecture in a written, argued design process.

Что требуется

  • Direct, hands-on experience treating ledger data as standard data structures.
  • You have pulled from RPC endpoints, archive nodes, or indexers; decoded logs and ABIs; managed chain reorgs and protocol edge cases; and applied UTXO vs. account-based models in production environments.
  • Proven track record shipping production-grade text processing workflows—including extraction, classification, embeddings, vector search, or LLM-in-the-loop enrichment.
  • You possess a clear, practical understanding of model evaluation, cost optimization, and failure mode mitigation.
  • Deep expertise in one of Blockchain Data or NLP & LLMs, and working proficiency in the other.
  • Advanced Python and SQL.
  • Proven experience building and operating production ETL/ELT pipelines under an orchestrator (Airflow, Dagster, Prefect, Step Functions, or equivalent), including backfills, idempotency, retries, schema drift, and on-call for your own pipelines.
  • Hands-on with PostgreSQL/RDS and object storage (S3).
  • Serving data to consumers: building and versioning APIs (Kong OSS, FastAPI, or similar) and/or feeding dashboards.
  • Docker, Git, CI/CD (GitHub Actions, AWS CodeBuild/CodePipeline), and IaC (Terraform, CDK, or equivalent).
  • Preferred: Streaming and near-real-time architectures.
  • Preferred: Document stores and analytical engines or warehouses.
  • Preferred: Graph data modeling and querying.
  • Preferred: Transformation and data-quality tooling.
  • Preferred: Vector stores.
  • Preferred: Domain: Blockchain ledger data, smart contracts, or web3 languages.
  • Preferred: NLP techniques, LLM integrations, or model feature engineering.
  • Preferred: Financial services, trading venues, or regulatory frameworks (SEC, CFTC, FinCEN).
  • Preferred: OSINT, dark web, or social platform data collection.

Преимущества

  • Fully remote, high-trust environment.
  • Prioritize impact and delivered results over hours logged.
  • Competitive compensation.
  • Healthcare stipend.
  • Childcare stipends.
  • Dedicated employee assistance resources.
  • Join a thought leader at the intersection of national security and digital assets, working with cutting-edge tech that defines the field.

Inca Digital is a veteran-owned data and intelligence company specializing in digital-asset analytics for exchanges, financial institutions, regulators, and blockchain ecosystems.

CryptoСтартапincadigital.com/
Зарплата не указана