Senior Data Engineer, Blockchain data and/or NLP pipelines

Inca Digital, Inc.
United States
24 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Airflow Amazon Web Services Amazon S3 Continuous Integration Data Deduplication Extract Transform Load (ETL) Data Structures Relational Databases Text Processing Github Intelligence Analysis
+30 more
Python (Programming Language) PostgreSQL Microsoft Message Queuing MongoDB Natural Language Processing Neo4j Open Source Intelligence Raw Data Blockchain Search Technologies SQL Databases Data Streaming Unstructured Data Management of Software Versions Feature Engineering Delivery Pipeline Large Language Models Snowflake Model Validation Git Fastapi Kubernetes Solidity Apache Kafka Web3.js Bitcoin Vertica Terraform Data Pipelines Docker

Job description

About Us: Inca Digital is a veteran-owned data and intelligence company specializing in digital-asset analytics for exchanges, financial institutions, regulators, and blockchain ecosystems. Our technology and expertise provide clarity across crypto markets, tracking blockchain transactions, liquidity movements, and illicit finance, helping clients identify risk, enhance transparency, and improve decision-making. Inca’s infrastructure fuses structured and unstructured data from blockchains, exchanges, social networks, and financial markets. The result is a powerful analytics engine that supports ecosystem monitoring, market surveillance, and counter-illicit finance intelligence across digital-asset networks. Inca operates as a fast-paced, nimble, global, and remote technology company. We leverage an asynchronous-first workflow, try to minimize time spent on meetings, and believe in open debate and logic over authority. Work alongside some of the sharpest minds in the world, including intelligence analysts, defense veterans, data engineers, quant researchers, linguists, and more.

Domain Expertise

  • Blockchain Data: Direct, hands-on experience treating ledger data as standard data structures. You have pulled from RPC endpoints, archive nodes, or indexers; decoded logs and ABIs; managed chain reorgs and protocol edge cases; and applied UTXO vs. account-based models in production environments.
  • NLP & LLMs: Proven track record shipping production-grade text processing workflows-including extraction, classification, embeddings, vector search, or LLM-in-the-loop enrichment. You possess a clear, practical understanding of model evaluation, cost optimization, and failure mode mitigation.

We expect deep expertise in one of these domains and working proficiency in the other. Please highlight your primary focus area in your application.

What You’ll Own

  • Design, build, and operate end-to-end batch and incremental ETL/ELT pipelines, turning raw data into production-grade APIs, dashboards, and automated alerts.
  • High-throughput data acquisition from diverse sources: relational databases, third-party and vendor APIs, flat files, blockchain nodes and indexers, and social and web text at scale.
  • NLP and LLM-assisted processing over unstructured text - entity and claim extraction, classification, deduplication, and enrichment feeding downstream risk models.
  • Model and query data across relational, object, and graph (Neo4j) stores, choosing the right one for the access pattern rather than defaulting to a favorite.
  • Provenance and reproducibility: raw captures immutable, datasets versioned, and any published finding reproducible as of the date it was made.
  • Data quality as a first-class deliverable: validation, lineage, reconciliation, and freshness monitoring.
  • Partner with the Head of R&D, engineers, data scientists, and our investigations team to translate intelligence requirements into scalable client-facing products.
  • Contribute to technical design and architecture in a written, argued design process., * Streaming and near-real-time architectures (Kafka, AWS SQS/SNS).
  • Document stores (MongoDB) and analytical engines or warehouses (ClickHouse, DuckDB, Snowflake, Athena).
  • Graph data modeling and querying (Neo4j/Cypher or comparable).
  • Transformation and data-quality tooling (dbt, Great Expectations, Soda, OpenLineage).
  • Vector stores (pgvector, Qdrant, OpenSearch).
  • Go; Kubernetes.
  • Domain: *

  • Blockchain ledger data, smart contracts, or web3 languages (Solidity, Vyper, Go, Bitcoin Script)
  • NLP techniques, LLM integrations, or model feature engineering
  • Financial services, trading venues, or regulatory frameworks (SEC, CFTC, FinCEN)
  • OSINT, dark web, or social platform data collection

Requirements

  • Advanced Python and SQL.
  • Proven experience building and operating production ETL/ELT pipelines under an orchestrator (Airflow, Dagster, Prefect, Step Functions, or equivalent), including backfills, idempotency, retries, schema drift, and on-call for your own pipelines.
  • Hands-on with PostgreSQL/RDS and object storage (S3).
  • Serving data to consumers: building and versioning APIs (Kong OSS, FastAPI, or similar) and/or feeding dashboards.
  • Docker, Git, CI/CD (GitHub Actions, AWS CodeBuild/CodePipeline), and IaC (Terraform, CDK, or equivalent).

Benefits & conditions

  • We offer competitive compensation and healthcare stipend.
  • We invest in our people through childcare stipends and dedicated employee assistance resources.
  • Join a thought leader at the intersection of national security and digital assets, working with cutting-edge tech that defines the field.

Curious about how we build at Inca Digital? Hear directly from our Head of R&D on how our team builds the infrastructure that powers Inca’s intelligence, merging financial, natural language, and blockchain data into custom dashboards and automation tools built around each client’s needs.

Watch on YouTube: Inside Inca The Engine Behind Inca’s Intelligence

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:24 min

Comparing Neo4j and GraphQL conceptual models

William Lyon · LIVE

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

47 sec

Building modern data pipelines for legacy exports

Dr. Alexander Wachtel Dr. Alexander Wachtel +1 · World Congress 2025

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

Videos

See all

Related articles

See all