> Markdown version of [/jobs/ext/4563812-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/4563812-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Gravie - **Location:** United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Artificial Intelligence, Amazon Web Services, Amazon S3, Apache HTTP Server, Unix, Command-Line Interface, Software as a Service, Information Systems, Databases, Continuous Integration, Data Discovery, Information Engineering, Data Security, Software Debugging, Programming Tools, Distributed Data Store, Protocol Buffers, Java Virtual Machine (JVM), Python (Programming Language), Operational Data Store, Online Transaction Processing, Operational Databases, SQL Databases, Data Streaming, Datadog, AWS Cdk, Transaction Processing (Computing), Model Validation, Change Data Capture, Data Lakes, Debezium, Information Technology, Collibra, Apache Flink, Avro, Apache Kafka, Data Management, Cloudwatch, Restful APIs, Terraform, Stream Processing, Data Pipelines - **Published:** November 4, 2026 - **Apply:** https://www.careerbuilder.com/job-details/senior-data-engineer--1b650140-ce42-48b3-91c6-cc4886cb7e56 ## About the Role Model Validation, Centers for Disease Control and Prevention (CDC), Software as a Service (SaaS), Transaction Processing/Management, Standards Development, Apache, Data Quality, Data Management, Amazon Web Services (AWS), Continuous Integration, You are self-driven, calm under production pressure, and comfortable owning streaming systems in a regulated environment., * 6+ years building and operating production data systems, including demonstrated ownership of streaming or event-driven pipelines - on-call, incident response, SLOs, runbooks, and recovery, not just development. * Deep, production experience with Apache Kafka (MSK preferred) - partitioning, consumer groups, idempotent semantics, Kafka Connect, and replay/backfill under load. * Strong, hands-on production experience with Apache Flink or a comparable stateful stream processor, in Java or another JVM language - state management, checkpointing, watermarks, and exactly-once sinks. * AWS-native data engineering across streaming, processing, storage, and catalog services (e.g. MSK, EMR, Glue, S3, Athena), with infrastructure-as-code - AWS CDK (preferred) or Terraform - CI/CD for data pipelines, and cost awareness. * Comfort debugging distributed data pipelines (consumer lag, data skew, backpressure, checkpoint failures, late/out-of-order events) with observability tooling (e.g. Datadog/CloudWatch). * SQL and Python, and experience building and consuming REST APIs. * An AI-forward engineering mindset, with demonstrated hands-on use of AI-assisted and agentic development tools, an opinion on where AI adds value (and where it doesn't), and an understanding of agentic data consumption patterns of trusted operational data - including context management, lineage, provenance, permissions, freshness. * Change data capture and open table formats - CDC (e.g. Debezium) plus Iceberg or Delta Lake: schema evolution, partitioning, and table maintenance. * Data contracts and schema governance - schema registries and technical metastore (e.g. Glue Data Catalog, Unity Catalog), compatibility rules, Avro or Protobuf, and dead-letter handling. * Degree in Computer Science, Information Systems or another quantitative field, and comfort on the command line / a Unix-based OS (we are 100% Mac+Linux at Gravie). * Excellent communication skills and demonstrated success in driving results through influence and collaboration. Extra Credit: * Health insurance domain knowledge, including HIPAA Protected Health Information (PHI) and compliance frameworks governing it. * Familiarity with serving data to AI and agentic consumers - exposing canonical data as low-latency context or inputs for automated/agentic workloads. * Experience with a governance & data discovery catalog (e.g. Atlan, Alation, Collibra). * Previous venture-backed start-up company experience. ## Description Share full-lifecycle ownership of the streaming platform - architecture, implementation, production operations. * Run the platform in production: own latency/throughput SLOs, monitoring and alerting (e.g. Datadog) - including replays, per-source backfills, connector-failure recovery, Flink checkpoint/savepoint recovery, dead-letter triage, and tuning for spiky load from batch-driven upstream sources. * Build and extend streaming pipelines that ingest CDC events from OLTP databases and SaaS sources into canonical, contract-validated form, and define standards to govern changes to them over time. * Transform and enrich in Apache Flink, including stateful processing and cross-stream joins that correlate events into unified lifecycle entities, with event-time handling for late and out-of-order data. * Enable secure, governed data access over PHI: classification and row/column controls applied as data is served to consumers, in partnership with Security and Compliance. * Make it reliable and observable: idempotent/replayable pipeline design, data-quality validation, runbooks, and observability the broader data team can rely on. * Provision as code: define the platform (streaming, processing, storage, and catalog services on AWS) in CDK with CI/CD for data pipelines, and right-size for cost against the latency SLO. * Partner across teams: work with upstream producers on source changes and contracts, with downstream consumers on access and data needs, and with stakeholders to turn requirements into what the platform delivers. * Demonstrate commitment to our core competencies of being authentic, curious, creative, empathetic and outcome oriented.