> Markdown version of [/jobs/ext/445217-staff-data-engineer-platform-engineering](https://www.wearedevelopers.com/jobs/ext/445217-staff-data-engineer-platform-engineering). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Staff Data Engineer, Platform Engineering - **Company:** Datavant - **Location:** Columbus, OH, United States - **Experience:** Expert - **Salary:** $190,000.0 - $230,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Amazon Web Services, Big Data, Software Quality, Continuous Integration, Data Transformation, Data Security, Data Systems, Software Debugging, Distributed Computing Environment, Distributed Systems, Interoperability, Cloud Services, Software Engineering, Data Streaming, Workflow Management Systems, Cloud Platform System, Fast Healthcare Interoperability Resources, Snowflake, Apache Spark, Event Driven Architecture, Core Data, Infrastructure Automation Frameworks, Apache Flink, Production Code, Health Level Seven International, Apache Kafka, Terraform, Data Pipelines, Databricks - **Published:** June 5, 2026 - **Apply:** https://dejobs.org/x/x/62CD33736C9A4842A9CF54885B90A501/job/ ## About the Role * Strong candidates will have experience with several of the following: * Distributed data processing frameworks (e.g., Spark, Flink, or similar) * Cloud data platforms (e.g., Databricks, Snowflake, or equivalent) * Data transformation and modeling frameworks (dbt or equivalent) * Workflow orchestration systems (e.g., Airflow or similar) * Streaming and event-driven systems (e.g., Kafka or equivalent) * Infrastructure-as-code (e.g., Terraform) * Modern table formats and lakehouse architectures (e.g., Iceberg, Delta, or similar) What You Need to Succeed: * 10+ years of experience building data-intensive or distributed systems, with a strong software engineering foundation * Proven experience designing and operating large-scale data platforms in production * Deep expertise in distributed data processing systems (e.g., Spark or similar big data technologies) * Strong software engineering fundamentals, including system design, testing, CI/CD, and production debugging * Experience building systems in cloud environments (AWS preferred), including storage, compute, and security patterns * Experience designing multi-tenant systems, with a focus on isolation, scalability, and reliability * Strong understanding of data modeling, pipeline design, and data quality enforcement * Ability to navigate ambiguity, evaluate tradeoffs, and drive durable technical decisions * Track record of being a high-impact, hands-on contributor who leads through both design and execution What Helps You Stand Out: * Experience building data systems that support AI-driven use cases, including: * low-latency data access patterns * feature generation and ML data pipelines * iterative, feedback-driven data workflows * Familiarity with agentic or AI-assisted coding tools, and the ability to leverage them to improve development velocity and code quality * Comfort operating in environments where AI augments both system design and development workflows * Experience in regulated environments (e.g., healthcare, finance) * Familiarity with interoperability standards (e.g., FHIR, HL7, or similar) * Experience leading large-scale platform migrations or architectural transformations ## Description This is a hands-on technical leadership role for a software-oriented data engineer who combines strong architectural judgment with deep implementation expertise. You will define how complex data is processed, validated, and served-supporting analytics, product, and AI-driven use cases in a regulated environment. What You Will Do: * Lead the architecture and development of core data platform capabilities, including processing frameworks, storage patterns, and shared services * Design and implement multi-tenant, multi-cloud data systems with strong isolation, scalability, and operational durability * Build and operate large-scale distributed data processing systems across batch and real-time workloads * Define and evolve data lifecycle patterns, including ingestion, validation, transformation, enrichment, and serving * Establish data quality gates and validation frameworks to ensure trust, consistency, and auditability * Design systems that integrate with platform infrastructure, including CI/CD, deployment orchestration, observability, and infrastructure automation * Make sound architectural decisions across performance, cost, reliability, and maintainability tradeoffs * Lead ambiguous, high-impact initiatives where both problem definition and solution design require ownership * Contribute significantly to production code, setting standards for quality, testing, and operability ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers)