> Markdown version of [/jobs/ext/189082-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/189082-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** ABSENTIA LABS INC. - **Location:** Austin, TX, United States - **Experience:** Expert - **Salary:** $115,000.0 - $200,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Amazon Web Services, Microsoft Azure, Information Engineering, Data Integrity, Data Systems, Distributed Computing Environment, Experimental Data, Python (Programming Language), Machine Learning, Cloud Services, Software Engineering, Management of Software Versions, Apache Spark, Data Lakes, Kubernetes, Apache Kafka, Free and Open-Source Software, Machine Learning Operations, Terraform, Stream Processing, Data Pipelines, Docker - **Published:** May 19, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=b8021ad4fe6bcc63 ## About the Role * 5+ years of experience in data engineering, platform engineering, or ML infrastructure roles, with clear ownership of production systems. * Proven experience designing and operating large-scale, production-grade data pipelines. * Strong proficiency in Python and data-centric software engineering practices. * Deep experience with cloud platforms (AWS, GCP, or Azure), including storage, compute, and security primitives. * Familiarity with distributed data processing and orchestration systems (e.g., Spark, Beam, Ray, Airflow, Dagster). * Experience supporting ML/AI workloads, including dataset generation, feature pipelines, and reproducible training workflows. * Strong architectural judgment and the ability to communicate technical decisions clearly across disciplines., * Prior work with biomedical or life-science data (e.g., omics, assays, molecular representations, clinical or toxicology data). * Experience with streaming platforms (Kafka, Pub/Sub, Kinesis). * Exposure to ontology-aware data modeling or schema evolution in scientific domains. * Infrastructure-as-code and systems experience (Terraform, Docker, Kubernetes). * Experience in early-stage startups or research-heavy environments. * Open-source contributions or technical publications. ## Description As a Senior Data Engineer, you will own the design and evolution of Absentia Labs' biomedical data platform. You will operate with a high degree of autonomy, making long-horizon architectural decisions while remaining hands-on in implementation. This role is ideal for an engineer who enjoys working in high-ambiguity, research-driven environments, and who understands that data engineering for AI is as much about representation and correctness as it is about scale. What You'll Do * Architect and lead the design of end-to-end data systems for large-scale biomedical datasets (chemical, biological, toxicology, omics, assay, clinical, and experimental data). * Define and evolve schema-driven data models that reconcile noisy, semi-structured, and heterogeneous sources into coherent, interoperable representations. * Establish best practices for data quality, validation, provenance, lineage, and versioning suitable for scientific and ML workflows. * Build and maintain cloud-native data infrastructure (data lakes, warehouses, object storage, streaming systems) with an emphasis on scalability and reliability. * Design pipelines that support both batch and streaming access for ML training, evaluation, and inference. * Partner closely with ML engineers, scientists, and product leads to translate research needs into durable data abstractions. * Make principled trade-offs around performance, cost, flexibility, and correctness in production systems. * Provide technical leadership through design reviews, architectural guidance, and mentorship of other engineers. * Identify and proactively address systemic risks in data integrity, scalability, and operational complexity. Who You Are You are a data engineer who thinks in systems and interfaces, not just pipelines. You are comfortable owning poorly defined problems and converging on robust solutions through thoughtful design and iteration. You understand that biomedical data is rarely "clean," and that schema design, normalization, and semantics are first-order engineering problems-especially in AI-driven settings. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Implementing Feature Environments with AWS and Terraform](https://www.wearedevelopers.com/videos/531-implementing-feature-environments-with-aws-and-terraform) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)