> Markdown version of [/jobs/ext/2589017-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/2589017-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer - **Company:** ClinDCast LLC - **Location:** Warsaw, IN, United States - **Experience:** Expert - **Salary:** $114,400.0 - $124,800.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Amazon Web Services, Automation of Tests, Microsoft Azure, Big Data, Cloud Database, Computer Programming, Continuous Integration, Data Architecture, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Systems, Data Warehousing, DevOps, Python (Programming Language), Metadata, Cloud Services, DataOps, Data Streaming, Enterprise Data Management, Data Logging, Data Processing, Google Cloud, Cloud Platform System, System Availability, Snowflake, Change Data Capture, Data Lakes, Semi-structured Data, Star Schema, Google Bigquery, Real Time Data, Data Management, Stream Processing, Azure Synapse Analytics, Data Pipelines, Amazon Redshift - **Published:** August 2, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=76ef5b2015775267 ## About the Role * Advanced expertise in designing and developing ETL/ELT pipelines. * Strong experience with batch data processing and near real-time/streaming data pipelines. * Hands-on experience working with structured and semi-structured data. * Strong knowledge of: + Incremental data loading + Change Data Capture (CDC) + Pipeline orchestration and dependency management * Strong programming skills in Python (preferred), Scala, or Java. * Experience optimizing large-scale data processing workloads for performance and cost. * Solid understanding of data modeling concepts: + Star Schema + Snowflake Schema + Normalized and denormalized data models * Hands-on experience with at least one major cloud platform: + Microsoft Azure + Amazon Web Services (AWS) + Google Cloud Platform (GCP) * Strong experience with modern data warehouses such as: + Snowflake + Azure Synapse + Google BigQuery + Amazon Redshift, * Experience with modern DataOps and CI/CD practices. * Knowledge of data governance, security, and compliance frameworks. * Experience designing enterprise-scale cloud-native data platforms. * Strong analytical, troubleshooting, and communication skills. ## Description We are seeking an experienced Data Engineering Architect / Lead Data Engineer to design, build, and optimize scalable data platforms and pipelines. The ideal candidate will have extensive experience in ETL/ELT development, cloud-based data engineering, real-time and batch data processing, and modern data warehouse architectures. This role requires strong expertise in designing end-to-end data solutions that are scalable, secure, and aligned with enterprise standards., Data Architecture & Solution Design * Design end-to-end data engineering architectures for enterprise-scale solutions. * Develop scalable architectures for: + Data Lakes and Lakehouse platforms + Enterprise Data Warehouses + Streaming and real-time data processing systems * Ensure solutions align with enterprise architecture, security, governance, and compliance standards. * Review and approve technical designs and implementation strategies. Data Pipeline Development & Management * Lead the design and development of scalable ETL/ELT pipelines. * Build and manage data ingestion pipelines for both batch and real-time data. * Process structured and semi-structured data efficiently. * Optimize data pipelines for performance, reliability, scalability, and cost. * Manage schema evolution, metadata, and pipeline dependencies. Data Quality, Reliability & Operations * Establish and enforce data quality standards and validation frameworks. * Implement monitoring, alerting, logging, and observability for data pipelines. * Perform root cause analysis and resolve data-related production issues. * Drive operational excellence by improving system stability and reliability. DevOps / DataOps * Build and maintain CI/CD pipelines for data engineering workloads. * Automate testing, deployment, and rollback processes. * Improve platform reliability and deployment efficiency through automation and DevOps best practices. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [A Data Mesh needs Open Metadata](https://www.wearedevelopers.com/videos/505-a-data-mesh-needs-open-metadata) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) - [Crafting Custom Frameworks with Rust: A Deep Dive into Procedural Macros](https://www.wearedevelopers.com/videos/849-crafting-custom-frameworks-with-rust-a-deep-dive-into-procedural-macros) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)