> Markdown version of [/jobs/ext/2065503-senior-data-engineer-id71671](https://www.wearedevelopers.com/jobs/ext/2065503-senior-data-engineer-id71671). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer ID71671 - **Company:** AGILE ENTERPRISES LLC - **Location:** Baltimore, MD, United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Query Performance, Application Programming Interfaces (APIs), Airflow, Amazon Web Services, Automation of Tests, Microsoft Azure, Continuous Integration, Data Architecture, Data Validation, Data Integrity, Extract Transform Load (ETL), Data Transformation, Data Stores, Data Warehousing, Database Design, Software Design Patterns, DevOps, Python (Programming Language), Object-Oriented Software Development, Package Management Systems, Query Optimization, DataOps, Software Engineering, Data Streaming, Systems Integration, Workflow Management Systems, Freeform SQL, Sql Optimization, Snowflake, Data Build Tool (dbt), Git, Event Driven Architecture, Containerization, Core Data, Integration Tests, Infrastructure Automation Frameworks, Data Lineage, Apache Kafka, Restful APIs, Software Version Control, Data Pipelines, Docker - **Published:** August 15, 2026 - **Apply:** https://www.careerjet.com/job/us701b8794742bc32027e668f85b2b32e1/eaa ## About the Role If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!, You must be authorized to work for ANY employer in the US (e.g., Green card holders, TN visa holders, GC EAD, H4 EAD, U4U with EAD), as we are unable to sponsor or take over employment visa sponsorship at this time; - 4+ years of experience as a Data Engineer. - Core Python Fundamentals: Demonstrable expertise writing modular, maintainable, and well-tested Python code (OOP/functional patterns, package management, standard testing frameworks). - Advanced SQL & Modeling: Deep knowledge of complex SQL queries, query optimization, database design principles, and normalization/denormalization patterns. - Data Warehousing: Solid, hands-on experience building, managing, and optimizing data architectures within Snowflake. - Workflow Orchestration: Production experience using workflow orchestration engines like Apache Airflow, Prefect, or Dagster. - Integrations & Ingestion: Hands-on experience working with REST APIs, event-driven architectures, and both batch and streaming pipelines. - Data Quality & Lineage: Experience building automated data quality checks, data lineage, and alerting mechanisms (e.g., using tools like dbt test, Great Expectations, or similar). - DevOps / DataOps Practices: Strong skills in version control (Git), containerization (Docker), CI/CD automation, and familiarity with Infrastructure-as-Code basics. - Upper-intermediate English level. NICE TO HAVES - Experience with dbt (data build tool) for data transformations. - Familiarity with major cloud providers (AWS, GCP, or Azure). - Exposure to message streaming tech like Apache Kafka or AWS Kinesis. ## Description We are looking for a Senior Data Engineer to architect, build, and scale a modern data platform - designing production-grade ETL/ELT pipelines, optimizing Snowflake data warehouse schemas, and establishing robust DataOps practices. You will orchestrate workflows using Airflow, Prefect, or Dagster, implement data quality and lineage frameworks, integrate third-party REST APIs and event-driven sources, and apply software engineering standards including CI/CD, Docker, and automated testing to data repositories. The role prioritizes clean, well-tested Python code and a deep commitment to data reliability and accessibility. WHAT YOU WILL DO - Data Pipeline Development: Design, build, and maintain reliable, scalable ETL/ELT workflows that process batch and streaming data from diverse sources. - Data Warehousing & Modeling: Design efficient, production-ready schemas (normalized and denormalized) in Snowflake to optimize query performance and enable enterprise analytics. - API & Event Integration: Connect and ingest data from third-party REST APIs, event-driven streams, and batch sources into core data storage platforms. - Orchestration: Maintain and expand workflow orchestration pipelines using modern tools (Airflow, Prefect, or Dagster). - Data Quality & Observability: Implement automated testing, validation, lineage tracking, and proactive alerting frameworks to guarantee data accuracy and system uptime. - DataOps & Engineering Standards: Drive CI/CD best practices, maintain code bases using Git and Docker, and adopt basic Infrastructure-as-Code (IaC) patterns. - Code Excellence: Apply modern software engineering standards-including design patterns, automated unit/integration testing, and clear documentation-to data repositories. ## Related Videos - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Database DevOps with Containers](https://www.wearedevelopers.com/videos/145-database-devops-with-containers) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)