> Markdown version of [/jobs/ext/3630966-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/3630966-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Madison-Davis, LLC - **Location:** Melrose Park, IL, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Agile Methodology, Airflow, Amazon S3, Apache HTTP Server, BigQuery, Cloud Database, Cloud Storage, Software Quality, Data Architecture, Information Engineering, Extract Transform Load (ETL), Data Systems, Fault Tolerance, Python (Programming Language), Machine Learning, Prometheus, Standard Sql, Service-Oriented Architecture, Simple Data Format, Data Streaming, Parquet, Datadog, Business Intelligence Development Studio, Macros, Google Data Studio, System Availability, Delivery Pipeline, Grafana, Change Data Capture, Backend, Event Driven Architecture, Data Lakes, Debezium, Kubernetes, Information Technology, Apache Flink, Avro, Data Analytics, Apache Kafka, Spark Streaming, Video Streaming, Terraform, Data Pipelines - **Published:** October 8, 2026 - **Apply:** https://www.disabledperson.com/jobs/75909409-senior-data-engineer ## About the Role * Bachelor's degree in Computer Science, Engineering, or a related field * 5+ years of experience in data engineering, platform engineering, or backend development * Strong SQL and Python skills for building and testing data solutions * Hands-on experience with GCP and its data products (BigQuery, Cloud SQL, Cloud Storage) * Experience with AWS services (S3, Glue, Athena, Kinesis) alongside GCP; EMR is a plus * Experience with CI/CD pipelines, infrastructure-as-code, and version-controlled deployment workflows (Terraform, GitOps) * Hands-on dbt experience building and maintaining projects - models, tests, macros, documentation, and CI * Proficiency with workflow orchestration tooling (Airflow, Prefect, or equivalent) * Working knowledge of data lake architecture, including file formats (Parquet, Avro) and open table formats (Apache Iceberg) * Familiarity with event-driven and service-oriented architecture * A track record of building automated, well-tested, observable data systems * Comfort working independently and collaboratively in a fast-paced Agile environment Bonus Points For * Hands-on Kubernetes experience, particularly with data workloads and containerized pipelines * Streaming technologies (Kafka, Spark Streaming, Flink) and comfort with high-volume, low-latency data flows * Change data capture tooling (Debezium, Kafka Connect) and real-time integration patterns * BI tooling such as Looker Studio or QuickSight * Observability and monitoring tooling (Datadog, Grafana, Prometheus) * Background in fintech, trading, or derivatives ## Description As a Senior Data Engineer on the Data & Analytics team, you will stay a step ahead of the people who depend on your work - providing the platform, tooling, and infrastructure that let analytics, product, and ML engineers ship solutions to real business problems. The scope goes well past pipeline maintenance: you will own data architecture, scalable workflows, and real-time solutions that support trading tools, product development, and machine learning. In This Role You Will * Design, build, and maintain resilient data pipelines and data lake architecture across both batch and real-time streaming use cases, including high-volume, low-latency processing * Strengthen observability, alerting, and SLOs across data systems so pipelines are easier to monitor and problems surface early * Optimize ETL/ELT workflows for performance, scalability, and fault tolerance * Build dbt workflows supporting partner onboarding and recurring end-of-day reporting * Build and support event-driven architectures and reusable platform components * Advance the orchestration and automation of workflows across the platform * Integrate complex financial APIs and third-party data sources into internal systems * Partner with analytics, product, and ML engineers to develop and deploy reliable data products * Build feature pipelines and model-ready datasets in support of machine learning work * Hold a high bar on code quality, testing, and platform reliability * Participate in Agile ceremonies and contribute to a collaborative, growth-oriented team culture