> Markdown version of [/jobs/ext/1465757-data-engineer](https://www.wearedevelopers.com/jobs/ext/1465757-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Smart Synergies - **Location:** Bethesda, MD, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Agile Methodology, Amazon Web Services, Amazon S3, Data Analysis, Automation of Tests, Business Intelligence Development, Code Review, Information Systems, Continuous Integration, Data Architecture, Data Validation, Data Cleansing, Information Engineering, Data Governance, Data Integration, Data Systems, Data Warehousing, Dimensional Modeling, Distributed Data Store, Github, Python (Programming Language), Meta-Data Management, Performance Tuning, Scrum Methodology, Power BI, Shell Script, Software Deployment, SQL Databases, Delivery Pipeline, Apache Spark, Cloudformation, Data Lakes, Pyspark, Core Data, Information Technology, Data Lineage, Collibra, Star Schema, AWS Data Analytics, Bitbucket, Oracle Ebusiness, Amazon Simple Queue Service (SQS), Terraform, Data Pipelines - **Published:** July 28, 2026 - **Apply:** https://www.dice.com/job-detail/d19a2b54-bc23-45fb-8230-da8a87eb5a7a ## About the Role * Bachelor's degree in Computer Science, Information Systems, Engineering, or a related discipline, or equivalent practical experience. * At least 7 years of experience in data engineering, with strong hands-on expertise in AWS services and distributed data technologies. * Advanced proficiency in Python and SQL, including experience with Spark/PySpark. * Proven experience building and maintaining AWS-based data pipelines using services such as Glue, Step Functions, Lambda, S3, Athena, SNS, SQS, and Redshift. * Experience with event-driven data architectures. * Hands-on experience processing and managing large-scale vendor data feeds. * Practical knowledge of Medallion architecture within a data lake or Lakehouse environment. * Experience using Terraform for infrastructure-as-code deployments. * Familiarity with CI/CD tools such as Bitbucket, GitHub, or AWS CodePipeline for pipeline deployment. * Strong understanding of data warehousing principles, including star schema design, dimensional modeling, and slowly changing dimensions (SCD). * Experience integrating data with Power BI or comparable business intelligence tools. * Working knowledge of UNIX/Linux environments, including shell scripting. * Experience supporting production systems, including monitoring, troubleshooting, and on-call responsibilities. * Familiarity with Agile development methodologies., * Experience integrating data from Oracle EBS. * Familiarity with data quality tools such as Great Expectations or dbt testing frameworks. * Experience with AWS CDK or CloudFormation alongside Terraform. * Knowledge of data cataloging and lineage tools such as Alation or Collibra. * AWS certifications (e.g., AWS Certified Data Engineer, AWS Certified Solutions Architect). ## Description We are looking for a driven and hands-on Data Engineer to design, implement, and support scalable, production-level data pipelines within our AWS-based data ecosystem. This position is responsible for full lifecycle pipeline delivery-from ingesting data from enterprise systems to producing analytics-ready datasets-while collaborating closely with Data Architects, Analytics teams, and business partners. The role is critical in ensuring reliable, high-quality data is available across the organization to power analytics and informed decision-making. As a member of the core data platform team, you will also contribute to advancing our AWS Lakehouse architecture and establishing engineering best practices., * Pipeline Engineering: Develop and maintain scalable ELT pipelines using reusable ingestion frameworks that support both batch and event-driven processing across multiple data sources such as ERPs, APIs, vendor feeds, and relational systems. * AWS Data Platform Development: Design and enhance AWS-native data solutions aligned with a Medallion (Bronze/Silver/Gold) Lakehouse architecture, with an emphasis on performance optimization and cost management. * Infrastructure & DevOps: Build and manage AWS infrastructure using Terraform, and support CI/CD processes through GitOps methodologies, including automated testing, monitoring, alerting, and system recovery capabilities. * Data Modeling & Transformation: Create and maintain dimensional models and Gold-layer datasets using SQL, Python, and PySpark. Implement scalable ingestion processes with strong handling of schema evolution, auditing, and performance tuning techniques such as partitioning, clustering, and materialization. * Data Quality & Governance: Integrate automated data validation, anomaly detection, and lineage tracking into pipelines, while contributing to metadata management practices. * Reporting & BI Enablement: Diagnose and resolve complex data issues, ensuring pipelines deliver data optimized for Power BI. Work closely with BI developers to align data models with reporting needs and troubleshoot dashboard-related challenges. * Cross-Functional Collaboration: Partner with architecture and analytics teams to translate business requirements into technical solutions, and actively participate in code reviews, sprint planning, and architectural discussions. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)