> Markdown version of [/jobs/ext/2012305-it-data-engineer](https://www.wearedevelopers.com/jobs/ext/2012305-it-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# IT Data Engineer

- **Company:** Diverse Agile Solutions
- **Location:** Washington, DC, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), JavaScript (Programming Language), Agile Methodology, Artificial Intelligence, Airflow, Amazon Web Services, Data Analysis, Apache HTTP Server, Microsoft Azure, Big Data, Cloud Computing, Cloud Engineering, Configuration Management, Code Review, Information Systems, Computer Programming, Databases, Continuous Delivery, Continuous Integration, Data Architecture, Information Engineering, Data Files, Data Governance, Data Integration, Extract Transform Load (ETL), Data Migration, Data Systems, Data Warehousing, Relational Databases, Linux, Perl (Programming Language), Github, R (Programming Language), Graph Database, Internet Security, Python (Programming Language), PostgreSQL, Machine Learning, Microsoft SQL Server, MySQL, NoSQL, Performance Tuning, Systems Development Life Cycle, Standard Sql, DataOps, Software Engineering, SQL Databases, Unstructured Data, Workflow Management Systems, Enterprise Data Management, Data Processing, Scripting, Snowflake, Database Optimization, Database Performance, Change Data Capture, Gitlab, Data Lakes, Linux Development, Kubernetes, Information Technology, Data Lineage, Deployment Automation, Enterprise Integration, Integration Frameworks, Data Management, Multiplatform, Software Version Control, Data Pipelines, Programming Languages
- **Published:** August 10, 2026
- **Apply:** https://www.careerbuilder.com/job-details/senior-it-data-engineer-washington-dc--d013aaea-75ca-4e93-b711-ca806c2fadd9

## About the Role

* Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline.
 * Minimum of 7 years of professional experience in Data Engineering, Data Architecture, or related disciplines.
 * Advanced knowledge of SQL and relational database platforms including:
 + PostgreSQL
 + Microsoft SQL Server
 + MySQL
 * Advanced programming experience with:
 + Python
 + R
 + Data engineering scripting languages
 * Extensive experience designing scalable data architectures.
 * Strong experience developing ETL/ELT pipelines.
 * Experience building enterprise data integration solutions.
 * Experience with workflow orchestration technologies including:
 + Apache Airflow
 + Prefect
 + Dagster
 + AWS Step Functions
 * Experience processing structured and unstructured datasets.
 * Experience with Linux development environments.
 * Experience using GitLab and/or GitHub source control.
 * Strong understanding of enterprise information architecture principles.
 * Excellent analytical, troubleshooting, and problem-solving skills.
 * Outstanding written and verbal communication skills.
 * Ability to work independently while supporting multiple technical teams.

Preferred Qualifications

Candidates possessing one or more of the following will be highly preferred:

 * Master's degree in Computer Science or related field
 * Experience supporting Federal Government agencies
 * Experience working with economic or financial data
 * Experience within research organizations
 * Experience with time-series data analysis
 * Experience implementing enterprise data lakes
 * Experience with NoSQL databases
 * Experience with Graph databases
 * Experience developing Machine Learning models
 * Experience implementing Change Data Capture (CDC)
 * Experience building enterprise Data Warehouse solutions
 * Experience implementing CI/CD pipelines for DataOps
 * Experience with Snowflake
 * Experience with AWS Cloud
 * Experience with Microsoft Azure
 * Experience with Java
 * Experience with Scala
 * Experience with JavaScript
 * Experience with Perl

Technical Environment

 * Python
 * SQL
 * PostgreSQL
 * Microsoft SQL Server
 * MySQL
 * AWS
 * Azure
 * Snowflake
 * Apache Airflow
 * Prefect
 * Dagster
 * AWS Step Functions
 * GitLab
 * GitHub
 * Linux
 * Data Lakes
 * ETL
 * ELT
 * Data Warehousing
 * CDC
 * Machine Learning
 * NoSQL
 * Graph Databases
 * CI/CD
 * DataOps, Agile Programming Methodologies, Amazon Web Services (AWS), Analysis Skills, Apache, Artificial Intelligence (AI), Automation, Centers for Disease Control and Prevention (CDC), Cloud Architecture, Cloud Computing, Code Reviews, Communication Skills, Computer Science, Consulting, Continuous Deployment/Delivery, Continuous Improvement, Continuous Integration, Cross-Functional, Data Analysis, Data Collection, Data Management, Data Migration, Data Modeling, Data Processing, Data Quality, Data Sets, Data Warehousing, Database Extract Transform and Load (ETL), Database Optimization, Enterprise Architecture, Enterprise Data Integration, Federal Government, GitHub, Identify Issues, Information Architecture, Information Technology & Information Systems, Internet Security, Java, JavaScript, Linux Operating System, Machine Learning, Microsoft SQL Server, Microsoft Windows Azure, Multiplatform/Cross-Platform, MySQL, NoSQL, Operational Strategy, Organizational Skills, Performance Tuning/Optimization,
Perl Programming Language, PostgreSQL, Presentation/Verbal Skills, Problem Solving Skills, Process Capability, Python Programming/Scripting Language, R Programming Language, Relational Databases (RDBMS), Root Cause Analysis, SQL (Structured Query Language), SQL Databases, Scala Programming Language, Scalable System Development, Scripting (Scripting Languages), Software Engineering, Source Code/Configuration Management (SCM), Statistics, Structured Data, Team Player, Technical Delivery, Technical Research, Technical Support, Technical/Engineering Design, Time Series Analysis, United States Citizen, Unstructured Data, Writing Skills

## Description

Diverse Agile Solutions is seeking a highly experienced Senior IT Data Engineer to support the Federal Reserve Board's Division of Research & Statistics (R&S) within the Data Architecture, Technology, and Analytics (DATA) organization.

This individual will play a critical role in transforming how enterprise data is ingested, modeled, organized, processed, and delivered across research and economic policy teams. The ideal candidate combines deep technical expertise in data engineering, enterprise data architecture, and cloud technologies with a passion for building scalable, high-performance data platforms.

This position requires an experienced professional who enjoys designing modern data architectures, optimizing complex data pipelines, and enabling advanced analytics for mission-critical research initiatives., * Design, develop, and maintain enterprise-scale data architectures supporting research and analytics initiatives.

 * Build and optimize scalable ETL/ELT pipelines for structured and unstructured data.
 * Develop high-performance data integration solutions across multiple enterprise platforms.
 * Design logical and physical data models supporting enterprise information architecture.
 * Build scalable databases, data lakes, and enterprise data platforms.
 * Optimize database performance and large-scale data processing environments.
 * Design workflow automation using orchestration platforms such as Apache Airflow, Prefect, Dagster, or AWS Step Functions.
 * Develop and maintain cloud-based data engineering solutions within AWS and Azure environments.
 * Migrate data pipelines between on-premises and cloud infrastructures.
 * Support economists, researchers, and technical teams with reliable, high-quality data solutions.
 * Perform root cause analysis of data quality issues and recommend long-term improvements.
 * Develop CI/CD pipelines supporting DataOps and automated deployment practices.
 * Collaborate with cross-functional teams to improve enterprise data governance and operational efficiency.
 * Design scalable data processing frameworks capable of supporting large analytical workloads.
 * Document enterprise data architecture, data lineage, and technical designs.
 * Participate in code reviews, testing, deployment, and continuous improvement activities.


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker)
- [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis)
- [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of)
- [Docker exec without Docker](https://www.wearedevelopers.com/videos/1094-docker-exec-without-docker)
- [NoSQL Data Modeling for Front-end Developers](https://www.wearedevelopers.com/videos/297-nosql-data-modeling-for-front-end-developers)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)