Senior IT Data Engineer

Diverse Agile Solutions
Washington, DC, United States
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Compensation
$145,600.0 - $170,560.0
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) JavaScript (Programming Language) Airflow Amazon Web Services Data Analysis Automation of Tests Microsoft Azure Big Data Cloud Computing Computer Programming Databases Continuous Integration
+41 more
Data Architecture Information Engineering Data Governance Data Infrastructure Data Integration Extract Transform Load (ETL) Data Systems Data Warehousing Linux DevOps Distributed Systems Perl (Programming Language) Github Graph Database Python (Programming Language) PostgreSQL Machine Learning Microsoft SQL Server MySQL NoSQL DataOps Data Streaming Workflow Management Systems Enterprise Data Management Data Processing Cloud Platform System Delivery Pipeline Snowflake Change Data Capture Gitlab Data Lakes Information Technology Deployment Automation Data Analytics Integration Frameworks Physical Data Models Cloud Migration Data Delivery Software Version Control Data Pipelines Programming Languages

Job description

The Senior IT Data Engineer will play a critical role in transforming how the Federal Reserve Board’s Division of Research & Statistics ingests, organizes, processes, and visualizes data. This position is responsible for designing, developing, and optimizing enterprise data architectures, scalable data pipelines, and advanced analytics platforms that support economists, researchers, and technical teams.

The ideal candidate is a hands-on data engineering professional with deep expertise in data modeling, database architecture, ETL/ELT development, cloud technologies, and enterprise-scale data solutions. This individual will help drive next-generation data initiatives while ensuring efficient, secure, and reliable data delivery across multiple platforms and environments., * Design, develop, and maintain enterprise data architectures, databases, and data integration solutions.

  • Build, optimize, and automate scalable ETL/ELT pipelines for structured and unstructured data sources.
  • Develop and maintain high-performance data processing frameworks supporting large-scale analytics workloads.
  • Design conceptual, logical, and physical data models aligned with business and research requirements.
  • Implement and manage data lake, data warehouse, and enterprise data platform solutions.
  • Collaborate with economists, researchers, and technical stakeholders to support data-driven research and policy initiatives.
  • Optimize data flow, storage, and processing architectures for performance, scalability, and reliability.
  • Perform root cause analysis on data and business processes to identify improvement opportunities.
  • Support migration of data pipelines and workflows between on-premises and cloud environments.
  • Develop and maintain DataOps practices, CI/CD pipelines, and automated deployment processes.
  • Ensure adherence to data governance, security, and architectural standards.
  • Evaluate emerging technologies and recommend innovative solutions to improve enterprise data capabilities.
  • Document technical solutions, architecture designs, and operational procedures., Programming & Analytics
  • Advanced proficiency in:
  • Python
  • R
  • Experience with additional programming languages such as:
  • Java
  • Scala
  • JavaScript
  • Perl

Data Processing & Orchestration

  • ETL/ELT workflow development and automation.
  • Distributed computing and large-scale data processing.
  • Workflow orchestration platforms such as:
  • Apache Airflow
  • Prefect
  • Dagster
  • AWS Step Functions

Cloud & Modern Data Platforms

  • Hands-on experience with:
  • AWS
  • Microsoft Azure
  • Snowflake
  • Cloud migration of data pipelines and workflows.
  • Enterprise data platform modernization initiatives.

DevOps & DataOps

  • CI/CD pipeline implementation and support.
  • GitLab and GitHub source control management.
  • Linux-based development environments.
  • Automated testing, deployment, and operational monitoring.

Requirements

Do you have experience in Version control?, Do you have a Master’s degree?, * Bachelor’s degree in Computer Science, Information Technology, Engineering, Data Science, or a related technical field.

  • Advanced degree (Master’s or Ph.D.) preferred.

Experience

  • Minimum of 7 years of professional experience in Data Engineering, Data Architecture, Database Administration, or related disciplines.
  • Proven experience designing and implementing enterprise-scale data solutions.
  • Experience supporting complex research, analytics, or data-intensive environments.
  • Strong ability to work independently while supporting multiple stakeholders and projects.

Required Technical Skills

Data Engineering & Architecture

  • Advanced SQL expertise.
  • Extensive experience with:
  • PostgreSQL
  • Microsoft SQL Server
  • MySQL
  • Data modeling and enterprise information architecture design.
  • Data lake and data warehouse architecture.
  • Change Data Capture (CDC) implementation and maintenance.
  • Data integration and pipeline automation., * Experience working with economic, financial, or research-oriented data environments.
  • Knowledge of time-series data analysis and forecasting methodologies.
  • Experience with NoSQL databases and graph database technologies.
  • Experience developing, training, deploying, and maintaining machine learning models.
  • Familiarity with advanced analytics, statistical modeling, and predictive analytics.
  • Experience supporting Federal Government agencies or highly regulated organizations.

Desired Competencies

  • Exceptional analytical and problem-solving skills.
  • Strong troubleshooting and root-cause analysis capabilities.
  • Excellent written and verbal communication skills.
  • Ability to communicate complex technical concepts to both technical and non-technical stakeholders.
  • Strong customer-service mindset and collaborative approach.
  • Self-motivated, detail-oriented, and results-driven professional.

Benefits & conditions

Pulled from the full job description

  • Opportunities for advancement, Why Join DAS?
  • Work on mission-critical initiatives supporting the Federal Reserve Board.
  • Collaborate with leading economists, researchers, and technology professionals.
  • Contribute to innovative data modernization and analytics programs.
  • Competitive compensation and benefits package.
  • Opportunities for professional growth and career advancement.
  • Hybrid work environment in the Washington, D.C. metropolitan area.

Equal Employment Opportunity

Diverse Agile Solutions (DAS) is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. Employment decisions are made without regard to race, color, religion, sex, national origin, age, disability, veteran status, or any other protected status under applicable federal, state, or local laws.

About the company

At Diverse Agile Solutions (DAS), we deliver innovative technology solutions that help government agencies and commercial organizations modernize operations, improve decision-making, and achieve mission success. We are seeking a highly skilled Senior IT Data Engineer to support the Federal Reserve Board’s Data Architecture, Technology, and Analytics (DATA) Section within the Division of Research & Statistics.

This is an exciting opportunity to contribute to the modernization of enterprise data architecture and analytics capabilities that support economic research, policy analysis, and data-driven decision-making at one of the nation’s most influential institutions.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:18 min

Scaling MySQL databases for massive user growth

Johannes Nicolai Johannes Nicolai +1 · LIVE

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

52 sec

Running persistent Linux environments directly on Windows

Ben Breard Ben Breard · WWC 2025

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

1:48 min

Analyzing network packets with database protocol tools

Daniël van Eeden Daniël van Eeden · WWC Europe 2026

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all