> Markdown version of [/jobs/ext/730146-sr-it-big-data-developer](https://www.wearedevelopers.com/jobs/ext/730146-sr-it-big-data-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Sr. IT Big Data Developer - **Company:** Diverse Agile Solutions - **Location:** Washington, DC, United States - **Experience:** Expert - **Salary:** $160,000.0 - $175,000.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), JavaScript (Programming Language), Agile Methodology, Airflow, Amazon Web Services, Data Analysis, Application Testing, Microsoft Azure, Big Data, Cloud Computing, Computer Programming, Databases, Continuous Integration, Data Architecture, Information Engineering, Data Integration, Extract Transform Load (ETL), Data Warehousing, Relational Databases, Linux, Digital Architecture, Digital Assets, Distributed Systems, Perl (Programming Language), Github, Graph Database, Python (Programming Language), PostgreSQL, Linux System Administration, Machine Learning, Microsoft SQL Server, MySQL, NoSQL, Standard Sql, DataOps, Software Engineering, SQL Databases, Enterprise Data Management, Data Processing, Cloud Platform System, Snowflake, Database Performance, Change Data Capture, Data Strategy, Gitlab, Data Lakes, Information Technology, Data Analytics, Integration Frameworks, Data Management, Physical Data Models, Software Version Control, Data Pipelines - **Published:** June 29, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=dba4bfa4195a614f ## About the Role Do you have experience in Version control?, * Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline. * Minimum 7 years of professional experience in Data Engineering, Data Architecture, or Big Data Development. * Advanced experience developing complex SQL solutions. * Extensive experience with relational databases including: + PostgreSQL + Microsoft SQL Server + MySQL * Advanced programming experience with: + Python + R * Experience designing scalable enterprise data platforms. * Experience building automated ETL/ELT pipelines. * Experience developing scalable data processing solutions. * Experience with GitLab and/or GitHub source control. * Experience working in Linux environments. * Strong software engineering background including development, testing, and deployment. * Excellent written and verbal communication skills. * Strong analytical and troubleshooting abilities., Experience with one or more of the following technologies is highly desirable: Data Engineering * Apache Airflow * Prefect * Dagster * AWS Step Functions Cloud Platforms * Amazon Web Services (AWS) * Microsoft Azure * Snowflake Enterprise Data Technologies * Enterprise Data Lakes * Data Warehouses * CDC (Change Data Capture) * DataOps * CI/CD Pipelines Big Data * Distributed Computing * Large Scale Data Processing * High-Volume Data Optimization, * Time Series Data * Forecasting Analytics * Economic Research * Financial Data * Research Organizations, * Python * R * SQL * Java (Preferred) * Scala (Preferred) * JavaScript (Preferred) * Perl (Preferred) Databases * PostgreSQL * Microsoft SQL Server * MySQL * NoSQL * Graph Databases Cloud * AWS * Microsoft Azure * Snowflake Data Engineering * ETL / ELT * Apache Airflow, * Are you a U.S. Citizen? * Are you able to work 100% on-site in Washington, DC? * Do you have at least 7 years of experience in Data Engineering or Data Architecture? * How many years of professional Python experience do you have? * How many years of advanced SQL development experience do you have? * Have you designed enterprise ETL/ELT data pipelines? * Which cloud platforms have you used professionally? (AWS, Azure, Snowflake) * Have you worked with Apache Airflow, Prefect, Dagster, or AWS Step Functions? * Have you designed enterprise data warehouse or data lake solutions? * Do you have experience supporting research, economic, or financial data environments? * Have you worked with PostgreSQL, SQL Server, and MySQL? * What is your earliest available start date? ## Description Diverse Agile Solutions is seeking a highly skilled Senior IT Big Data Developer (Data Architect/Engineer) to support the Federal Reserve Board's Data Architecture, Technology, and Analytics (DATA) organization within the Division of Research & Statistics. The DATA team is responsible for transforming how economic research data is collected, managed, integrated, analyzed, and visualized across the organization. This position is ideal for an experienced Data Architect and Data Engineer who enjoys designing scalable enterprise data platforms, building modern data pipelines, optimizing large-scale data processing systems, and supporting data-driven research initiatives. The successful candidate will collaborate closely with economists, data scientists, researchers, and software engineers to design next-generation data architecture supporting critical economic policy research., * Design and implement scalable enterprise data architectures supporting research and analytics initiatives. * Develop, optimize, and maintain enterprise data pipelines and automated ETL/ELT workflows. * Design conceptual, logical, and physical data models. * Build highly scalable data processing frameworks capable of supporting large datasets. * Develop data integration solutions for structured and unstructured data sources. * Optimize database performance across enterprise environments. * Design enterprise data lake and data warehouse solutions. * Implement Change Data Capture (CDC) methodologies. * Develop workflow orchestration using tools such as Apache Airflow, Prefect, Dagster, or AWS Step Functions. * Support migration of data platforms between on-premises and cloud environments. * Perform root cause analysis of data quality and business process issues. * Collaborate with economists and technical teams to deliver trusted, high-quality data assets. * Develop software solutions supporting enterprise data services. * Participate in application testing, deployment, and production support. * Build and maintain CI/CD pipelines supporting DataOps initiatives. * Document architecture, standards, and technical designs. * Recommend improvements to enterprise data strategy and governance., * NoSQL Databases * Graph Databases * Machine Learning * Java * Scala * JavaScript * Perl, * Dagster * AWS Step Functions * Data Lakes * Data Warehouses * Change Data Capture (CDC) * DataOps * CI/CD Tools * GitLab * GitHub * Linux ## Related Videos - [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Coding for Good: Achieving social change with an app](https://www.wearedevelopers.com/videos/1645-coding-for-good-achieving-social-change-with-an-app) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)