> Markdown version of [/jobs/ext/150572-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/150572-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Nucorevision, Inc. - **Location:** Washington, DC, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Microsoft Azure, Big Data, Data Files, Extract Transform Load (ETL), Data Sharing, Data Structures, Relational Databases, Apache Hadoop, Python (Programming Language), Open Source Technology, Scala (Programming Language), SQL Databases, Data Streaming, Apache Spark, Microsoft Fabric, Information Technology, Data Management, Data Pipelines, Databricks - **Published:** May 15, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=f581cc73281da92d ## About the Role Do you have experience in Technical documentation?, Do you have a Master's degree?, * Must be a US citizen * Must Reside in the DMV Area (DC, Maryland, Virginia) * Must have a minimum of 10-years Experience * Master's Degree Highly Preferred, * Years of Experience: 10+ years * Recommended Certifications: Power Platform certifications preferred. * Relevant federal IT experience, technical capability, and operational support experience aligned to assigned labor category. ## Description Create and maintain optimal data pipeline architecture, including optimal extraction, transformation and loading of data, leveraging Microsoft Fabric notebooks, Apache Spark (SQL, Python, Scala) and other Microsoft Azure or open-source tools as required. Maintain high quality documentation about data structures in shared data governance tools for the business to access. Collaborate with data owners, data stewards, analysts, software developers, and Database Administrators (DBAs). Experience with Apache Spark, Python, SQL or relational databases, Hadoop, Databricks and data pipeline management in Spark for batch and streaming. Experience building and optimizing 'big data' data pipelines, architectures and data sets. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Introduction to TXT](https://www.wearedevelopers.com/videos/30-introduction-to-txt) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers) - [Implementing continuous delivery in a data processing pipeline](https://www.wearedevelopers.com/videos/73-implementing-continuous-delivery-in-a-data-processing-pipeline) ## Related Articles - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)