> Markdown version of [/jobs/ext/2840729-data-engineer](https://www.wearedevelopers.com/jobs/ext/2840729-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** BIG IMPACT TECH CORP - **Location:** Washington, DC, United States - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Amazon Web Services, Microsoft Azure, Big Data, Cloud Computing, Information Systems, Databases, Continuous Integration, Information Engineering, Data Integration, Extract Transform Load (ETL), Data Transformation, Data Systems, Data Warehousing, DevOps, Apache Hive, NoSQL, Power BI, SQL Databases, Data Streaming, Tableau (Software), Unstructured Data, Google Cloud, Cloud Platform System, Data Ingestion, Azure Data Factory, Snowflake, Apache Spark, Git, Microsoft Fabric, Containerization, Data Lakes, Pyspark, Infrastructure Automation Frameworks, Information Technology, Deployment Automation, Qlikview, Data Management, Data Lakehouse, Azure Synapse Analytics, Data Pipelines, Databricks - **Published:** September 11, 2026 - **Apply:** https://www.clearancejobs.com/jobs/9155276/data-engineer ## About the Role * Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or a related field. * 5+ years of experience in Data Engineering. * 3+ years of hands-on experience with Databricks. Strong experience with PySpark, Spark SQL, and SQL. * Experience building large-scale data pipelines and ETL/ELT solutions. Experience with cloud platforms such as Azure, AWS, or Google Cloud. * Strong understanding of data modeling, data warehousing, and Lakehouse architectures. Experience working with relational and NoSQL databases., * Experience supporting Coast Guard or other government-related programs. * Experience with Azure Databricks, Azure Data Factory, Microsoft Fabric, Synapse Analytics, or Snowflake. * Knowledge of Delta Lake, Unity Catalog, and Databricks Workflows. Experience with real-time and streaming data solutions. * Familiarity with DevOps practices, Git, CI/CD pipelines, and Infrastructure as Code. Experience with Power BI, Qlik, or Tableau reporting environments. * Relevant Databricks or cloud certifications preferred. Technical Skills * Databricks PySpark * Apache Spark Spark SQL SQL * Delta Lake * Data Lakehouse Architecture Azure Databricks * Azure Data Factory Microsoft Fabric * Snowflake * Data Warehousing * ETL/ELT Development * Git CI/CD * Cloud Platforms (Azure, AWS, GCP) ## Description We are seeking a skilled Data Engineer with strong Databricks expertise to support Coast Guard data modernization, analytics, and cloud transformation initiatives. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, data lakehouse solutions, and cloud-based data platforms that enable efficient data integration, storage, processing, and analytics. The candidate will work closely with data architects, analysts, developers, and business stakeholders to deliver reliable, secure, and high-performing data solutions., * Design, develop, and maintain scalable data pipelines using Databricks and cloud-native technologies. * Build and optimize ETL/ELT processes for structured, semi-structured, and unstructured data. Develop and manage data ingestion frameworks from various source systems, APIs, databases, and files. * Implement and maintain Delta Lake architecture and Lakehouse solutions. * Develop PySpark, Spark SQL, and SQL-based transformations for large-scale data processing. Support data warehousing, data lakes, and enterprise analytics initiatives. * Monitor and optimize data pipeline performance, reliability, and scalability. Ensure data quality, governance, lineage, and security across data platforms. * Collaborate with business stakeholders and technical teams to understand requirements and deliver data solutions. * Implement CI/CD practices and automated deployment processes for data engineering solutions. Troubleshoot and resolve production issues related to data ingestion, transformation, and reporting. ## Related Videos - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)