Data Cloud Engineer (Remote)

Zachary Piper
United States
4 days ago
Apply on www.clearancejobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Compensation
$120,000.0 - $140,000.0
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Agile Methodology Amazon Web Services Amazon S3 Microsoft Azure Big Data Cloud Database Cloud Engineering Cyber Security Information Systems Continuous Integration Data Governance
+27 more
Extract Transform Load (ETL) Data Warehousing Relational Databases DevOps Apache Hive JSON Python (Programming Language) Oracle Databases Role-Based Access Control Cloud Services Software Engineering SQL Databases Unstructured Data Data Ingestion Azure Data Factory Change Data Capture SC Clearance Pyspark Information Technology Data Lineage Deployment Automation AWS Glue Cloud Migration Azure Synapse Analytics Data Pipelines Amazon Redshift Databricks

Job description

  • Design, develop, and maintain scalable cloud-based ETL/ELT pipelines using Azure and AWS technologies.
  • Build and optimize large-scale data transformation solutions utilizing PySpark and Spark SQL.
  • Develop ingestion frameworks supporting structured and unstructured data sources, including relational databases, APIs, JSON, and flat files.
  • Implement full and incremental data loading strategies, including Change Data Capture (CDC).
  • Design and support enterprise data lakes, data warehouses, and analytics-ready environments.
  • Establish data quality, governance, and security controls including schema validation, RBAC, lineage tracking, and credential management.
  • Monitor, troubleshoot, and improve the performance and reliability of cloud data pipelines.
  • Support CI/CD implementation and automated deployment processes.
  • Partner closely with cloud engineering, cybersecurity, DevOps, and software development teams to support modernization initiatives.
  • Ensure solutions remain compliant with DoD security requirements and best practices.

Requirements

  • Active Secret Clearance.
  • Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, or related technical discipline.
  • 10+ years of experience designing and supporting enterprise-scale data engineering solutions.
  • Strong expertise with PySpark, Spark SQL, Python, and SQL.
  • Experience building cloud-native data pipelines in Azure Synapse Analytics, Databricks, and/or AWS Glue.
  • Experience with data ingestion, integration, and transformation of structured and unstructured data.
  • Experience implementing CDC methodologies and incremental load frameworks.
  • Knowledge of data governance, access controls, and data quality methodologies.
  • Experience supporting production environments and troubleshooting operational issues.

Preferred Qualifications

  • Experience with Azure Data Factory, Redshift, Amazon S3, and Oracle databases.
  • Experience supporting federal or DoD cloud modernization programs.
  • Familiarity with RMF, STIG, and FedRAMP compliance frameworks.
  • Experience working in Agile development environments.

Benefits & conditions

  • Salary 120,000-140,000+ depending on experience

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.clearancejobs.com
Prepare application

Good distractions

Loading talks and stories from around this role…