Data Cloud Engineer (Remote)
Zachary Piper
United States
4 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.clearancejobs.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Compensation
$120,000.0 - $140,000.0
Working hours
Regular working hours
Job source
Tech stack
Application Programming Interfaces (APIs)
Agile Methodology
Amazon Web Services
Amazon S3
Microsoft Azure
Big Data
Cloud Database
Cloud Engineering
Cyber Security
Information Systems
Continuous Integration
Data Governance
+27 more
Extract Transform Load (ETL)
Data Warehousing
Relational Databases
DevOps
Apache Hive
JSON
Python (Programming Language)
Oracle Databases
Role-Based Access Control
Cloud Services
Software Engineering
SQL Databases
Unstructured Data
Data Ingestion
Azure Data Factory
Change Data Capture
SC Clearance
Pyspark
Information Technology
Data Lineage
Deployment Automation
AWS Glue
Cloud Migration
Azure Synapse Analytics
Data Pipelines
Amazon Redshift
Databricks
Job description
- Design, develop, and maintain scalable cloud-based ETL/ELT pipelines using Azure and AWS technologies.
- Build and optimize large-scale data transformation solutions utilizing PySpark and Spark SQL.
- Develop ingestion frameworks supporting structured and unstructured data sources, including relational databases, APIs, JSON, and flat files.
- Implement full and incremental data loading strategies, including Change Data Capture (CDC).
- Design and support enterprise data lakes, data warehouses, and analytics-ready environments.
- Establish data quality, governance, and security controls including schema validation, RBAC, lineage tracking, and credential management.
- Monitor, troubleshoot, and improve the performance and reliability of cloud data pipelines.
- Support CI/CD implementation and automated deployment processes.
- Partner closely with cloud engineering, cybersecurity, DevOps, and software development teams to support modernization initiatives.
- Ensure solutions remain compliant with DoD security requirements and best practices.
Requirements
- Active Secret Clearance.
- Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, or related technical discipline.
- 10+ years of experience designing and supporting enterprise-scale data engineering solutions.
- Strong expertise with PySpark, Spark SQL, Python, and SQL.
- Experience building cloud-native data pipelines in Azure Synapse Analytics, Databricks, and/or AWS Glue.
- Experience with data ingestion, integration, and transformation of structured and unstructured data.
- Experience implementing CDC methodologies and incremental load frameworks.
- Knowledge of data governance, access controls, and data quality methodologies.
- Experience supporting production environments and troubleshooting operational issues.
Preferred Qualifications
- Experience with Azure Data Factory, Redshift, Amazon S3, and Oracle databases.
- Experience supporting federal or DoD cloud modernization programs.
- Familiarity with RMF, STIG, and FedRAMP compliance frameworks.
- Experience working in Agile development environments.
Benefits & conditions
- Salary 120,000-140,000+ depending on experience
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.clearancejobs.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…