Data Cloud Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+30 more
Job description
- Build, enhance, and support scalable cloud-based data integration and processing pipelines across AWS and Azure technologies
- Develop high-performance data transformation workflows using PySpark, Spark SQL, and modern big data technologies.
- Create data ingestion solutions for a variety of sources, including databases, APIs, JSON, and file based systems.
- Design and implement efficient full-load, incremental, and change-tracking data processing strategies.
- Support the architecture and operation of enterprise-scale data lakes, warehouses, and analytics platforms.
- Contribute to automated deployment processes and CI/CD best practices to streamline development and operations.
- Partner with cross-functional teams, including engineering, security, operations, and application development, to deliver modern data solutions.
- Ensure platforms and processes align with organizational security, compliance, and operational standards.
Requirements
to help build and maintain scalable, cloud-native data platforms that power critical analytics and data-driven decision-making. This role is fully remote and will require extensive experience in data engineering solutions. In this role, you will develop high-performance data pipelines, support multi-cloud data integration initiatives, and contribute to the design of secure, enterprise-scale data architectures. The ideal candidate has experience with Azure and/or AWS, strong proficiency in Python, PySpark, and Spark SQL, and a track record of delivering robust data engineering solutions in complex environments., * Active security clearance required.
- Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, or a related technical field.
- 10+ years of experience designing, implementing, and supporting enterprise-scale data engineering and analytics solutions.
- Strong hands-on experience with Python, SQL, PySpark, and Spark SQL for large-scale data processing.
- Proven experience building and maintaining cloud-native data platforms using technologies such as Azure Synapse, Databricks, AWS Glue, or similar tools.
- Experience developing data ingestion, integration, and transformation solutions for both structured and unstructured data sources.
- Solid understanding of change data capture (CDC), incremental processing, and modern data loading methodologies.
- Knowledge of data governance, data quality, security controls, and access management best practices.
- Experience supporting production data environments, troubleshooting complex issues, and optimizing performance and reliability., * Experience with Azure Data Factory, Redshift, Amazon S3, and Oracle databases.
- Experience supporting federal or DoD cloud modernization programs.
- Familiarity with RMF, STIG, and FedRAMP compliance frameworks.
- Experience working in Agile development environments.
Benefits & conditions
Salary $120,000-$140,000 depending on experience
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…