Cloud Engineer - Data Engineering
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+30 more
Job description
The Cloud Engineer I - Data Engineering supports the Department of Veterans Affairs (VA) by designing, developing, and maintaining secure, scalable cloud-based data platforms and data engineering solutions. The engineer will work within Agile teams to build and optimize data pipelines, cloud storage solutions, and analytics environments that enable enterprise reporting, operational decision-making, artificial intelligence (AI), and machine learning (ML) initiatives across the VA.
This position combines cloud infrastructure engineering with modern data engineering practices to ensure data is reliable, secure, and readily available for mission-critical healthcare and business applications while maintaining compliance with VA security and privacy requirements., * Design, develop, and maintain cloud-native data engineering solutions within Microsoft Azure and AWS environments.
- Develop, deploy, and optimize Extract, Transform, and Load (ETL/ELT) pipelines for structured and unstructured data.
- Build and maintain scalable cloud-based data lakes, data warehouses, and data marts.
- Integrate data from multiple enterprise systems using APIs, databases, flat files, and cloud-native integration services.
- Develop Infrastructure-as-Code (IaC) to automate cloud infrastructure deployment and management.
- Optimize data ingestion, transformation, and storage processes for performance and scalability.
- Implement data quality, validation, cleansing, and monitoring processes.
- Support cloud-based analytics, business intelligence, and AI/ML initiatives.
- Develop automation scripts to improve operational efficiency.
- Collaborate with data architects, application developers, business analysts, and cybersecurity personnel.
- Monitor cloud infrastructure and data platform performance, availability, and costs.
- Support backup, disaster recovery, and business continuity planning for cloud data environments.
- Produce technical documentation, including:
- Data flow diagrams
- Data dictionaries
- ETL specifications
- Architecture diagrams
- Standard Operating Procedures (SOPs)
- Participate in Agile ceremonies, including Sprint Planning, Daily Standups, Sprint Reviews, and Retrospectives.
- Support Authority to Operate (ATO) activities and security audits.
- Ensure all cloud and data engineering activities comply with:
- NIST 800-53
- FedRAMP
- VA Handbook 6500
- Zero Trust Architecture principles
Requirements
- Must possess an active Department of Veterans Affairs Personal Identity Verification (PIV) badge (VA badge).
- Must be eligible to continue supporting VA systems and maintain all required background investigation requirements., Bachelor’s degree in:
- Computer Science
- Information Systems
- Data Science
- Engineering
- Information Technology
or
Equivalent combination of education and relevant experience.
Experience
Minimum 4 years of professional IT experience, including:
- 2+ years developing cloud-based data engineering solutions
- Experience building enterprise ETL/ELT pipelines
- Experience supporting Microsoft Azure and/or AWS cloud environments
- Experience working with relational and non-relational databases
- Experience supporting federal government or highly regulated environments
- Experience using Git-based source control
Desired Technical Skills and Experience
Experience with many of the following:
Cloud Platforms (AWS/Azure)
Data Engineering Tools
Databases (SQL, Oracle)
Programming & Scripting
Data Processing, * Previous experience supporting VA cloud and enterprise data platforms
- Experience supporting enterprise analytics environments
- Familiarity with Databricks, Apache Spark, or similar distributed data processing platforms
- Experience supporting AI/ML data pipelines
Benefits & conditions
$85 - $95 an hour - Full-time, Candidates must meet all of the following requirements before being considered:
- Active Department of Veterans Affairs PIV badge (VA badge) with current access.
- U.S. Citizenship.
Join us to be part of a forward-thinking team committed to leveraging innovative cloud solutions that transform data management. Your expertise will help shape the future of enterprise IT infrastructure while supporting impactful projects that make a difference.
Pay: $85.00 - $95.00 per hour
About the company
National Consulting Partners (NCP) is a SBA-verified Service-Disabled Veteran-Owned Small Business (SDVOSB) with extensive expertise in business processes, strategic planning, and IT systems within the Department of Veterans Affairs. We collaborate with clients and stakeholders to design, manage, and optimize complex programs that integrate technology and operations for improved outcomes across enterprise environments.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
7 Cloud Computing Trends Coming in 2025 for Developers
Data Engineer Salary UK
Top-Paying Tech Jobs (with Salaries)