Cloud Engineer - Data Engineering

Nationwide Consulting Company Inc
United States
24 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Compensation
$176,800.0 - $197,600.0
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Agile Methodology Artificial Intelligence Amazon Web Services Microsoft Azure Backup Devices Business Software Cloud Computing Cloud Database Cloud Engineering Cloud Storage Information Systems
+30 more
Databases Data Dictionary Information Engineering Data Infrastructure Extract Transform Load (ETL) Data Mart Data Warehousing Disaster Recovery Distributed Computing Environment Machine Learning Oracle (Applications) Scrum Methodology Software Tools Cloud Services Zero Trust Network Access SQL Databases Systems Integration Unstructured Data Enterprise Data Management Data Processing Cloud Platform System Data Ingestion Apache Spark Git Infrastructure Automation Frameworks Information Technology Non-relational Database Software Version Control Data Pipelines Databricks

Job description

The Cloud Engineer I - Data Engineering supports the Department of Veterans Affairs (VA) by designing, developing, and maintaining secure, scalable cloud-based data platforms and data engineering solutions. The engineer will work within Agile teams to build and optimize data pipelines, cloud storage solutions, and analytics environments that enable enterprise reporting, operational decision-making, artificial intelligence (AI), and machine learning (ML) initiatives across the VA.

This position combines cloud infrastructure engineering with modern data engineering practices to ensure data is reliable, secure, and readily available for mission-critical healthcare and business applications while maintaining compliance with VA security and privacy requirements., * Design, develop, and maintain cloud-native data engineering solutions within Microsoft Azure and AWS environments.

  • Develop, deploy, and optimize Extract, Transform, and Load (ETL/ELT) pipelines for structured and unstructured data.
  • Build and maintain scalable cloud-based data lakes, data warehouses, and data marts.
  • Integrate data from multiple enterprise systems using APIs, databases, flat files, and cloud-native integration services.
  • Develop Infrastructure-as-Code (IaC) to automate cloud infrastructure deployment and management.
  • Optimize data ingestion, transformation, and storage processes for performance and scalability.
  • Implement data quality, validation, cleansing, and monitoring processes.
  • Support cloud-based analytics, business intelligence, and AI/ML initiatives.
  • Develop automation scripts to improve operational efficiency.
  • Collaborate with data architects, application developers, business analysts, and cybersecurity personnel.
  • Monitor cloud infrastructure and data platform performance, availability, and costs.
  • Support backup, disaster recovery, and business continuity planning for cloud data environments.
  • Produce technical documentation, including:
  • Data flow diagrams
  • Data dictionaries
  • ETL specifications
  • Architecture diagrams
  • Standard Operating Procedures (SOPs)
  • Participate in Agile ceremonies, including Sprint Planning, Daily Standups, Sprint Reviews, and Retrospectives.
  • Support Authority to Operate (ATO) activities and security audits.
  • Ensure all cloud and data engineering activities comply with:
  • NIST 800-53
  • FedRAMP
  • VA Handbook 6500
  • Zero Trust Architecture principles

Requirements

  • Must possess an active Department of Veterans Affairs Personal Identity Verification (PIV) badge (VA badge).
  • Must be eligible to continue supporting VA systems and maintain all required background investigation requirements., Bachelor’s degree in:
  • Computer Science
  • Information Systems
  • Data Science
  • Engineering
  • Information Technology

or

Equivalent combination of education and relevant experience.

Experience

Minimum 4 years of professional IT experience, including:

  • 2+ years developing cloud-based data engineering solutions
  • Experience building enterprise ETL/ELT pipelines
  • Experience supporting Microsoft Azure and/or AWS cloud environments
  • Experience working with relational and non-relational databases
  • Experience supporting federal government or highly regulated environments
  • Experience using Git-based source control

Desired Technical Skills and Experience

Experience with many of the following:

Cloud Platforms (AWS/Azure)

Data Engineering Tools

Databases (SQL, Oracle)

Programming & Scripting

Data Processing, * Previous experience supporting VA cloud and enterprise data platforms

  • Experience supporting enterprise analytics environments
  • Familiarity with Databricks, Apache Spark, or similar distributed data processing platforms
  • Experience supporting AI/ML data pipelines

Benefits & conditions

$85 - $95 an hour - Full-time, Candidates must meet all of the following requirements before being considered:

  • Active Department of Veterans Affairs PIV badge (VA badge) with current access.
  • U.S. Citizenship.

Join us to be part of a forward-thinking team committed to leveraging innovative cloud solutions that transform data management. Your expertise will help shape the future of enterprise IT infrastructure while supporting impactful projects that make a difference.

Pay: $85.00 - $95.00 per hour

About the company

National Consulting Partners (NCP) is a SBA-verified Service-Disabled Veteran-Owned Small Business (SDVOSB) with extensive expertise in business processes, strategic planning, and IT systems within the Department of Veterans Affairs. We collaborate with clients and stakeholders to design, manage, and optimize complex programs that integrate technology and operations for improved outcomes across enterprise environments.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:04 min

Database evolution and the funding behind vector databases

Erik Bamberg · LIVE

4:43 min

Building an anti-money laundering production architecture with Python

Stefan Donsa Stefan Donsa +1 · LIVE

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

1:34 min

Pivoting careers into specialized platform engineering roles

Xavier Portilla Edo · LIVE

4:01 min

Managing application isolation via pluggable database models

Wei Hu Wei Hu · WWC 2022

1:44 min

Career transition into cloud native and data management

Michael Cade · LIVE

Videos

See all

Related articles

See all