Data Engineer (Remote)

Kforce Inc.
United States
7 days ago

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
9 years minimum
Compensation
$135,200.0 - $176,800.0
Working hours
Regular working hours

Tech stack

Amazon Web Services Amazon S3 Big Data Cloud Computing Cloud Database Code Review Continuous Integration Data Validation Data Cleansing Information Engineering Data Governance Data Integration
+17 more
Data Integrity Extract Transform Load (ETL) Data Transformation Data Systems Job Scheduling Python (Programming Language) SAP NetWeaver Data Management Enterprise Data Management Data Processing Cloud Platform System Sql Optimization Gitlab Data Lakes Pyspark Software Version Control Data Pipelines Databricks

Job description

We are seeking an experienced Data Engineer to support a high-visibility federal modernization initiative within a large Department of Defense environment. This role focuses on building and optimizing scalable data pipelines, transforming complex financial and operational datasets, and enabling advanced analytics capabilities across enterprise systems.

This is an excellent opportunity for a data professional who enjoys working with big data technologies, cloud environments, and modern data engineering practices while supporting mission-critical programs., Design, develop, and maintain scalable data pipelines for ingesting, transforming, and processing large datasets. Build, optimize, and automate ETL/ELT workflows to support analytics and reporting requirements. Perform data cleansing, transformation, aggregation, and data wrangling activities to improve data quality and usability. Develop and maintain solutions using Databricks and related technologies. Implement automated data validation processes and data quality controls. Work with large-scale financial and transactional datasets, ensuring data integrity and accuracy. Collaborate with analysts, product owners, engineers, and stakeholders to deliver data solutions supporting business objectives. Support cloud-based data environments and storage solutions. Troubleshoot, optimize, and enhance existing data pipelines and workflows. Contribute to CI/CD processes, code reviews, and version control best practices.

Requirements

9+ years of professional Data Engineering experience. Strong experience building and maintaining enterprise-scale data pipelines. Hands-on expertise with: Databricks ETL/ELT development Python PySpark SQL Big Data processing and architecture Data wrangling, cleansing, and transformation Experience designing and implementing data integration frameworks. Advanced SQL skills for complex querying and data transformation. Experience working with large datasets in cloud-based environments. Strong analytical and problem-solving abilities. Excellent communication and collaboration skills., Experience working within the Advana platform. Knowledge of Databricks Delta Lake, Autoloader, and job scheduling. Familiarity with Unity Catalog for data governance. Experience with AWS GovCloud and Amazon S3. Understanding of Medallion Architecture (Bronze, Silver, Gold layers). Experience implementing automated data quality frameworks. Knowledge of Federal Financial Management or General Ledger data. Experience with Universe of Transactions (UoT) reconciliations. Familiarity with SAP data structures. Experience using GitLab and CI/CD methodologies.

Technical Environment Databricks Python PySpark SQL AWS GovCloud Amazon S3 Delta Lake GitLab CI/CD Pipelines Enterprise Data Platforms

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.clearancejobs.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

6:14 min

Structuring CI/CD pipelines with integrated security and quality checks

Christoph Ruggenthaler · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · WWC Europe 2026

1:29 min

Utilizing specific tooling for continuous integration and modeling

Christoph Fassbach Christoph Fassbach +1 · WWC 2024

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

Videos

See all

Related articles

See all