> Markdown version of [/jobs/ext/447515-data-engineer](https://www.wearedevelopers.com/jobs/ext/447515-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** Spectraforce
- **Location:** Richmond, VA, United States
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Agile Methodology, Amazon Web Services, Amazon Elastic Compute Cloud, Amazon S3, Automation of Tests, Cloud Computing Security, Code Review, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Security, Dataspaces, Data Systems, Software Debugging, DevOps, Distributed Computing Environment, Identity and Access Management, Python (Programming Language), Operational Databases, Performance Tuning, Cloud Services, SQL Databases, Scripting, Freeform SQL, Snowflake, Apache Spark, State Machines, Backend, Git, Pyspark, Cloudwatch, Data Pipelines, Serverless Computing, Golang
- **Published:** June 3, 2026
- **Apply:** http://leoforce.us/Careers/Spectraforce/JobDetails.html?jobid=ad64f23b-7b92-4572-ad9c-ac130f5027ec&OrgId=1&UserId=4553

## About the Role

*Skills-Data Engineer- Python , Spark/PySpark, AWS, Golang, Able to write complex SQL queries against Snowflake tables / Troubleshoot issues, Java/Python, AWS (Glue, EC2, Lambda).
*Proficiency in Python with experience building scalable data pipelines or ETL processes.
*Strong hands-on experience with Spark/PySpark for distributed data processing.
*Experience writing complex SQL queries (Snowflake preferred), including optimization and performance tuning.
*Working knowledge of AWS cloud services used in data engineering (S3, Glue, Lambda, EMR, Step Functions, CloudWatch, IAM).
*Experience with Golang for scripting, backend services, or performance-critical processes.
*Strong debugging, troubleshooting, and analytical skills across cloud and data ecosystems.
*Familiarity with CI/CD workflows, Git, and automated testing.

## Description

*Design, develop, and maintain data pipelines leveraging Python, Spark/PySpark, and cloud-native services.
*Build and optimize data workflows, ETL processes, and transformations for large-scale structured and semi-structured datasets.
*Write advanced and efficient SQL queries against Snowflake, including joins, window functions, and performance tuning.
*Develop backend and automation tools using Golang and/or Python as needed.
*Implement scalable, secure, and high-quality data solutions across AWS servies such as S3, Lambda, Glue, Step Functions, EMR, and CloudWatch.
*Troubleshoot complex production data issues, including pipeline failures, data quality gaps, and cloud environment challenges.
*Perform root-cause analysis and implement automation to prevent recurring issues.
*Collaborate with data scientists, analysts, platform engineers, and product teams to enable reliable, high-quality data access.
*Ensure compliance with enterprise governance, data quality, and cloud security standards.
*Participate in Agile ceremonies, code reviews, and DevOps practices to ensure high engineering quality.


## Related Videos

- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Go with the Flow: Stop the Leaks Before Your Memory's a Waterfall!](https://www.wearedevelopers.com/videos/100073-go-with-the-flow-stop-the-leaks-before-your-memory-s-a-waterfall)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [#90DaysOfDevOps - The DevOps Learning Journey](https://www.wearedevelopers.com/videos/548-90daysofdevops-the-devops-learning-journey)
- [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)