> Markdown version of [/jobs/ext/2936331-data-engineer-expert](https://www.wearedevelopers.com/jobs/ext/2936331-data-engineer-expert). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer-- Expert

- **Company:** PROBITY, INC.
- **Location:** Chantilly, VA, United States
- **Experience:** Starter
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Airflow, Amazon Web Services, Big Data, Information Systems, Information Engineering, Data Retrieval, Data Systems, Relational Databases, Linux, Apache Hive, JSON, Python (Programming Language), PostgreSQL, Linux System Administration, MySQL, Oracle (Applications), Performance Tuning, SAP (Applications), Shell Script, Software Deployment, SQL Databases, Unstructured Data, Workflow Management Systems, Data Processing, Information Technology, Apache Nifi, Scalable Processor Architecture, Data Pipelines
- **Published:** September 16, 2026
- **Apply:** https://recruitingbypaycor.com/career/JobIntroduction.action?clientId=8ad64ec641581ddf01417baac7cb5ed7&id=8a78879e9d4aea52019d68451fc5396e&source=&lang=en

## About the Role

* Active TS/SCI with Polygraph clearance.
 * A Master's degree in Computer Science, Information Systems, Engineering, or additional years of specialized experience in a scientific or technical discipline.
 * Build and maintain reliable data pipelines that support ingestion, transformation, and delivery of large datasets
 * Partner with software developers and engineering teams to integrate data solutions into existing systems and applications
 * Develop and optimize SQL queries to support data retrieval, transformation, and analysis
 * Work with relational databases such as PostgreSQL, Oracle, and MySQL to store, manage, and access data
 * Develop scripts and automation using Python, Linux, and shell scripting to support data processing tasks
 * Operate within AWS environments to support cloud-based data infrastructure and workflows
 * Prepare and structure data outputs in usable formats for analysis and downstream systems, including JSON
 * 8+ years of experience developing or maintaining data pipelines in collaboration with development teams
 * 4+ years of hands-on experience with Python
 * Experience working with AWS cloud services
 * Familiarity with SPARC environments and relational databases including PostgreSQL, Oracle, or MySQL
 * Demonstrated experience writing and maintaining SQL queries
 * 4+ years of experience working in Linux environments, including shell scripting An SAP NS2 Company
 * Experience preparing and managing structured and unstructured datasets, including JSON formats

Desired Qualifications:

 * Excellent communication and collaboration skills.
 * Experience with workflow orchestration tools such as Apache NiFi or Apache Airflow
 * 4+ years of development experience with Java or Scala
 * Experience managing or supporting EMR or SPARC clusters
 * Background in performance tuning and optimization of data pipelines or large data systems
 * 4+ years of experience working with Hive or Iceberg
 * Familiarity with implementing cloud-based security practices
 * Experience using ACM processes for code deployment

## Description

Seeking a highly motivated, self-directed professional for a Data Engineering role. In this role, you will design and maintain data pipelines, collaborate closely with development teams, and help deliver reliable data solutions that enable teams to transform data into actionable insights.


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json)
- [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker)
- [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)
- [Introducing JSON Structure](https://www.wearedevelopers.com/videos/100219-introducing-json-structure)

## Related Articles

- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)