Data Engineer in Arlington, VA (Hybrid - 3 Days Onsite)

PRI Global
Arlington, VA, United States
about 1 month ago

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Compensation
$26,000.0
Working hours
Regular working hours

Tech stack

Business Analytics Applications Data Analysis Big Data Data Governance Data Integration Extract Transform Load (ETL) Data Mining Data Warehousing Apache Hadoop Hadoop Distributed File System Apache Hive Python (Programming Language)
+10 more
Standard Sql SQL Databases Enterprise Data Management Data Processing Apache Yarn Apache Spark Pyspark Tools for Reporting Software Version Control Data Pipelines

Job description

We are seeking an experienced Data Engineer to join a newly established analytics and reporting team focused on automating data extraction, transformation, and reporting processes across multiple client engagements. This role will support a pilot initiative designed to improve how business stakeholders access and utilize data, with the opportunity to contribute to a growing Center of Excellence focused on data automation and analytics., * Design, develop, and maintain scalable data pipelines and ETL processes.

  • Build and optimize Spark-based data processing solutions.
  • Extract, transform, and integrate large datasets from enterprise data sources.
  • Write and optimize complex SQL and Spark SQL queries.
  • Develop Python-based data extraction, transformation, and reporting solutions.
  • Work with Hadoop ecosystem technologies including HDFS, Ozone, and Hive.
  • Support data quality validation, troubleshooting, and production issue resolution.
  • Collaborate with data engineers, analysts, and business stakeholders to deliver reporting and analytics solutions.
  • Contribute to process automation initiatives and continuous improvement efforts.
  • Follow coding standards, version control practices, and data governance requirements.

Requirements

The ideal candidate will have strong hands-on experience with Spark, Hadoop, Python, and SQL, along with a background working in large-scale data environments. This position involves developing and optimizing data pipelines, transforming complex datasets, and supporting reporting and analytics solutions used across multiple business functions., * Strong experience as a Data Engineer or similar data-focused role.

  • Advanced experience with:
  • Apache Spark (PySpark, Spark SQL)
  • Hadoop Ecosystem (HDFS, Hive, YARN, Ozone)
  • Python
  • SQL
  • Experience building and maintaining ETL/data pipeline solutions.
  • Strong understanding of data modeling, data integration, and data warehousing concepts.
  • Experience working with large-scale transactional or analytical data environments.
  • Ability to identify and resolve data quality and performance issues.
  • Strong communication skills and ability to work with both technical and non-technical stakeholders., * Experience in financial services, banking, payments, fintech, or transaction-processing environments.
  • Experience working with large enterprise data platforms.
  • Familiarity with reporting and analytics-focused data engineering solutions.
  • Prior experience supporting client-facing analytics initiatives., * Hybrid schedule with three days onsite per week in Arlington, VA.
  • Candidates should be comfortable attending in-person interviews.
  • Local DMV-area candidates are strongly preferred.
  • Opportunity to contribute to a high-visibility pilot initiative with potential for extension based on project success.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www2.jobdiva.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

4:18 min

Exploring the Apache Spark layer architecture

Ayon Roy · LIVE

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all