Spark Data Engineer

GRVTY, LLC

Tysons, VA, United States

2 days ago

Apply on www.clearancejobs.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Compensation

$150,000.0 - $250,000.0

Working hours

Regular working hours

Job source

www.clearancejobs.com

Tech stack

Java (Programming Language) Airflow Amazon Web Services Data Analysis Unit Testing Cloud Computing Relational Databases Database Queries Linux JSON Python (Programming Language) PostgreSQL

+13 more

MySQL Oracle (Applications) Performance Tuning Shell Script Simple Data Format Software Deployment Extensible Markup Language (XML) Parquet Data Processing Apache Spark Avro Apache Nifi Data Pipelines

Requirements

Active TS/SCI with Polygraph Clearance
Demonstrated experience building and managing data pipelines
Demonstrated experience with Python.
Demonstrated experience with cloud computing using AWS services.
Demonstrated experience processing data using Apache Spark.
Demonstrated experience with an RDBMS (Postgres, Oracle, MySQL) and writing SQL queries.
Demonstrated experience with Linux and shell scripting.
Demonstrated experience analyzing data in different file formats like csv, xml, json, avro, parquet, etc.
Demonstrated experience writing and validating unit tests.

What Would be Nice to Have

Demonstrated experience in NiFi, Apache AirFlow, or an equivalent solution or tool for orchestrating data pipelines.
Demonstrated experience with Java or Scala.
Demonstrated experience administering an EMR/Spark cluster
Demonstrated experience conducting performance tuning of a spark job
Demonstrated experience developing cloud-based security solutions
Demonstrated experience following a configuration mgmt. process to review and deploy code as part of releases

Benefits & conditions

Pay Range: At GRVTY, we understand that compensation is influenced by many factors-such as geographic location, federal contract labor categories, wage rates, prior experience, skillsets, education, and certifications. We’re proud to offer a work environment that empowers our team to achieve a strong work-life balance. GRVTY provides competitive pay, comprehensive benefits, and meaningful opportunities for professional growth. Our benefits package is designed to support the well-being of our employees and their families, and includes coverage in areas such as healthcare, financial wellness, retirement planning, family assistance, continued education, and paid time off.

Virginia Pay Range

$150,000-$250,000