Spark Data Engineer (Software Engineer)

Ardent Principles
Tysons, VA, United States
28 days ago
Apply on www.clearancejobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Compensation
$130,000.0 - $260,000.0
Working hours
Regular working hours

Tech stack

Java (Programming Language) Airflow Amazon Web Services Data Analysis Unit Testing Big Data Cloud Computing Relational Databases Database Queries Linux File Systems JSON
+15 more
Python (Programming Language) PostgreSQL MySQL Oracle (Applications) Performance Tuning Shell Script Simple Data Format Software Deployment Extensible Markup Language (XML) Parquet Data Processing Apache Spark Avro Apache Nifi Data Pipelines

Job description

In this challenging yet rewarding role, you are an integral part of what brings our Company’s mission to life. You must have the following required skills, certifications and demonstrated experience in and/or with: * Building and managing data pipelines * Using Python * Cloud computing using AWS services * Processing data using Apache Spark * Working with RDBMS (Postgres, Oracle, MySQL) and writing SQL queries * Linux and shell scripting * Analyzing data in different file formats like csv, xml, json, avro, parquet, etc. * Writing and validating unit tests.

Highly Desired Qualifications

Other skills and demonstrated experiences that are highly desired but not mandatory to perform the work, include working with: * Working with NiFi, Apache AirFlow, or an equivalent solution or tool for orchestrating data pipelines * Java or Scala * Administering an EMR/Spark cluster * Conducting performance tuning of a spark job * Developing cloud-based security solutions * Following a configuration mgmt. process to review and deploy code as part of releases., We use cookies to ensure the basic functionalities of the website and to enhance your online experience. You can choose for each category to opt-in/out whenever you want. For more details relative to cookies and other sensitive data, please read the full privacy policy.

Strictly necessary cookiesStrictly necessary cookies

These cookies are essential for the proper functioning of our website. Without these cookies, the website may not work properly. NameDomainExpirationDescription _pinpoint_session

pinpointhq.com

As soon as browser window is closed

Allows us to associate file uploads to our file storage provider with your form submissions, We use an internal metrics collector to understand interactions with our website over time

Requirements

We are seeking a skilled Spark Data Engineer who must have hands-on experience designing, building, and maintaining scalable data pipelines while processing large datasets using Apache Spark. This role requires strong Python programming skills, expertise in cloud computing with AWS services, and experience working with relational databases such as PostgreSQL, Oracle, and MySQL.

Benefits & conditions

We offer advanced services in data science, data engineering, software engineering, AI solutions, cybersecurity, and IT program management.

Passionate Integrity, Driven by Excellence Ardent Principles offers a competitive salary range and a comprehensive, industry-leading benefits package designed to support long-term stability and employee well-being. We provide more than a position-we offer a workplace committed to excellence, integrity, and mission-focused impact. Our mission is to act as a bridge between satisfied clients and fulfilled employees, ensuring that your job and well-being are our top priorities because your satisfaction leads to the success of our clients.

Join us as we continue building the future of secure, high-impact solutions., Highly Competitive Salary: Recognizing and rewarding your expertise and contributions. * Generous Paid Time Off: Providing ample time for rest, relaxation, and personal pursuits. * Dedicated Training Budget: Supporting continuous learning and professional development. * 100% Employer-Covered Family Vision, Dental, and Health Insurance: Ensuring comprehensive health coverage for you and your family. * 100% Employer-Covered Life and Disability Insurance: Offering financial security and peace of mind. * 401(k) Plan with a 6% Employer Match: Helping you plan and save for a secure retirement, with 100% vesting from day one. * 11 Paid Government Holidays: Observing national holidays to ensure time off with family and friends. * Spot Bonuses for Exceptional Performance: Rewarding outstanding contributions and achievements.

About the company

At Ardent Principles, we’re more than just a technology company - we’re a team of innovators, problem-solvers, and collaborators dedicated to pushing the boundaries of what’s possible. Our mission is to empower organizations with transformative IT solutions and program management services, while our values of integrity, excellence, and teamwork guide everything we do. We foster a culture of open communication, where every voice is heard, and every idea is valued. Join us and be part of a company where your contributions truly make a difference.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.clearancejobs.com
Prepare application

Good distractions

Loading talks and stories from around this role…