Data Engineer (Apache Spark)

Experis
Charlotte, United States of America
1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Charlotte, United States of America

Tech stack

Performance Tuning
Spark

Job description

  • Consult on or participate in moderately complex initiatives within Software Engineering, contributing to large-scale planning and deliverables.
  • Review and analyze complex Software Engineering challenges, providing in-depth evaluations and solutions.
  • Collaborate with client personnel to meet Software Engineering deliverables, leveraging understanding of policies, procedures, and compliance requirements.
  • Build and enhance new functional features in the SparkFlow framework, including sources, targets, transformations, and governance controls.
  • Support integrating SparkFlow into the Unity control plane by developing interfaces, adapters, and automation workflows., * Opportunity to work on innovative data processing frameworks and AI-enabled solutions.
  • Engagement with cutting-edge technologies in a collaborative environment.
  • Chance to contribute to large-scale enterprise data initiatives.
  • Supportive team environment fostering professional growth.
  • Competitive pay rate aligned with your expertise and experience.

Requirements

Our client, a leading organization in the data and technology sector, is seeking a Sr. Data Engineer (Apache Spark) to join their team. As a Sr. Data Engineer (Apache Spark), you will be part of the Data Engineering Department supporting the Data Solutions team. The ideal candidate will demonstrate strong problem-solving skills, excellent collaboration abilities, and a proactive mindset, which will align successfully in the organization., * 4+ years of Software Engineering experience, with a focus on Apache Spark (Scala, Java, or Python).

  • Experience building frameworks and libraries, including API and abstraction design.
  • Proficiency with CI/CD tools, Git, and build systems like Maven or Gradle.
  • Knowledge of enterprise data ecosystem components such as Hadoop, Hive, Kafka, and cloud storage solutions.
  • Strong understanding of database concepts, UNIX bash scripting, and Spark performance tuning.

About the company

About ManpowerGroup, Parent Company of: Manpower, Experis, Talent Solutions, and Jefferson Wells. ManpowerGroup® (NYSE: MAN), the leading global workforce solutions company, helps organizations transform in a fast-changing world of work by sourcing, assessing, developing, and managing the talent that enables them to win. We develop innovative solutions for hundreds of thousands of organizations every year, providing them with skilled talent while finding meaningful, sustainable employment for millions of people across a wide range of industries and skills. Our expert family of brands - Manpower, Experis, Talent Solutions, and Jefferson Wells - creates substantial value for candidates and clients across more than 75 countries and territories and has done so for over 70 years. We are recognized consistently for our diversity - as a best place to work for Women, Inclusion, Equality and Disability and in 2023 ManpowerGroup was named one of the World's Most Ethical Companies for the 14th year - all confirming our position as the brand of choice for in-demand talent.

Apply for this position