IT - Technology Lead | Big Data - Data Processing | Spark

Cloudspace LLC
Charlotte, NC, United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Compensation
$135,200.0 - $145,600.0
Working hours
Regular working hours

Tech stack

Amazon Web Services Business Logic Big Data Data Transformation Python (Programming Language) Object-Oriented Software Development Software Engineering Data Processing Apache Spark Pyspark Software Coding

Requirements

We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming. The ideal candidate will be responsible for designing, developing, and implementing new features to our existing framework using PySpark and Python. This position requires a deep understanding of data transformation and the ability to create standalone scripts based on given business logic. Proficient in Python, PySpark, and Object-oriented programming concepts. Proven experience as a Senior Data Engineer or similar role. Strong problem-solving techniques with an ability to troubleshoot complex software issues. Experience with AWS is preferred, but not mandatory. Excellent communication skills, both written and verbal. Self-motivated and able to work independently with minimal supervision. Minimum Years of Experience: 8 years Certifications Needed: Top 3 responsibilities you would expect the Subcon to shoulder and execute

About the company

Compass Group

  • Charlotte, NC A family of companies and experiences As the leading foodservice and support services company, Compass Group USA is known for our great people, great service and our great result…

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

4:18 min

Exploring the Apache Spark layer architecture

Ayon Roy · LIVE

Videos

See all

Related articles

See all