Sr. Data Engineer (Python, Pyspark, AWS)

Randstad
Charlotte, NC, United States
5 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$124,800 - $135,200
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Business Logic Data Architecture Data Transformation Software Debugging Python (Programming Language) Object-Oriented Software Development Software Engineering Prompt Engineering Software Troubleshooting Generative AI Agentic-AI
+3 more
Pyspark Data Analytics Software Coding

Job description

We are seeking a highly skilled Senior Data Engineer to join an innovative technology-driven team. This is an exceptional opportunity to enhance your career within the Data and Analytics industry, where you will play a pivotal role in evolving our data architecture and ensuring the seamless delivery of high-performance technical solutions., * Design, develop, and implement new features to the existing data framework using PySpark and Python.

  • Write efficient and effective standalone scripts in PySpark to execute complex transformations based on defined business logic.
  • Apply expert-level Python and Object-Oriented Programming (OOP) concepts to solve intricate problems and build durable, enterprise-grade solutions.
  • Collaborate closely with cross-functional teams to translate business requirements into technical deliverables that support organizational objectives.
  • Perform rigorous testing and debugging of code to ensure high-quality output and system performance.
  • Document programming tasks, procedures, and architectural decisions to facilitate future maintenance and troubleshooting.

Requirements

  • Bachelor’s degree in a relevant field.
  • Proven professional experience as a Senior Data Engineer or in a similar technical capacity.
  • Advanced proficiency in Python, PySpark, and Object-Oriented programming concepts.
  • Demonstrated ability in complex problem-solving and troubleshooting software issues.
  • Strong written and verbal communication skills.
  • Self-motivated with the ability to operate effectively with minimal supervision.
  • Experience with AWS (preferred).
  • Familiarity with Gen AI, Prompt Engineering, MCPs, and Agentic AI (desirable).
  • Ability to complete the required professional assessment during the hiring process.

qualifications:

Bachelor’s degree in a relevant field.

Proven professional experience as a Senior Data Engineer or in a similar technical capacity.

Advanced proficiency in Python, PySpark, and Object-Oriented programming concepts.

Demonstrated ability in complex problem-solving and troubleshooting software issues.

Strong written and verbal communication skills.

Self-motivated with the ability to operate effectively with minimal supervision.

Experience with AWS (preferred).

Familiarity with Gen AI, Prompt Engineering, MCPs, and Agentic AI (desirable).

Ability to complete the required professional assessment during the hiring process.

skills:

Experience with AWS,business logic,data transformation,Object-oriented programming,Object-oriented,PySpark,Python,hands-on coding,Test and debug,software issues,troubleshoot,Self-motivated,able to work independently,minimal supervision

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…