Lead Data Engineer | Python, PySpark, AWS, and Jenkins
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
Job description
- Design, develop, and maintain scalable data engineering and machine learning solutions.
- Build and optimize data pipelines using Python and PySpark.
- Leverage AWS services to support cloud-based data processing and application development.
- Develop, enhance, and maintain CI/CD pipelines using Jenkins.
- Troubleshoot performance, reliability, and data quality issues.
- Collaborate with data scientists, software engineers, and business stakeholders.
- Provide technical leadership, code reviews, and guidance to other team members.
- Apply best practices for testing, deployment, monitoring, and production support.
Requirements
Position Overview We are seeking a Lead Data Engineer to support data engineering and machine learning initiatives. The ideal candidate will have strong hands-on experience with Python, PySpark, AWS, and Jenkins, along with the ability to lead technical development and collaborate across engineering teams., * Strong professional experience with Python and PySpark.
- Hands-on experience developing solutions in AWS environments.
- Experience building or supporting CI/CD pipelines using Jenkins.
- Strong understanding of big data processing and data engineering principles.
- Ability to lead technical initiatives and work effectively in a collaborative environment.
- Excellent communication, analytical, and problem-solving skills.
Benefits & conditions
Estimated Min Rate: $63.23 Estimated Max Rate: $90.33
Whatβs In It for You?
We welcome you to be a part of the largest and legendary global staffing companies to meet your career aspirations. Yohβs network of client companies has been employing professionals like you for over 65 years in the U.S., UK and Canada. Join Yohβs extensive talent community that will provide you with access to Yohβs vast network of opportunities and gain access to this exclusive opportunity available to you. Benefit eligibility is in accordance with applicable laws and client requirements. Benefits include:
- Medical, Prescription, Dental & Vision Benefits (for employees working 20+ hours per week)
- Health Savings Account (HSA) (for employees working 20+ hours per week)
- Life & Disability Insurance (for employees working 20+ hours per week)
- MetLife Voluntary Benefits
- Employee Assistance Program (EAP)
- 401K Retirement Savings Plan
- Direct Deposit & weekly epayroll
- Referral Bonus Programs
- Certification and training opportunities
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦