Sr Data Engineer (AWS/Python/Scala)
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+14 more
Job description
We are seeking a Senior Big Data/Machine Learning Engineer to support the design, development, and implementation of scalable data engineering and machine learning solutions. The ideal candidate will have strong experience with Python, Scala, AWS data services, distributed processing, streaming technologies, SQL, and REST APIs.
Responsibilities
- Design, develop, test, and support scalable data engineering solutions.
- Build and maintain data pipelines using AWS services, including EMR and Glue.
- Develop distributed data processing applications using Python and Scala.
- Implement real-time and event-driven data solutions using Kafka and streaming technologies.
- Create and integrate REST APIs to support data and application workflows.
- Write complex SQL queries for data transformation, analysis, validation, and troubleshooting.
- Collaborate with data scientists, software engineers, architects, and business stakeholders.
- Ensure solutions meet standards for performance, reliability, scalability, security, and data quality.
- Troubleshoot production issues and support ongoing enhancements to data platforms.
- Contribute to technical documentation, code reviews, testing, and Agile delivery practices.
- Apply machine learning or artificial intelligence capabilities where appropriate.
Requirements
- Senior-level experience in data engineering, big data, or machine learning engineering.
- Strong hands-on experience with Python and/or Scala.
- Experience developing solutions in AWS environments.
- Practical experience with AWS EMR and AWS Glue.
- Experience building and consuming REST APIs.
- Experience with Kafka and streaming data architectures.
- Strong SQL development and data manipulation skills.
- Experience working with distributed data processing and large-scale data platforms.
- Strong communication and collaboration skills.
Preferred Qualifications
- Experience applying artificial intelligence or machine learning techniques.
- Experience with Spark, PySpark, or similar big data frameworks.
- Familiarity with AWS data, storage, and security services.
- Experience supporting production data pipelines and enterprise applications.
- Prior experience in financial services or other highly regulated environments.
Benefits & conditions
Estimated Min Rate: $52.73 Estimated Max Rate: $80.00
What’s In It for You?
We welcome you to be a part of the largest and legendary global staffing companies to meet your career aspirations. Yoh’s network of client companies has been employing professionals like you for over 65 years in the U.S., UK and Canada. Join Yoh’s extensive talent community that will provide you with access to Yoh’s vast network of opportunities and gain access to this exclusive opportunity available to you. Benefit eligibility is in accordance with applicable laws and client requirements. Benefits include:
- Medical, Prescription, Dental & Vision Benefits (for employees working 20+ hours per week)
- Health Savings Account (HSA) (for employees working 20+ hours per week)
- Life & Disability Insurance (for employees working 20+ hours per week)
- MetLife Voluntary Benefits
- Employee Assistance Program (EAP)
- 401K Retirement Savings Plan
- Direct Deposit & weekly epayroll
- Referral Bonus Programs
- Certification and training opportunities
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…