Big Data/Machine Learning Engineer - Sr

Join a dynamic team where you will be responsible for designing and implementing high-performance data pipelines to handle large volumes of data. This role requires expertise in ensuring data integrity through advanced quality checks and lineage tracking. You will work in a collaborative environment focused on innovation and excellence.

• Expert-level proficiency in Python and PySpark.
• Deep hands-on experience with AWS Glue and Amazon EMR.
• Proven track record of building scalable pipelines for large-scale data (Terabyte-scale preferred).
• Demonstrated experience implementing frameworks for Data Lineage and Data Quality.
• Strong experience working with S3-based lakes and relational databases (RDS/PostgreSQL/MySQL).
• Must have previous client experience working for this customer in the past 5 years.

Preferred Skills & Qualifications

• Experience within the Financial Services industry is a huge plus.
• Experience with Kinesis or Kafka integration for low-latency data delivery.
• Familiarity with CI/CD for data pipelines and Infrastructure as Code.

Competitive and commensurate with experience, Day-to-Day Responsibilities

• Design and implement high-performance data pipelines.
• Ensure data integrity through advanced quality checks and lineage tracking.
• Collaborate with cross-functional teams to optimize data workflows.

Company Benefits & Culture

• Competitive salary and comprehensive benefits package.
• Inclusive and innovative company culture.
• Opportunities for professional growth and development.