Senior Data Engineer

• Senior Data Engineer Position Summary: The Senior Data Engineer leads complex data engineering projects, working on designing data architectures that align with business requirements.
• This role focuses on optimizing data workflows, managing data pipelines, and ensuring the smooth operation of data systems., * Responsibilities: Leads development of data pipelines and architectures that handle large-scale data sets.
• Designs, constructs, and tests data architecture aligned with business requirements.
• Provides technical leadership for data projects, ensuring best practices and high-quality data solutions.
• Collaborates with product, finance, and other business units to ensure data pipelines meet business requirements.
• Oversees development of data solutions that enable predictive and prescriptive analytics.
• Ensures the technical quality of solutions, managing data as it moves across environments.
• Aligns data architecture to Healthfirst solution architecture.

• Minimum Qualifications: 8+ Years overall IT experience with minimum 5 years of work experience in below tech skills.
• Tech Skills: Strong experience in Python Scripting and PySpark for data processing.
• Proficiency in SQL, dealing with big data processing.
• Proven experience in data processing for data lake in Iceberg format, with strong understanding of architecture.
• Experience in AWS Glue jobs.
• Experience in AWS cloud platform and its data services (S3, Redshift, Lambda, EMR, Airflow, Postgres, SNS, Event bridge).
• Expertise in BASH/Shell scripting.
• Strong understanding of healthcare Finance systems and experience leading data engineering teams.
• Experience in Agile environments.
• Excellent problem-solving skills and attention to detail.
• Effective communication and collaboration skills.

At BNY, our culture allows us to run our company better and enables employees’ growth and success. As a leading global financial services company at the heart of the global financi…