Associate - Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+15 more
Job description
You will apply modern data engineering practices and technologies, including dbt, PySpark, AWS Glue, Databricks, and Kafka, while helping ensure data solutions meet expectations for quality, consistency, governance, and scalability., * Build and maintain scalable data models and pipelines using dbt, PySpark, AWS Glue, Databricks, and streaming technologies to deliver clean, reliable, and well-structured data for analytics, data science, and AI use cases.
- Apply software engineering best practices across data development, including version control, testing, integration, code reviews, and pull request approvals, to promote quality and consistency.
- Partner with data scientists, business stakeholders, and data stewards to source strategic enterprise data, address data quality and availability needs, and align solutions with data governance standards.
- Translate business and technical requirements into actionable development plans and Jira stories, establish milestones, and manage work through delivery.
- Collaborate with Technology teams on data strategy, tooling, system integrations, and deployment processes while clearly communicating technical concepts and recommendations to diverse stakeholders.
Requirements
- 2-5+ years of relevant data engineering or related experience, including hands-on experience building and maintaining dbt data models and transformation pipelines.
- Proficiency with AWS Glue, including ETL development, job orchestration, and catalog integration, and experience using PySpark for data processing.
- Strong working knowledge of Databricks, including SQL, notebooks, and distributed data processing.
- Experience with Kafka or comparable streaming technologies for real-time data ingestion and processing.
- Strong analytical and problem-solving skills, with the ability to troubleshoot complex data and engineering issues and develop practical solutions.
- Effective communication and collaboration skills, with the ability to work across technical and business teams and explain technical concepts to varied audiences.
Preferred Skills
- Experience with Google Cloud Platform (GCP) or related cloud data technologies.
- Experience working in the insurance, financial services, or another regulated industry.
- Experience partnering with data science teams to support analytics, machine learning, or AI use cases.
Benefits & conditions
Actual base salary will be determined based on several factors but not limited to individual’s experience, skills, qualifications, and job location. Additionally, employees are eligible for an annual discretionary bonus. In addition to base salary, employees may also be eligible to participate in an incentive program.
About the company
Within the Tech, Data, AI, Ventures (TDAV) organization, our work is guided by a shared vision: deploying the power of technology, data, AI and ventures to accelerate sustainable competitive advantage for New York Life’s businesses. We build solutions that power how we serve policy owners, agents, advisors and employees while delivering measurable business outcomes.
Across technology, data, AI, cyber, product, digital experience, architecture and infrastructure, TDAV combines the scale and investment of an industry leader, access to leading-edge technologies and the opportunity to help shape how a world-class financial services company competes in the AI era - all backed by the stability and purpose of a mutual company built to last., At New York Life, our 180-year legacy of purpose and integrity fuels our future. As we evolve into a more technology-, data-, and AI-enabled organization, we remain grounded in the values that drive lasting impact.
Our diverse business portfolio creates opportunities to make a difference across industries and communities-inviting bold thinking, collaborative problem-solving, and purpose-driven innovation. Here, you’ll find the rare balance of long-standing stability and forward momentum, supported by an inclusive team that honors tradition while embracing progress.
As a Fortune 100 mutual company, we offer a place to grow your skills, contribute to meaningful work, and deliver solutions that matter. Your ideas drive what’s next, and your growth powers it.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…