Data Engineer

National Planning Corporation
New York, NY, United States
2 days ago
Apply on dejobs.org
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$99,150.0 - $162,885.0
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Amazon S3 Data Analysis Software as a Service Profiling Code Review Databases Data as a Services Data Architecture Information Engineering Data Governance Data Infrastructure
+29 more
Data Mapping Data Transformation Data Structures Data Stores Data Systems Data Warehousing Relational Databases Database Theory Digital Assets Distributed Computing Environment Python (Programming Language) PostgreSQL Machine Learning NoSQL Oracle (Applications) Performance Tuning Cloud Services Standard Sql SQL Databases Systems Integration Change Data Capture Agentic-AI Data Strategy Pyspark Information Technology Data Analytics Data Management Data Pipelines Databricks

Job description

Guardian is seeking a Data Engineer to join the team responsible for establishing and maintaining an optimized, scalable data pipelines to provide access to high quality, consistent data in an easy and convenient manner to all authorized end users and applications of Guardian and its subsidiaries.

As a Data Engineer, you will play a vital role in our data infrastructure and analytics ecosystem. You will work closely with data architects and data scientists to build and maintain data pipelines, transform raw data into actionable insights, and contribute to the development of cutting-edge data solutions. This is an excellent hands-on opportunity to experience the latest technologies and make a significant impact on our data-driven initiatives. The position will integrate new data sources from enterprise sources and external vendors using a variety of ingestion patterns including Structured Query Language (SQL) Ingestion, File, and Application Programming Interfaces (APIs).

You will

  • Collaborate with cross-functional teams to understand data requirements and translate them into effective data pipelines.
  • Design and maintain reliable batch and real-time ingestion pipelines for databases, files, APIs, event streams, and third-party data sources, including schema evolution, error handling, and data quality controls.
  • Develop and operationalize scalable data pipelines using Python, PySpark, and SQL to transform ingested data into curated, trusted, and business-ready data assets.
  • Leverage Databricks to build, orchestrate, optimize, and govern production-grade data pipelines and data assets.
  • Build governed, high-quality data assets that support analytics, machine learning, and generative AI use cases.
  • Design scalable dimensional and domain-oriented data models, define schemas and data contracts, and optimize data structures for performance and usability.
  • Implement observability, automated data-quality checks, and proactive alerting to ensure pipeline reliability, performance, and compliance with service-level objectives.
  • Participate in code reviews, testing, and documentation efforts to maintain high-quality code and data documentation.
  • Stay updated on industry trends and best practices in data engineering.
  • Continue to look for innovative and next generation solutions for solving data challenges.

You are

A self-starter, self-motivated team player and have excellent communication skills, enabling you to engage with all levels of stakeholders who is fueled by collaboration, able to transform conceptual designs into reliable, scalable processes that meet or exceed customer needs. An individual who works closely with IT and business leaders across the enterprise to drive and embed the Enterprise Data Strategy into transformational roadmaps ensuring key principles of Data Governance, Data Management, Data Analytics and Architecture are implemented.

Requirements

  • 10+ Years of IT experience, with 5+ years of experience as a Data Architect, data engineer or other data professional
  • Expert knowledge of relational and NoSQL database concepts, with hands-on experience across PostgreSQL, Oracle, Databricks, and cloud-native data stores.
  • Expert proficiency in logical, physical, dimensional, and domain-oriented data modeling, including schema design and data contracts; experience with enterprise modeling tools is preferred.
  • Extensive hands-on data engineering experience with distributed data processing and lakehouse technologies, including Python and PySpark on the Databricks platform.
  • Hands-on experience designing and optimizing large-scale data pipelines and data-warehouse architecture using batch and incremental processing, change data capture, orchestration, and schema evolution.
  • Experience with AWS data services and modern cloud data platforms, including Amazon S3, PostgreSQL, and Databricks.
  • Demonstrated expertise with data sourcing, profiling, data mapping and data analysis.
  • Expert SQL skills, including complex query development, performance optimization, data transformations, and scalable data-structure design.
  • Ability to design secure, scalable cloud-native data solutions across object storage, lakehouse platforms, SaaS integrations, relational databases, and NoSQL data stores.
  • Excellent written and verbal communication skills and creative problem-solving skills.
  • Ability to adapt to changing business priorities and experience effectively communicating changes across different levels in the organization.
  • Communication Skills: Articulate the vision and goals, both to the team members and other stakeholders.
  • Emotional Intelligence & Empathy: Motivate, inspire, and resolve conflicts with others while building a positive rapport with team members and partners.
  • Collaboration: Collaborate effectively with the Product Manager and your leadership and keep appraised with key updates and planning. Encourage partnership between team members to create a more dynamic and effective work environment.
  • Strong listeners and able to provide constructive feedback.
  • SAFE experience and the ability to work on a cross functional, self-organizing development teams is a plus.
  • Significant experience interfacing with both customers and management across business and IT
  • Reltio proficiency and Agentic AI development with Bedrock, Guardian Life is not currently or in the foreseeable future sponsoring employment-based visas (e.g., such as an H-1B). In order to be a successful applicant, you must be legally authorized to work in the United States, without the need for employer sponsorship/support now or at any time in the future.

Benefits & conditions

The salary range reflected above is a good faith estimate of base pay for the primary location of the position. The salary for this position ultimately will be determined based on the education, experience, knowledge, and abilities of the successful candidate. In addition to salary, this role may also be eligible for annual, sales, or other incentive compensation.

Our Promise

At Guardian, you’ll have the support and flexibility to achieve your professional and personal goals. Through skill-building, leadership development and philanthropic opportunities, we provide opportunities to build communities and grow your career, surrounded by diverse colleagues with high ethical standards.

About the company

Every day, Guardian helps our 29 million customers realize their dreams through a range of insurance and financial products and services. Our Purpose, to inspire well-being, guides our dedication to the colleagues, consumers, and communities we serve. We know that people count, and we go above and beyond to prepare them for the life they want to live, focusing on their overall well-being - mind, body, and wallet. As one of the largest mutual insurance companies, we put our customers first. Behind every bright future is a GuardianTM. Learn more about Guardian at guardianlife.com .

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org
Prepare application

Good distractions

Loading talks and stories from around this role…