Data Engineer - Hanover, NJ

We’re looking for an experienced Data Engineer to design, build, and optimize scalable, cloud-native data platforms supporting batch and real-time processing, analytics, and enterprise reporting. The ideal candidate will have strong hands-on expertise in Python, SQL, PySpark, ETL/ELT, cloud data engineering, and modern Lakehouse architectures, along with the ability to lead technical discussions and mentor engineering teams., Design develop and maintain scalable and reliable data pipelines for batch and realtime processing

Build and manage enterprise data lakes data warehouses and data marts

Develop ETLELT solutions using modern data engineering tools and frameworks

Collaborate with business stakeholders architects analysts and data scientists to understand data requirements

Optimize data processing workflows for performance scalability and cost efficiency

Implement data quality lineage governance and monitoring frameworks

Design and maintain data models supporting analytics and reporting use cases

Lead technical design discussions and provide engineering best practices

Troubleshoot complex data integration and performance issues

Mentor junior engineers and conduct code reviews

Support CICD automation and infrastructure ascode initiatives

Data Engineering

Strong experience in designing and building largescale data platforms

Expertise in data warehousing and dimensional modeling

Experience with ETLELT design and implementation

Strong understanding of data governance metadata management and data quality frameworks

Programming Databases

Advanced proficiency in Python and SQL

Experience with Spark PySpark for largescale data processing

Strong knowledge of relational and NoSQL databases

Cloud Technologies

Experience with one or more cloud platforms, Azure Data Factory ADF

Azure Synapse Analytics

Azure Databricks

ADLS Gen2

Big Data Streaming

Apache Spark

Kafka

Kinesis

Hadoop ecosystem preferred

DevOps Automation

Git

Jenkins GitHub Actions Azure DevOps

Terraform or Cloud Formation

Docker and Kubernetes preferred

Preferred Qualifications

Experience with Apache Iceberg Delta Lake or Hudi

Handson experience with Snowflake or Databricks

Experience implementing Lakehouse architectures

Working knowledge of Data Mesh and modern data platform concepts

Exposure to AIML data pipelines and feature engineering

Experience in Banking Financial Services or Capital Markets domains