Senior Data Integration Engineer - New York, NY - DIE26-06669

Navitas, Inc.
Newark, NY, United States
3 months ago
Apply on indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Compensation
$166,400.0 - $208,000.0
Working hours
Regular working hours
Job source

Tech stack

Agile Methodology Microsoft Azure Big Data Computer Programming Continuous Integration Information Engineering Data Integration Extract Transform Load (ETL) Data Systems Distributed Computing Environment Python (Programming Language) Raw Data
+11 more
SQL Databases Enterprise Data Management Snowflake Apache Spark Data Lakes Pyspark Gitlab-ci Atlassian Tools Data Pipelines Jenkins Databricks

Job description

  • Design, develop, and maintain scalable data pipelines for counterparty, trade, collateral, and market data integration.
  • Build and support ETL/ELT solutions using Python, PySpark, Databricks, and SQL.
  • Integrate risk and trading data into Counterparty Credit Risk (CCR) calculation and reporting platforms.
  • Partner with Risk, Business Analysts, and Technology teams to gather requirements and deliver data solutions.
  • Ensure data quality, reconciliation, monitoring, and governance across risk data platforms.
  • Support exposure analytics, including EPE, PFE, EAD, stress testing, and regulatory reporting.
  • Investigate and resolve data and production issues through root cause analysis and permanent fixes.
  • Implement automation, monitoring, and operational improvements to enhance platform reliability.
  • Lead platform enhancements, migrations, and strategic data initiatives.
  • Maintain technical documentation and support audit and regulatory data requests.

Requirements

Do you have experience in Spark?, * Must be eligible for Security Clearance.

  • Only candidates with 10+ years of experience will be considered., We are seeking a Senior Data Integration Engineer to design, develop, and support scalable data integration solutions for Counterparty Credit Risk (CCR) platforms. The ideal candidate will have strong experience with Python, SQL, Databricks, and PySpark, and a proven background in risk data, ETL development, and financial services., * 10+ years of experience in Python development and advanced SQL programming.
  • 5+ years of experience in Data Engineering, Data Integration, or Enterprise Data Management within Financial Services.
  • 3+ years supporting Risk, Exposure Management, or Counterparty Credit Risk platforms in a senior technical leadership capacity.
  • 3+ years of hands-on experience with Databricks and PySpark for large-scale data processing and ETL development.
  • Experience working within globally distributed support and delivery models.

Technical Skills

  • Strong experience with Python, SQL, PySpark, Databricks, and Snowflake.
  • Experience building ETL/ELT pipelines and large-scale data integration solutions.
  • Knowledge of Counterparty Credit Risk (CCR), including EPE, PFE, EAD, collateral, and exposure management.
  • Experience with Azure Cloud, Data Lakes, ADF, and distributed data processing frameworks.
  • Familiarity with CI/CD tools such as Jenkins, GitLab CI, or Azure DevOps.
  • Experience working in Agile environments using JIRA and Confluence.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

1:02 min

Applying an ETL methodology to infrastructure configuration management

Axel Barbier · World Congress 2023

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

Videos

See all

Related articles

See all