Data Engineer

Cyber Sphere LLC
New York, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote
New York, United States of America

Tech stack

.NET
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Information Engineering
Data Governance
ETL
Data Systems
Financial Information EXchange
IBM WebSphere MQ
Performance Tuning
Query Optimization
Queueing Systems
RabbitMQ
Cloud Services
SQL Stored Procedures
Transaction Data
Datadog
Sql Optimization
Indexer
Amazon Web Services (AWS)
Kubernetes
Kafka
REST
Stream Processing
Data Pipelines
Serverless Computing
Docker

Job description

Senior Data Engineer with extensive Capital Markets experience to support the design, development, and implementation of trade lifecycle data solutions. The consultant will be responsible for building cloud-native data pipelines, onboarding complex financial data sources, and supporting a unified trade architecture that enables trade processing, reconciliation, settlement, and exception management functions.

Requirements

Skills Needed: +10 years in the following: Data Engineering within Capital Markets environment, Developing ETL pipelines using .NET application code, Writing .NET applications using RabbitMQ libraries, Complete trade lifecycle, ISO 15022, AWS, Advanced SQL Server, MQ Technologies and frameworks, etc, This role requires strong technical expertise combined with deep knowledge of post-trade processing, DTCC platforms, and financial messaging standards., * 10+ years of Data Engineering experience within Capital Markets environments.

  • Strong Experience developing ETL pipelines using .NET application code and deploying solutions into containerized Kubernetes environments.
  • Strong experience writing .NET applications utilizing RabbitMQ libraries for message queue integration and event-driven processing.
  • Strong understanding of the complete trade lifecycle, including execution, clearing, settlement, and reconciliation.
  • Extensive experience designing and implementing ETL/ELT data pipelines.
  • Strong expertise in data modeling, schema design, and transaction data architecture.
  • Hands-on experience with DTCC platforms, specifically RTTM and Settlement Web.
  • Strong knowledge of ISO 15022 financial messaging standards.
  • Experience developing ingestion frameworks utilizing MQ technologies (IBM MQ, RabbitMQ, Kafka, or similar) and REST APIs.
  • Advanced SQL Server expertise including performance tuning, indexing, query optimization, and stored procedure development.
  • Strong experience with AWS cloud-native services, including S3, EKS, Kubernetes, Docker, and RDS.
  • Excellent troubleshooting, analytical, and problem-solving capabilities.

Preferred Experience

  • Unified Trade Record (UTR) schema design and implementation.
  • Trade Exceptions platform development and support.
  • Real-time or near real-time data processing architectures.
  • Data governance, lineage, cataloging, and observability tooling.
  • Regulatory reporting and compliance data requirements within Capital Markets.
  • FIX protocol message processing.
  • FxML message processing.
  • Previous consulting or client-facing delivery experience.

Apply for this position