data engineer

Susquehanna International Group, LLP

Bala Cynwyd, PA, United States

8 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Working hours

Regular working hours

Job source

www.careerbuilder.com

Tech stack

Apache HTTP Server Big Data Data Architecture Information Engineering Data Files Data Systems Distributed Computing Environment Python (Programming Language) Performance Tuning Systems Development Life Cycle Query Optimization Software Engineering

+10 more

Parquet Data Processing Scripting Snowflake Apache Spark Integration Frameworks Apache Kafka Data Management Data Pipelines Databricks

Job description

We are hiring a Data Engineer to join our Data Technologies team. This team partners with middle-and back-office application teams to design, build, and support next-generation data platforms and pipelines that ingest, process, and transform large-scale data into business-ready datasets. We are looking for an experienced data engineer who is passionate about modern data architectures, distributed data processing, and scalable analytics platforms.

In this role, you will:

Design, develop, and support scalable data pipelines and data products for middle- and back-office systems
Architect and implement modern data platform solutions
Build and optimize large-scale batch and streaming data processing workflows
Collaborate with application teams to model, transform, and deliver data solutions that meet business requirements
Monitor, troubleshoot, and optimize data processing environments to ensure reliability, scalability, and performance

Requirements

5+ years of experience in data engineering, data platforms, or large-scale distributed data processing
Strong experience with modern data engineering technologies such as Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and/or Kafka
Strong Python development skills required
Experience designing and optimizing high-volume data pipelines and data processing frameworks
Experience with query optimization and performance tuning in large-scale analytical environments
Experience with on-premises data platforms preferred
Industry experience within capital markets or financial services is required
Domain knowledge particularly Operations and/or Compliance, is highly preferred
Ability and flexibility to provide occasional off-hours/weekend support, Analysis Skills, Apache, Apache Kafka, Capital Markets, Data Management, Data Processing, Data Sets, Financial Services, Identify Issues, Performance Tuning/Optimization, Python Programming/Scripting Language, Query Optimization, Scalable System Development, Software Design, Technical Recruiting