Data Engineer
Susquehanna International Group, LLP
Philadelphia, PA, United States
26 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source
Tech stack
Apache HTTP Server
Big Data
Data Architecture
Information Engineering
Data Systems
Distributed Computing Environment
Python (Programming Language)
Performance Tuning
Query Optimization
Parquet
Data Processing
Snowflake
+6 more
Apache Spark
Integration Frameworks
Apache Kafka
Data Management
Data Pipelines
Databricks
Job description
We are hiring a Data Engineer to join our Data Technologies team. This team partners with middle-and back-office application teams to design, build, and support next-generation data platforms and pipelines that ingest, process, and transform large-scale data into business-ready datasets. We are looking for an experienced data engineer who is passionate about modern data architectures, distributed data processing, and scalable analytics platforms.
In this role, you will:
- Design, develop, and support scalable data pipelines and data products for middle- and back-office systems
- Architect and implement modern data platform solutions
- Build and optimize large-scale batch and streaming data processing workflows
- Collaborate with application teams to model, transform, and deliver data solutions that meet business requirements
- Monitor, troubleshoot, and optimize data processing environments to ensure reliability, scalability, and performance
Requirements
- 5+ years of experience in data engineering, data platforms, or large-scale distributed data processing
- Strong experience with modern data engineering technologies such as Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and/or Kafka
- Strong Python development skills required
- Experience designing and optimizing high-volume data pipelines and data processing frameworks
- Experience with query optimization and performance tuning in large-scale analytical environments
- Experience with on-premises data platforms preferred
- Industry experience within capital markets or financial services is required
- Domain knowledge particularly Operations and/or Compliance, is highly preferred
- Ability and flexibility to provide occasional off-hours/weekend support
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
BB
Benedikt Bischof
about 4 years ago
DS
Dhannush Subramani
Top Big Data Technologies That You Need to Know
about 4 years ago
EM
Eli McGarvie
Data Engineer Salary UK
about 3 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
CH
Chris Heilmann
Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production
almost 2 years ago
EM
Eli McGarvie
Data Analyst Salary in Switzerland
about 3 years ago