Data Engineer

Learn Beyond Consulting LLC
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Tech stack

Java
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Information Engineering
Data Integration
ETL
Data Transformation
Data Security
Hadoop
Identity and Access Management
Python
Snowflake
Data Lake
Data Pipelines
Amazon Web Services (AWS)
Databricks

Job description

The Role: We are looking for a highly skilled Senior Data Engineer (603 Level / VP equivalent) to lead a massive data platform modernization initiative for a top-tier global bank. You will be the technical driving force behind migrating legacy AWS EMR data pipelines to a modern, high-performance ecosystem utilizing Databricks and Snowflake.

This is a high-visibility role focused on integrating complex external data sources (such as Equifax) and making them consumable across the enterprise. Beyond deep technical acumen, this role requires technical leadership maturity, as it has a direct path to grow into a people-management position., * Lead Migrations: Architect and execute the migration of legacy data workloads from AWS EMR to Databricks and Snowflake.

  • External Ingestion: Design and manage secure, scalable data movement pipelines between external partners (e.g., Equifax) and internal enterprise systems.
  • Modernization: Build optimized, scalable data transformation frameworks to handle a massive influx of new data sources across the organization.
  • Technical Leadership: Act as the subject matter expert. Mentor junior engineers, set coding/architecture standards, and drive best practices.
  • Optimization: Ensure data pipelines are performant, cost-effective, and compliant with strict financial data governance standards.

Requirements

  • 10+ years of professional experience in Data Engineering.
  • 3 4+ years of hands-on, heavy experience with Databricks and Snowflake.
  • Strong proficiency in Python or Java for building data pipelines.
  • Proven AWS experience (specifically S3, IAM, Glue, and EMR).
  • Concrete experience migrating from EMR (or Hadoop) to Databricks/Snowflake.
  • Experience working with external/third-party data integrations.
  • Leadership capabilities with a demonstrated interest in growing into a people-leadership role., * Experience in the Financial Services/Banking industry.
  • Experience handling highly sensitive data (PII/PCI) and understanding of data security/encryption.
  • Familiarity with Medallion Architecture (Bronze/Silver/Gold) and Delta Lake.

Apply for this position