Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+49 more
Job description
We are seeking a hands-on Data Engineer with strong experience in building scalable enterprise data solutions within Financial Services environments. The ideal candidate will have expertise in cloud-based data platforms, modern data engineering practices, and large-scale data integration initiatives supporting operational, analytical, and regulatory data needs. This role requires strong technical capabilities in data pipeline development, cloud data processing, Master Data Management (MDM), and enterprise data integration. The candidate should be comfortable working across complex distributed environments and partnering with architecture, analytics, governance, and business teams to deliver reliable, secure, and scalable data solutions., Design, develop, and support scalable data pipelines and enterprise data integration solutions. Build and maintain batch and real-time data ingestion, transformation, and processing frameworks. Develop cloud-native data engineering solutions supporting enterprise data lake, warehouse, and lakehouse platforms. Implement ETL/ELT processes for structured, semi-structured, and unstructured data sources. Support Master Data Management (MDM) initiatives across security, account, client, and reference data domains. Collaborate with data architects, business analysts, governance teams, and application teams to support enterprise data initiatives. Implement data quality validation, monitoring, metadata management, and lineage processes. Support cloud migration and modernization efforts involving legacy and enterprise data platforms. Optimize data processing, storage, and pipeline performance for scalability and operational efficiency. Ensure compliance with enterprise security, governance, and regulatory standards within financial services environments. Support reporting, analytics, and downstream consumption platforms through reliable and trusted data delivery.
Requirements
- Financial services experience
- Data pipeline development
- Databricks/Delta Lake
- Master Data Management (MDM)(Golden Source) integration
- Strong SQL and data engineering skills
- Oracle to Cloud migration experience
- Data quality and reconciliation, Strong hands-on experience in Data Engineering and enterprise-scale data integration. Proven experience developing scalable ETL/ELT pipelines and distributed data processing solutions. Experience working with modern cloud-based data platforms and data ecosystems. Hands-on expertise with: Strong SQL expertise along with programming/scripting experience in Python, PySpark, or Snowpark. Experience with dbt (Data Build Tool) for: o Data transformation and modeling o ELT pipeline development within Snowflake/Databricks o Modular, reusable SQL-based data workflows o Data testing, documentation, and version control integration Experience with cloud platforms such as Azure, AWS, or Google Cloud Platform, including integration with Snowflake and Databricks. Solid understanding of data lake, data warehouse, and lakehouse architectures, and their implementation across platforms. Experience with orchestration and workflow tools (e.g., Airflow, Databricks Workflows, Snowflake Tasks) for pipeline scheduling and automation. Experience supporting Master Data Management (MDM) and enterprise data governance initiatives. Familiarity with metadata management, data lineage, data cataloging, and data quality processes. Experience integrating diverse data sources, including: o APIs and microservices o File-based ingestion (batch) o Real-time/streaming data (e.g., Kafka, Spark Streaming) Knowledge of performance tuning, cost optimization, and scalability techniques across both Spark-based and Snowflake environments. Understanding of enterprise security, compliance, and governance standards, including RBAC, data masking, and encryption. Experience working in Agile and DevOps environments, including CI/CD for data pipelines., Financial Services or Banking industry experience preferred. Experience supporting regulatory, risk, compliance, or operational reporting data environments. Exposure to real-time data processing and streaming technologies. Familiarity with CI/CD processes and infrastructure automation. Strong analytical, troubleshooting, and problem-solving skills. Excellent communication and collaboration skills.
Education: Bachelor s degree in Computer Science, Information Systems, or Engineering
About the company
We welcome you to be a part of the largest and legendary global staffing companies to meet your career aspirations. Yoh s network of client companies has been employing professionals like you for over 65 years in the U.S., UK and Canada. Join Yoh s extensive talent community that will provide you with access to Yoh s vast network of opportunities and gain access to this exclusive opportunity available to you. Benefit eligibility is in accordance with applicable laws and client requirements. Benefits include
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Top Big Data Technologies That You Need to Know
Highest Paying Tech Companies for Developers
Data Engineer Salary UK
How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again