Integration Data Engineer

Mizuho Americas Services LLC
Jersey City, NJ, United States
7 days ago
Apply on www.jofdav.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
$77,000 - $135,000
Working hours
Regular working hours
Job source

Tech stack

Data Analysis Big Data Cloud Computing Cloud Database Code Review Computer Programming Extract Transform Load (ETL) Data Warehousing Database Queries Python (Programming Language) Microsoft SQL Server Online Analytical Processing
+19 more
NumPy Online Transaction Processing Reverse Engineering SQL Stored Procedures SQL Databases Talend Enterprise Data Management Cloud Platform System Azure Data Factory Snowflake Pandas Pyspark Information Technology Data Analytics Data Management Data Pipelines Service Stack Databricks Programming Languages

Job description

We are seeking an Integration Data engineer with a background in SQL and data warehousing for enterprise level systems. The ideal candidate is comfortable working with business users along with business analyst expertise.

Major Responsibilities:

  • Design, develop, and deploy Databricks jobs to process and analyze large volumes of data.
  • Collaborate with data engineers and data scientists to understand data requirements and implement appropriate data processing pipelines.
  • Optimize Databricks jobs for performance and scalability to handle big data workloads.
  • Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
  • Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
  • Demonstrated proficiency with Data Analytics, Data Insights
  • Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process
  • Leverage SQL, programming language (Python or similar) and/or ETL Tools (Azure Data Factory, Data Bricks, Talend and SnowSQL) to develop data pipeline solutions to ingest and exploit new and existing data sources.
  • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

Requirements

  • 5+ years - Enterprise Data Management

  • 5+ years - SQL Server based development of large datasets

  • 5+ years with Data Warehouse Architecture, hands-on experience with Databricks platform. Extensive experience in PySpark coding. Snowflake experience is good to have

  • 3+ years Python(numpy, pandas) coding experience

  • 3+ years’ experience in Finance / Banking industry - some understanding of Securities and

Banking products and their data footprints.

  • Experience with Snowflake utilities such as SnowSQL and SnowPipe - good to have

  • Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.

  • Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills

  • Capable of discussing enterprise level services independent of technology stack

  • Experience with Cloud based data architectures, messaging, and analytics

  • Superior communication skills

  • Cloud certification(s) preferred

  • Any experience with Regulatory Reporting is a Plus

Education

  • Minimally a BA degree within an engineering and/or computer science discipline

  • Master’s degree strongly preferred

Education

  • Minimally a BA degree within an engineering and/or computer science discipline

  • Master’s degree strongly preferred

Benefits & conditions

The expected base salary ranges from $77,000 - $135,000. Salary offers are based on a wide range of factors including relevant skills, training, experience, education, and, where applicable, certifications and licenses obtained. Market and organizational factors are also considered. In addition to salary and a generous employee benefits package, including Medical, Dental and 401K plans, successful candidates are also eligible to receive a discretionary bonus.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.jofdav.com
Prepare application

Good distractions

Loading talks and stories from around this role…