Data Engineering

State Street
1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 203K

Job location

Tech stack

Amazon Web Services (AWS)
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Business Analytics Applications
Unit Testing
Big Data
Cloud Computing
Computer Programming
Databases
Information Engineering
Data Governance
ETL
Data Transformation
Data Mining
Data Security
Data Warehousing
Linux
DevOps
File Systems
Identity and Access Management
Python
Machine Learning
Oracle
Oracle Applications
Performance Tuning
Power BI
Shell Script
PL-SQL
SQL Databases
Tableau
Spark
GIT
Pandas
Data Lake
PySpark
Semi-structured Data
Scikit Learn
Information Technology
Data Management
User Administration
Jenkins
Databricks

Job description

This role will be responsible for managing and analyzing terabytes of data hosted in enterprise data warehouse and leveraging large-scale data platforms to advancing new research and product development in the form of thought leadership, market indicators, and analytical tools., As a Data Engineering you will

  • Promote data governance, security, and best practices in managing large volumes of sensitive business data, to compliance with company policies and regulatory requirements.
  • Work with terabytes of structured and semi-structured data from our enterprise data warehouse, primarily stored in Oracle and integrated with Databricks Spark on AWS.
  • Write efficient, production-quality SQL and PL/SQL queries for data extraction and transformation in Oracle.
  • Leverage Databricks Spark and PySpark to process large datasets and build machine learning models in a distributed environment.
  • Collaborate closed with business stakeholders to understand data requirements and translate them into technical solutions.
  • Ensure deployment and operationalization of both traditional and cloud applications.
  • Participate in scope definition, requirements analysis, functional and technical design, application build, product configuration, unit testing, and production deployment.
  • Provide technical expertise and ownership in the diagnosis and resolution of issues, including the determination and provision of workaround solution or escalation to service owners.
  • Conceptual POCs in new technologies or system integrations and scaling it to production grade.
  • Document and interact with business and technology stake holders/team members as necessary.
  • Experience in DevOPS is a plus with hands on experience in Jenkins, Git and any one artifactory tool.

Requirements

State Street Associates (SSA) is looking for a highly skilled and motivated Data Engineering with hands-on experience working with Oracle database and Databricks Spark on AWS., * Masters or B.S. degree in Computer Science, Data Science, Statistics Engineering or a related field.

  • Expertise in Oracle database, with strong proficiency in SQL and PL/SQL, Oracle access control (roles, privileges, user management, and data security).
  • Working knowledge of AWS core services, including S3, EC2/EMR, IAM, Athena, Glue or Redshift.
  • Hands-on experience with Databricks Spark on large datasets, using PySpark, Scala, or SQL. Familiarity with Delta Lake, Unity Catalog or similar data Lakehouse technologies.
  • Proficient in Linux environments, including experience with shell scripting, basic system operations, and navigating file systems.
  • Deep understanding of data warehouse concepts and experience with data modeling, ETL/ELT pipelines, and performance tuning.
  • Solid programming skills in Python for data transformation and machine learning (e.g., pandas, scikit-learn).
  • Experience with BI tools such as Power BI and Tableau.
  • Strong problem-solving and communication skills, with the ability to work across regions.
  • 5+ years of experience in data engineering, with proven work managing large-scale datasets.

Benefits & conditions

$120,000 - $202,500 Annual

The range quoted above applies to the role in the primary location specified. If the candidate would ultimately work outside of the primary location above, the applicable range could differ.

Employees are eligible to participate in State Street's comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans., We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you'll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

About the company

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

Apply for this position