Data Engineer, Officer - State Street Investment Management

State Street
Boston, MA, United States
about 1 month ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$70,000.0 - $118,750.0
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Agile Methodology Artificial Intelligence Amazon Web Services Microsoft Azure Code Generation Continuous Integration Information Engineering Data Infrastructure Data Warehousing Software Debugging Distributed Computing Environment
+21 more
Github Python (Programming Language) Systems Development Life Cycle Reliability Engineering SQL Databases Data Streaming Unstructured Data Data Ingestion GitHub Copilot Snowflake Apache Spark Git Data Lakes Pyspark Information Technology Collibra Data Pipelines Docker Jenkins Databricks Artifactory

Job description

  • Design, develop, test, and maintain data pipelines using Python, PySpark, and SQL.
  • Design, build, and manage robust workflows and data ingestion, transformation solutions using Databricks and Snowflake
  • Hands-on experience with Databricks, Snowflake on AWS (Azure acceptable)
  • Design and maintain CI/CD pipelines using tools such as Jenkins, Artifactory, GitHub.
  • Develop containerized applications for APIs, event based, streaming and batch using Docker.
  • Prior experience on working in Agile project management practices
  • Work under minimal supervision to analyze, design, develop, test, and debug
  • Participate in cross-team group activities to complete assignments.
  • Work with cross-functional teams and other engineers on the core platform capabilities
  • Develop Iceberg, unity catalog based tables for consistent, performant analytical access across multiple compute engines.
  • Partner with product owners, analytics teams, and downstream consumers to translate business requirements into technical solutions
  • Apply AI code generation tools (e.g., Anthropic Code, Codex, and GitHub Copilot) to accelerate development, improve quality, and increase productivity.
  • Excellent verbal and written communication and should be able to work with all the stakeholders.

Requirements

  • Master’s degree in Computer Science or a related engineering discipline.
  • 6-10 years of technology experience with Data Engineeting focus
  • Strong hands-on in Python, Spark, SQL, Databricks and Snowflake, with the ability to design, debug, and optimize distributed data processing;
  • Experience building Lakehouse platforms using Snowflake and Databricks on AWS (Azure acceptable), supporting high concurrency analytical workloads.
  • Proficiency in data engineering and automation
  • 5+ years of hands-on experience building data pipelines on cloud platforms
  • Some experience working on modern Data Platform Architecture, Lakehouse, Data Products, and cloud-native analytics ecosystems.
  • Good understanding of Data Warehousing, Data Lakes, and Data Quality concepts
  • Experience working with both unstructured data sources and processing patterns
  • Exposure with GIT, CI/CD Process for Deployment and Releases.
  • Strong operational and engineering excellence mindset, with experience establishing SDLC standards, CI/CD, observability, reliability engineering, incident management, and continuous improvement practices for mission-critical platforms.
  • Familiarity with AI-assisted development tools (e.g., GitHub Copilot, Codex, Anthropic tools)., * Previous experience in data/platform development within a financial institution.
  • Experience with both structured and unstructured data management tools and associated patterns
  • Familiarity with modern governance frameworks (Unity Catalog, Collibra, Alation).
  • Expertise in AI-assisted coding using GitHub Copilot or Claude Code Assistant.

Benefits & conditions

Pulled from the full job description

  • Health insurance
  • 401(k) matching
  • Paid time off
  • Vision insurance
  • Dental insurance
  • Life insurance
  • Employee assistance program, $70,000 - $118,750 Annual

The range quoted above applies to the role in the primary location specified. If the candidate would ultimately work outside of the primary location above, the applicable range could differ.

Employees are eligible to participate in State Street’s comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans., We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

About the company

State Street Investment Management’s Data, Analytics & AI Services (DAAIS) team is looking for a Data Engineer - Officer to be part of the architecture, engineering execution, modernization strategy, and technology roadmap supporting the investment management business. The successful candidate will bring hands-on development expertise in large-scale data platform architecture, distributed computing, data pipeline engineering, and modern cloud architecture.

Why this role is important to us

The team you will be joining is a part of State Street Investment Management, one of the largest asset managers in the world. We partner with many of the world’s largest, most sophisticated investors and financial intermediaries to help them reach their goals through a rigorous, research-driven investment process. With over four decades of experience and trillions of dollars in assets under management, we offer one of the broadest selections of services across asset classes, risk profiles, regions and styles. As pioneers in index, ETF, and ESG investing, we are always inventing new ways to invest.

Join us if making your mark in the asset management industry from day one is a challenge you are up for., Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · World Congress 2023

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

Videos

See all

Related articles

See all