Asset&Wealth Management-Senior Cloud Data Engineer-Vice President-Dallas
The Goldman Sachs Group Inc
Dallas, TX, United States
9 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours
Job source
Tech stack
Kubernetes Security
Java (Programming Language)
Artificial Intelligence
Airflow
Amazon Web Services
Amazon Elastic Compute Cloud
Apache HTTP Server
Unit Testing
Big Data
Cloud Computing
Cloud Database
Code Review
+35 more
Computer Programming
System Configuration
Data Validation
Information Engineering
Data Infrastructure
Extract Transform Load (ETL)
Data Warehousing
Github
Identity and Access Management
Interoperability
Python (Programming Language)
Open Source Technology
Performance Tuning
SQL Databases
Data Streaming
Workflow Management Systems
AWS Cdk
GitHub Copilot
Snowflake
Apache Spark
AWS ECS
Containerization
Pyspark
Gitlab-ci
Information Technology
AWS Glue
AWS Fargate
Apache Kafka
Cloudwatch
Terraform
Data Pipelines
Serverless Computing
Amazon Elastic Mapreduce (EMR)
Docker
Microservices
Job description
- Hands-on Pipeline & Microservices Migration: + Active Migration Execution: Directly execute the migration of legacy ETL and microservices to AWS. This includes refactoring monolithic code into containerized services and deploying them to Amazon ECS (Fargate/EC2). + Containerization & Orchestration: Build and maintain Docker images, write complex ECS Task Definitions, and configure service-to-service communication using Amazon ECS Service Connect and AWS Cloud Map. + Data Pipeline Engineering: Develop end-to-end data flows using AWS Glue (PySpark), Amazon EMR, and Snowflake. Implement āLakehouseā patterns using Apache Iceberg to ensure data portability.
- Infrastructure & Automation-as-Code + IaC Development: Write and maintain production-grade Terraform or AWS CDK modules to provision VPCs, ECS clusters, and RDS instances. Ensure all infrastructure is version-controlled and deployed via GitHub Actions or GitLab CI. + AI-Augmented Coding: Actively use AI coding assistants (e.g., GitHub Copilot) to refactor legacy SQL, generate unit tests, and automate the creation of boilerplate pipeline code. + Toil Reduction: Identify manual bottlenecks in the migration process and build custom automation tools in Python or Go to streamline data validation and schema conversion.
- Technical Leadership & Reliability + Code Reviews & Standards: Lead rigorous peer code reviews, enforcing standards for performance, security (IAM least privilege), and maintainability. + Observability Implementation: Hands-on configuration of Amazon CloudWatch Container Insights, and OpenTelemetry to ensure deep visibility into migrated microservices and data jobs. + Performance Tuning: Directly optimize Spark job configurations, Snowflake warehouse sizing, and ECS auto-scaling policies to balance performance.
Requirements
We are seeking a high-caliber, hands-on Senior Cloud Data Engineer. While you will provide architectural guidance, your primary impact will come from hands-on engineering: building production-ready data pipelines, containerizing microservices for Amazon ECS, and executing the technical migration of legacy on-premises systems to AWS., Technical Requirements
- Experience: 8+ years of hands-on experience in Data Engineering and Cloud Infrastructure, with a focus on building and migrating production workloads.
- AWS ECS Expertise: Deep technical expertise in Amazon ECS (Fargate/EC2), including networking (ALB/NLB), task placement strategies, and container security.
- Data Platform Expertise: Proven experience with modern data platforms such as Snowflake (AI Data Cloud) and cloud-native services. Good understanding of open-source table formats, specifically Apache Iceberg, to enable interoperability, schema evolution, and high-performance analytics across multiple engines.
- Programming: Expert-level proficiency in Java, Python and SQL.
- Big Data & Orchestration: Hands-on experience with Spark, Kafka, and orchestration tools like Apache Airflow, Dagster, or dbt.
- Data Modeling: Deep understanding of data warehousing and modern data lakehouse architecture.
Leadership & Soft Skills
- Mentorship: Proven track record of upskilling junior engineers.
- Communication: Ability to explain complex technical concepts to non-technical stakeholders in the wealth management business.
- Problem Solving: A ābuilderā mindset with the ability to navigate ambiguity in a fast-paced environment.
Education
- Bachelorās or Masterās degree in computer science, Engineering, Mathematics, or a related field.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on diversityjobs.comGood distractions
Talks and stories from around this role ā technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
over 3 years ago
EM
Eli McGarvie
Data Engineer Salary UK
about 3 years ago
LM
Luis Minvielle
7 Cloud Computing Trends Coming in 2025 for Developers
over 2 years ago
AJ
Austin Joy
What Are The Top Skills Required For Azure Developers?
over 4 years ago
EM
Eli McGarvie
Best Companies to work for in London: Top 25 Companies in 2023
over 3 years ago
BB
Benedikt Bischof
Making Data Warehouses Fast: A Developerās Story
about 4 years ago