Lead Data Engineer

World Market
Alameda, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 175K

Job location

Remote
Alameda, United States of America

Tech stack

Sql Data Warehouse
Airflow
Data analysis
Cloud Computing
Code Review
Continuous Integration
Information Engineering
Data Infrastructure
Data Transformation
Data Warehousing
Software Design Patterns
DevOps
Document-Oriented Databases
Github
Python
Release Management
Standard Sql
DataOps
Data Streaming
Snowflake
GIT
Data Delivery
Api Design
Terraform
Software Version Control
Data Pipelines
Jenkins

Job description

  • Design and implement scalable data pipelines and data infrastructure that support various business domains (customer, product, merchandising, and other data domains).
  • Design and implement data transformations, cleaning, and validation logic to produce trusted, well-documented data models for analytics use cases.
  • Build reusable frameworks, templates, and self-service tooling so both engineering and business teams can move faster.
  • Own source code management, documentation (technical and end-user), and release planning for data engineering products; lean into DataOps, DevOps, and CI/CD to deliver reliable, tested, and scalable functionality through automation.
  • Own end-to-end delivery and day-to-day production support of data products, actively monitoring pipeline health and troubleshooting failures to guarantee uptime and meet data delivery SLAs.
  • Document data definitions, transformations, and lineage for datasets you own.
  • Partner with the Snowflake Admin/Architect to evaluate new platform capabilities, design patterns, and storage/compute optimizations that accelerate delivery timelines.
  • Evaluate and adopt new tools and technologies to improve platform capability and speed of analytics delivery.
  • Partner with Analytics, Security, and Cloud Infra teams to ensure best practices are defined and implemented.
  • Partner directly with business stakeholders to translate business questions into data models and self-service datasets.
  • Set standards and patterns for how domain-specific data products are built on the platform; mentor engineers working across platform and analytics.

Requirements

This is a fully remote position, with responsibilities that require strong communication skills and the ability to thrive in a virtual work environment. Candidates located on or near the West Coast are preferred., * 10+ years of data engineering experience maintaining data platform technologies and supporting analytical teams.

  • 5+ years of hands-on experience with cloud data warehouse platforms (Snowflake).
  • Retail experience preferred.
  • Expert knowledge of SQL and Python.
  • Hands-on experience with pipeline orchestration tools (Airflow) and data transformation tooling (dbt).
  • Working knowledge of Git, CI/CD practices (GitHub Actions/Jenkins), and Infrastructure as Code (Terraform).
  • Hands-on experience with Kimball data warehouse modeling methodologies, alongside strong data modeling, data quality, and documentation practices.
  • Experience in API design; real-time streaming experience is a plus.
  • Experience providing production support, monitoring pipeline health, and triaging platform alerts to guarantee data delivery SLAs.
  • Experience performing root cause analysis for production issues and identifying opportunities for data platform improvement.
  • Passionate about writing clean, documented, and well-formed code, and performing regular code reviews.
  • Experience setting technical standards, mentoring engineers, and balancing platform scalability with domain-specific delivery needs.
  • Track record of partnering with business stakeholders in customer, product, or merchandising domains to translate requirements into robust data models.
  • Ability to work cross-functionally with Enterprise Architect, Security, and Cloud Infra teams, as well as collaborating with offshore teams.
  • Excellent written and verbal communication skills, with a proven ability to break down complex technical topics for non-technical audiences.

Benefits & conditions

Pulled from the full job description

  • Health insurance
  • 401(k) matching
  • Vision insurance
  • Dental insurance
  • Paid sick time
  • Life insurance
  • Employee assistance program, * Benefits that support health, financial security, and personal life needs. Learn more about benefits and eligibility for Medical, Dental, and Vision Insurance, and more!
  • Paid vacation and paid sick time
  • 401(k) plan with Roth option and company match
  • Employee Assistance Program and wellness resources to be and do your best
  • Sample Sales and up to 30% shopping discount on our unique finds for you and your designated shopper
  • Work life balance and work from home flexibility
  • Working with a team who thinks the world of you, CA Pay Range is $155,000 - $175,000 annually

#LI-LO1

#LI-Remote

Full time and Part time associates are eligible to participate in the Company's 401(k) retirement savings plan after three (3) months of service.

Benefits for full-time employment on the first of the month following 30 days of continuous employment include offerings for programs including Medical, Dental, Vision, Prescription Drug, Life Insurance, Flexible Spending, Commuter Benefits and Employee Assistance.

Apply for this position