Data Pipeline Engineer

Microsoft
Redmond, WA, United States
6 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Airflow Information Engineering Extract Transform Load (ETL) Data Security Data Warehousing Decision Support Systems Python (Programming Language) Cloud Services Standard Sql Workflow Management Systems Azure Data Factory Data Pipelines

Job description

Experteer Overview As a Data Pipeline Engineer, you will design, build, and operate scalable data pipelines that feed analytics and data science initiatives. You’ll work with data engineers, analysts, and stakeholders to deliver reliable datasets in modern cloud environments. You’ll focus on data quality, security, and performance to enable data-driven decision making and AI transformation for customers. This role sits within the Customer Service & Support data team and offers exposure to large-scale analytics and cloud platforms. Compensation / Benefits * Design, develop, and maintain batch and real-time data pipelines for ingestion, transformation, and delivery of enterprise data * Build scalable ETL/ELT solutions with monitoring, alerting, and data quality controls * Ensure data pipelines are reliable, performant, and cost-efficient; troubleshoot failures and bottlenecks * Design and optimize data models, data warehouses, lakehouses, and storage solutions; support legacy data migrations * Apply data security practices and ensure governance compliance * Collaborate with data scientists, analysts, engineers, and stakeholders to deliver trusted datasets Tasks * Bachelor’s Degree in a technical field and 3+ years in data engineering or related roles OR 5+ years of experience * Strong SQL and proficiency in Python or Scala * Experience building ETL/ELT pipelines and analytics-ready data modeling * Experience with orchestration tools (e.g., Airflow, Azure Data Factory) and cloud data platforms Key requirements *

Requirements

years * Apply data security practices and ensure governance compliance * Collaborate with data scientists, analysts, engineers, and stakeholders to deliver trusted datasets Tasks * Bachelor’s Degree in a technical field and 3+ years in data engineering or related roles OR 5+ years of experience * Strong SQL and proficiency in Python or Scala * Experience building ETL/ELT pipelines and analytics-ready data modeling * Experience with orchestration tools (e.g., Airflow, Azure Data Factory) and cloud data platforms Key requirements *

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on us.experteer.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

6:08 min

Applying software engineering environments and testing to data pipelines

Matthias Niehoff Matthias Niehoff · WWC 2024

4:06 min

Using ClickHouse as a foundation for fast analytics

Hellmar Becker Hellmar Becker · WWC Europe 2026

4:04 min

Embedding data security and applied ethics into developer education

Daniel Tao +3 · WWC 2024

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · WWC Europe 2026

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · WWC 2024

Videos

See all

Related articles

See all