Data Pipeline Engineer

Microsoft
Redmond, WA, United States
3 months ago
Apply on us.experteer.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Airflow Information Engineering Extract Transform Load (ETL) Data Security Data Warehousing Decision Support Systems Python (Programming Language) Cloud Services Standard Sql Workflow Management Systems Azure Data Factory Data Pipelines

Job description

Experteer Overview As a Data Pipeline Engineer, you will design, build, and operate scalable data pipelines that feed analytics and data science initiatives. You’ll work with data engineers, analysts, and stakeholders to deliver reliable datasets in modern cloud environments. You’ll focus on data quality, security, and performance to enable data-driven decision making and AI transformation for customers. This role sits within the Customer Service & Support data team and offers exposure to large-scale analytics and cloud platforms. Compensation / Benefits * Design, develop, and maintain batch and real-time data pipelines for ingestion, transformation, and delivery of enterprise data * Build scalable ETL/ELT solutions with monitoring, alerting, and data quality controls * Ensure data pipelines are reliable, performant, and cost-efficient; troubleshoot failures and bottlenecks * Design and optimize data models, data warehouses, lakehouses, and storage solutions; support legacy data migrations * Apply data security practices and ensure governance compliance * Collaborate with data scientists, analysts, engineers, and stakeholders to deliver trusted datasets Tasks * Bachelor’s Degree in a technical field and 3+ years in data engineering or related roles OR 5+ years of experience * Strong SQL and proficiency in Python or Scala * Experience building ETL/ELT pipelines and analytics-ready data modeling * Experience with orchestration tools (e.g., Airflow, Azure Data Factory) and cloud data platforms Key requirements *

Requirements

years * Apply data security practices and ensure governance compliance * Collaborate with data scientists, analysts, engineers, and stakeholders to deliver trusted datasets Tasks * Bachelor’s Degree in a technical field and 3+ years in data engineering or related roles OR 5+ years of experience * Strong SQL and proficiency in Python or Scala * Experience building ETL/ELT pipelines and analytics-ready data modeling * Experience with orchestration tools (e.g., Airflow, Azure Data Factory) and cloud data platforms Key requirements *

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on us.experteer.com
Prepare application

Good distractions

Loading talks and stories from around this role…