Sr Data Integration Engineer

Shared Success Center
Eden Prairie, MN, United States
24 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$153,000.0 - $178,000.0
Working hours
Regular working hours
Job source

Tech stack

Adobe Experience Manager Application Programming Interfaces (APIs) Airflow Amazon Web Services Data Analysis Application Performance Management Microsoft Azure BigQuery Cloud Database Customer Data Management Data Governance Data Infrastructure
+34 more
Data Integration Extract Transform Load (ETL) Dataspaces Data Warehousing Digital Architecture Python (Programming Language) Windows PowerShell Queueing Systems Salesforce.Com SQL Databases Data Streaming Systems Integration Talend Pulumi Google Cloud Informatica Powercenter System Availability Snowflake Reliability of Systems Git Cloudformation Event Driven Architecture Infrastructure Automation Frameworks Information Technology Low Latency Bicep Apache Kafka Apache Nifi Restful APIs Terraform Data Pipelines User Identification Databricks Microservices

Job description

  • Develop and maintain scalable data pipelines and workflows using Python and modern data tools.
  • Build and maintain production-grade data integrations across internal and third-party systems.
  • Code, test, deploy, orchestrate, monitor, document, and troubleshoot cloud-based data engineering processes and associated automation in accordance with best practices and security standards throughout the development lifecycle.
  • Design and implement a robust, scalable Customer Data Platform (CDP) to centralize and unify customer data from multiple sources (CRM, ERP, web, mobile, etc.).
  • Develop and maintain APIs and data pipelines to support real-time and batch data integration between the CDP and internal/external systems.
  1. Optimization & Performance * Optimize and manage data environments, including data modeling, security practices, and Lakehouse performance. * Monitor and optimize data flows and API performance to ensure high availability and low latency. * Troubleshoot and resolve data-related issues, ensuring system reliability and efficiency.

  2. Collaboration & Communication * Collaborate with cross-functional teams including marketing, product, engineering, and business stakeholders to define data requirements and integration strategies. * Communicate effectively with stakeholders, translating technical concepts into actionable insights.

  3. Governance & Compliance * Implement data governance and privacy practices to ensure compliance with regulations (e.g., GDPR, CCPA). * Ensure data quality, governance, and compliance with internal policies and external regulations.

  4. Tools & Automation * Utilize Git version control and CI/CD pipelines to deploy and manage data workflows. * Evaluate and recommend tools, platforms, and technologies to support the CDP and integration framework. * Document architecture, data flows, and integration patterns to support maintainability and scalability.

  5. Perform other duties as requested or as needed to fulfill the purpose of the job.

Performance Expectations

  • Meet all performance and behavior expectations outlined in the company performance appraisal form or communicated by management.
  • Perform responsibilities as directed achieving desired results within expected time frames and with a high degree of quality and professionalism.
  • Establish and maintain positive and productive work relationships with all staff, customers and business partners.
  • Demonstrate the behavioral and technical competencies necessary to effectively complete job responsibilities. Take personal initiative for technical and professional development.
  • Follow the company HR Policy, the Code of Business Conduct and all subsidiary and department policies and procedures, including protecting confidential company information, attending work punctually and regularly, and following good safety practices in all activities.

Requirements

  • Bachelor’s or Master’s degree in computer science, engineering, or related field., * 10+ years of experience with RESTful APIs.
  • 10+ years of experience with SQL, Python, or PowerShell.
  • 5+ years of experience with cloud platforms such as Azure, AWS, GCP, ect.
  • 5+ years of experience with cloud-native tools (ADF, Glue, Cloud Data Fusion, dbt, Airflow).
  • Proven experience building or integrating with Customer Data Platforms such as Segment, Salesforce CDP, Adobe Experience Platform, or custom-built solutions.
  • Experience with data integration tools such as Apache NiFi, Talend, Informatica, etc.
  • Experience with identity resolution, customer segmentation, and real-time personalization use cases preferred.

Knowledge and Skills:

  • Strong proficiency in ETL/ELT pipelines and data modeling.
  • Familiarity with event-driven architectures, message queues (ex., Kafka), and microservices.
  • Strong understanding of data privacy and security best practices.
  • Familiarity with CI/CD pipelines and Infrastructure as Code (IaC) tools (Bicep, Terraform, Pulumi, CloudFormation)
  • Knowledge of data warehousing and analytics platorms (ex. Snowflake, BigQuery, Databricks) preferred.

Benefits & conditions

Wage: $153,000 - $178,000 annually; actual wage is based upon education and experience. Potential for annual discretionary bonus.

Benefits: Full suite of benefits including Medical, Health Savings Account, Dental, Vision, Life Insurance, Paid Vacation (PTO), 401(k) with employer match, Flexible Spending Account, and Employee Assistance Program (EAP)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:56 min

Provisioning a secure container infrastructure with Bicep

Matthias Falkenberg +1 · World Congress 2022

1:55 min

Contrasting Terraform with Pulumi and cloud-specific tools

Devlin Duldulao · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

Videos

See all

Related articles

See all