Data Engineer

EXL SERVICE

United States

about 1 month ago

Apply on www.indeed.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

6 years minimum

Compensation

$100,000.0 - $135,000.0

Working hours

Regular working hours

Job source

www.indeed.com

Tech stack

Amazon Web Services Microsoft Azure Program Optimization Data Governance Extract Transform Load (ETL) Data Security Distributed Data Store Python (Programming Language) Metadata Cloud Services Standard Sql Data Ingestion

+5 more

Apache Spark Data Lakes Performance Monitor Data Pipelines Databricks

Job description

Build and maintain scalable data pipelines, warehouses, and lakes to ensure accurate, accessible, and secure data for analytics and reporting. Develop data ingestion, transformation, integration, and data quality capabilities.

Support data governance, monitoring, reconciliation, and platform optimization.

Responsibilities: Build and maintain scalable data pipelines, warehouses, and lakes to ensure accurate, accessible, and secure data for analytics and reporting. Develop data ingestion, transformation, integration, and data quality capabilities.

Support data governance, monitoring, reconciliation, and platform optimization.

Key Responsibilities:

Develop and optimise data pipelines and ETL/ELT processes.
Build and maintain data warehouse and data lake structures.
Ensure data quality, governance, and security across platforms.
Collaborate with data scientists and engineering teams.
Monitor performance and troubleshoot data workflows.

Requirements

Qualifications: Minimum 6 years of experience
Strong SQL, Python, Spark.
Python expertise (mandatory) and hands-on experience with AWS services and/or Databricks.
Experience with cloud data platforms AWS and/or Azure.
Knowledge of data modelling, governance, and metadata.
Understanding of large-scale distributed data