Lead Data Quality Engineer

EPAM Systems, Inc.
Atlanta, GA, United States
1 day ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Languages
English

Tech stack

Amazon Web Services Data Analysis Automation of Tests Microsoft Azure Bash Shell Cloud Computing Databases Continuous Delivery Continuous Integration Data Cleansing Data Governance Data Integration
+20 more
Extract Transform Load (ETL) Linux Elasticsearch Apache Hadoop Python (Programming Language) NumPy Performance Tuning Standard Sql SQL Databases Test Case Strategies of Testing Data Processing Scripting Apache Spark Pandas Data Lakes Apache Kafka Data Management Data Pipelines Databricks

Job description

We are looking for a Lead Data Quality Engineer to drive the data quality testing strategy across our products, collaborating with cross-functional teams to ensure data reliability, governance, and performance meet the highest standards., * Work with product, engineering and customer teams to understand requirements and implement a quality testing strategy, defining and setting up data quality metrics

  • Design and implement a quality verification strategy for data products and ensure that all areas of the business perform according to the defined standards
  • Define priorities, risks and attributes in the data quality testing strategy, as well as choose proper data tools
  • Control and tune the data governance processes, including data preparation, generation, data obfuscation, data integration, data slicing and data quality control
  • Prepare data quality environments and applications in compliance with the standards
  • Design, monitor and maintain QA reports, KPIs and quality trends
  • Collaborate with all teams involved in data solution development to ensure efficient task execution for achieving results
  • Adhere to and promote quality standards

Requirements

  • 5+ years of hands-on engineering experience and practice in Data Management, Data Quality verification/Data Governance and Data Integration
  • Understanding of data pipelines, data lakes and ETL testing
  • Experience in CI/CD principles and best practices in data processing
  • Knowledge of SQL
  • Proficiency in Python or other scripting languages
  • Experience with one of the major cloud providers: AWS, Azure or GCP
  • Experience in building up a test automation framework and maintaining QA environments
  • Experience in data analysis and requirements validation
  • Concrete experience in Data project Test Strategy creation, Test Planning, Test Case design and test result reporting
  • Skills in infrastructure troubleshooting, support in performance tuning and optimization, and bottleneck problem analysis
  • Experience in leading a team and in direct customer communications
  • Analytical approach to problem solving, excellent interpersonal and communication skills, and English proficiency

Nice to have

  • Familiarity with a few data processing technologies, e.g., Spark, Hadoop, Kafka, Elasticsearch, Python libraries (Pandas/NumPy/etc.)
  • Understanding of various ETL Tools (e.g., Databricks)
  • Knowledge of Linux and Bash scripting basics

Skills: Amazon Web Services (AWS), Analysis Skills, Apache Hadoop, Apache Spark, Best Practices, Cloud Computing, Communication Skills, Concrete, Continuous Deployment/Delivery, Continuous Integration, Cross-Functional, Data Analysis, Data Management, Data Processing, Data Quality, Database Extract Transform and Load (ETL), Elasticsearch, Engineering, English Language, GCP (Good Clinical Practices), Identify Issues, Interpersonal Skills, Leadership, Microsoft Windows Azure, Performance Metrics, Performance Tuning/Optimization, Problem Solving Skills, Product Engineering, Python Programming/Scripting Language, Quality Assurance, Quality Engineering, Quality Metrics, Requirements Validation/Verification, SQL (Structured Query Language), Standards Development, Strategic Planning, Team Lead/Manager, Test Automation, Test Case, Test Design, Test Plan/Schedule, Test Strategy, Trend Analysis

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:34 min

Maximizing execution memory effectively via python numpy broadcasting

Jodie Burchell · LIVE

52 sec

Running persistent Linux environments directly on Windows

Ben Breard Ben Breard · World Congress 2025

2:03 min

Accelerating pandas dataframes using cudf module plugins

Ankit Patel Ankit Patel · World Congress 2024

6:08 min

Applying software engineering environments and testing to data pipelines

Matthias Niehoff Matthias Niehoff · World Congress 2024

1:25 min

Replacing NumPy with cuPy for straightforward GPU acceleration

Paul Graham Paul Graham · World Congress 2025

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

Videos

See all

Related articles

See all