Data Engineer with Python

Realign Llc
Malvern, United States of America
1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
$ 131K

Job location

Malvern, United States of America

Tech stack

API
Amazon Web Services (AWS)
Azure
Big Data
Cloud Computing
Information Engineering
Data Infrastructure
Data Integration
ETL
Data Mining
Data Visualization
Data Warehousing
Relational Databases
Hadoop
Python
PostgreSQL
Microsoft SQL Server
MySQL
NumPy
Power BI
SQL Databases
Tableau
Spark
GIT
Pandas
Data Lake
PySpark
Data Analytics
Kafka
Data Management
Tools for Reporting
Software Version Control
Data Pipelines

Job description

We are seeking a Data Engineer with strong Python expertise to design, build, and maintain scalable data pipelines and data infrastructure. The ideal candidate will work with large datasets, develop ETL processes, and support data analytics and business intelligence initiatives., Design, develop, and maintain scalable data pipelines using Python. Build and optimize ETL/ELT processes to ingest and transform large datasets from multiple sources. Develop and manage data models, data warehouses, and data lakes. Write efficient SQL queries for data extraction, transformation, and analysis. Ensure data quality, integrity, and governance across data platforms. Work closely with data scientists, analysts, and business stakeholders to understand data requirements. Monitor and troubleshoot data pipeline performance issues. Implement data integration solutions using APIs and streaming technologies. Support data visualization and reporting tools such as Power BI or Tableau.

Requirements

Do you have experience in Version control?, Strong experience with Python for data engineering (Pandas, PySpark, NumPy). Experience building ETL pipelines and data workflows. Proficiency in SQL and relational databases (PostgreSQL, MySQL, SQL Server, etc.). Experience with big data tools such as Apache Spark, Hadoop, or Kafka. Knowledge of data warehousing concepts and data modeling. Familiarity with cloud platforms such as AWS, Azure, or GCP. Experience with version control tools like Git.

Required Skills

PYTHON DEVELOPER

Apply for this position