Data Engineer
Experis
Charlotte, United States of America
2 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Compensation
$ 114KJob location
Charlotte, United States of America
Tech stack
API
Agile Methodologies
Azure
Cloud Database
Continuous Integration
Data as a Services
ETL
Data Systems
Database Queries
Python
Performance Tuning
Cloud Services
SQL Databases
Data Processing
Azure
FastAPI
PySpark
Deployment Automation
Data Pipelines
Databricks
Job description
- Design, develop, and maintain scalable ETL/ELT data pipelines.
- Build and optimize data processing solutions using Python and PySpark.
- Develop and support cloud-native data platforms on Microsoft Azure.
- Work with Databricks, Azure Data Factory, and SQL-based data solutions.
- Collaborate with cross-functional teams to deliver high-quality data products.
- Implement CI/CD practices and support automated deployment processes.
- Develop APIs and data services using FastAPI and related technologies.
- Ensure data quality, governance, and performance optimization.
Requirements
- Strong experience with Python and PySpark
- Hands-on experience with Microsoft Azure
- Experience with Azure Databricks
- Expertise in Azure Data Factory (ADF)
- Strong SQL skills
- Experience building ETL/ELT pipelines
- Experience with FastAPI
- Knowledge of CI/CD tools and deployment practices, * Financial Services, Banking, or Capital Markets experience
- Experience working in Agile environments
- Strong problem-solving and analytical skills