ETL Data Engineer
Vrddhi Solutions LLC
Charlotte, United States of America
5 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
EnglishJob location
Charlotte, United States of America
Tech stack
.NET
Azure
Big Data
C Sharp (Programming Language)
Information Engineering
Data Governance
ETL
Data Systems
Data Warehousing
Python
SQL Stored Procedures
SQL Databases
SQL Server Integration Services
Freeform SQL
Cloud Platform System
Data Ingestion
Azure
System Availability
Information Technology
Data Management
Data Pipelines
Databricks
Job description
- Design, develop, and maintain scalable data pipelines and ETL processes using SSIS, SQL, Azure Data Factory, and DataBricks.
- Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver robust data solutions.
- Develop and optimize complex SQL queries, stored procedures, and data models.
- Implement data ingestion, transformation, and orchestration workflows.
- Develop and maintain data integrations and workflows using C#, .NET, and Python.
- Ensure data quality, security, and compliance across all data platforms.
- Monitor and troubleshoot data pipelines to ensure high availability and performance.
- Stay updated with industry best practices and emerging technologies to improve data engineering processes.
Requirements
Skills required: SSIS, C#, SQL, Python, Data Factory, Data Bricks, .NET
Candidate must show the DL copy on video at the time of submission, * Proven experience as a Data Engineer with strong expertise in SSIS, SQL, Data Factory, and DataBricks.
- Hands-on experience in C#, .NET, and Python for data solution development.
- Solid understanding of data warehousing concepts and architecture.
- Experience with cloud-based data platforms, preferably Azure.
- Strong problem-solving skills and attention to detail.
- Excellent communication and teamwork skills.
- Bachelor's degree in Computer Science, Information Technology, or related field; Master's preferred.
Preferred Skills:
- Experience with other big data technologies and frameworks.
- Knowledge of data governance and security best practices.
- Familiarity with CI/CD pipelines and automation tools.