Data Engineer
Intersources Inc.
1 month ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
EnglishJob location
Tech stack
Azure
Big Data
Continuous Integration
Data Validation
Information Engineering
Power BI
Azure
Azure
PySpark
Software Version Control
Data Pipelines
Job description
- Create Maintain and Enhance Big Data Pipeline
- Daily status reporting interacting with Leads
- Version control ADOGIT CICD
- Marketing Campaign experiences
- Data Platform Product telemetry Analytical thinking
- Data Validation of the new streams
- Data quality check of the new streams
- Monitoring of data pipeline created in Azure Data factory
- updating the Tech spec and wiki page for each implementation of pipeline
- Updating ADO on daily basis
Requirements
- Experience in Synapase with pyspark
- Knowledge of Big Data pipelines Data Engineering
- Working Knowledge on Azure Data factory Azure Data Lake and Azure Data lake storage
- Handson in Visualization like PowerBI
- Implement endend data pipelines using cosmos Azure Data factory
- Should have good analytical thinking and Problem solving
- Good communication and coordination skills
- Able to work as Individual contributor
