Data Engineer

Data Engineer with expertise in ETL development, Python, SQL, and cloud-based data processing, responsible for building and managing scalable data pipelines using Databricks, AWS, and modern DevOps practices., * Perform Develop and manage ETL processes using Python, PySpark, and SQL.

• Work with Databricks for data processing.
• Utilize AWS services like S3, CloudWatch, IAM, SNS, and Lambda.
• Familiarity with Terraform for infrastructure management.
• Work with Angular for front-end integration.
• Collaborate on version control using Git and deployment using Octopus and Azure DevOps.
• Support CI/CD processes using Git, Octopus, and Azure DevOps.
• Work within cloud-based data engineering environments and data processing frameworks.

• Engineering Degree BE/ME/BTech/MTech/BSc/MSc.
• Technical certification in multiple technologies is desirable.

Skills: -

Mandatory skills

• Strong ETL
• Python
• SQL
• PySpark
• Angular for front-end development
• Experience with AWS services (S3, CloudWatch, IAM, SNS, Lambda)
• Terraform knowledge
• Experience with Git, Octopus, and Azure DevOps for CI/CD

Good to Have Skills

• Databricks
• Terraform
• Angular
• Basic knowledge of Scala
• Basic knowledge of HL7