Data Engineer
VeeRteq Solutions Inc
Chicago, IL, United States
about 2 months ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Amazon S3
Microsoft Azure
Cloud Database
Continuous Integration
Extract Transform Load (ETL)
DevOps
Identity and Access Management
Python (Programming Language)
Octopus Deploy
Standard Sql
Amazon Simple Notification Service (SNS)
+13 more
SQL Databases
Data Processing
Git
AngularJS
Pyspark
Health Level Seven International
Integration Frameworks
Front End Software Development
Functional Programming
Cloudwatch
Terraform
Data Pipelines
Databricks
Job description
Data Engineer with expertise in ETL development, Python, SQL, and cloud-based data processing, responsible for building and managing scalable data pipelines using Databricks, AWS, and modern DevOps practices., * Perform Develop and manage ETL processes using Python, PySpark, and SQL.
- Work with Databricks for data processing.
- Utilize AWS services like S3, CloudWatch, IAM, SNS, and Lambda.
- Familiarity with Terraform for infrastructure management.
- Work with Angular for front-end integration.
- Collaborate on version control using Git and deployment using Octopus and Azure DevOps.
- Support CI/CD processes using Git, Octopus, and Azure DevOps.
- Work within cloud-based data engineering environments and data processing frameworks.
Requirements
- Engineering Degree BE/ME/BTech/MTech/BSc/MSc.
- Technical certification in multiple technologies is desirable.
Skills: -
Mandatory skills
- Strong ETL
- Python
- SQL
- PySpark
- Angular for front-end development
- Experience with AWS services (S3, CloudWatch, IAM, SNS, Lambda)
- Terraform knowledge
- Experience with Git, Octopus, and Azure DevOps for CI/CD
Good to Have Skills
- Databricks
- Terraform
- Angular
- Basic knowledge of Scala
- Basic knowledge of HL7
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦