Data Engineer
Intersources Inc.
United States
2 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www2.jobdiva.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Adobe InDesign
Agile Methodology
Amazon Web Services
Amazon S3
JIRA
Databases
Information Engineering
Extract Transform Load (ETL)
SQL Databases
Apache Spark
Gitlab
Data Lakes
+4 more
Pyspark
Amazon Simple Queue Service (SQS)
Data Pipelines
Databricks
Requirements
10+ years of experience in data engineering with Databricks and Spark Strong knowledge of Databricks architecture, tools and capabilities Experience in Design, develop, and optimize ETL/ELT data pipelines using Databricks on AWS. Good understanding of AWS native services - S3, DataSync, DMS, Lambda, SNS, SQS. SQL and PySpark : strong command over querying databases and proficiency in PySpark. Experience with Delta Lake and building data lakes. Familiarity with CI/CD pipelines using tools such as Gitlab. Good communication and presentation skills Agile trained and knowledge of JIRA
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www2.jobdiva.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦